-- Logs begin at Sat 2022-09-24 04:21:40 UTC, end at Sat 2022-09-24 05:22:53 UTC. -- Sep 24 04:52:08.459711 dv-cinder-859186-1-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Sep 24 04:52:08.468710 dv-cinder-859186-1-iscsi devstack@n-api.service[105407]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Sep 24 04:52:08.470600 dv-cinder-859186-1-iscsi devstack@n-api.service[105407]: *** Starting uWSGI 2.0.18-debian (64bit) on [Sat Sep 24 04:52:08 2022] *** Sep 24 04:52:08.470600 dv-cinder-859186-1-iscsi devstack@n-api.service[105407]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Sep 24 04:52:08.470600 dv-cinder-859186-1-iscsi devstack@n-api.service[105407]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Sep 24 04:52:08.470600 dv-cinder-859186-1-iscsi devstack@n-api.service[105407]: nodename: dv-cinder-859186-1-iscsi Sep 24 04:52:08.470600 dv-cinder-859186-1-iscsi devstack@n-api.service[105407]: machine: x86_64 Sep 24 04:52:08.470600 dv-cinder-859186-1-iscsi devstack@n-api.service[105407]: clock source: unix Sep 24 04:52:08.470600 dv-cinder-859186-1-iscsi devstack@n-api.service[105407]: pcre jit disabled Sep 24 04:52:08.470600 dv-cinder-859186-1-iscsi devstack@n-api.service[105407]: detected number of CPU cores: 4 Sep 24 04:52:08.470600 dv-cinder-859186-1-iscsi devstack@n-api.service[105407]: current working directory: / Sep 24 04:52:08.470600 dv-cinder-859186-1-iscsi devstack@n-api.service[105407]: detected binary path: /usr/bin/uwsgi-core Sep 24 04:52:08.471276 dv-cinder-859186-1-iscsi devstack@n-api.service[105407]: your processes number limit is 47680 Sep 24 04:52:08.471276 dv-cinder-859186-1-iscsi devstack@n-api.service[105407]: your memory page size is 4096 bytes Sep 24 04:52:08.471276 dv-cinder-859186-1-iscsi devstack@n-api.service[105407]: detected max file descriptor number: 2048 Sep 24 04:52:08.471276 dv-cinder-859186-1-iscsi devstack@n-api.service[105407]: lock engine: pthread robust mutexes Sep 24 04:52:08.471276 dv-cinder-859186-1-iscsi devstack@n-api.service[105407]: thunder lock: enabled Sep 24 04:52:08.471276 dv-cinder-859186-1-iscsi devstack@n-api.service[105407]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Sep 24 04:52:08.471276 dv-cinder-859186-1-iscsi devstack@n-api.service[105407]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Sep 24 04:52:08.509346 dv-cinder-859186-1-iscsi devstack@n-api.service[105407]: Python main interpreter initialized at 0x55ef2c6f29c0 Sep 24 04:52:08.509346 dv-cinder-859186-1-iscsi devstack@n-api.service[105407]: python threads support enabled Sep 24 04:52:08.509346 dv-cinder-859186-1-iscsi devstack@n-api.service[105407]: your server socket listen backlog is limited to 100 connections Sep 24 04:52:08.509346 dv-cinder-859186-1-iscsi devstack@n-api.service[105407]: your mercy for graceful operations on workers is 90 seconds Sep 24 04:52:08.509675 dv-cinder-859186-1-iscsi devstack@n-api.service[105407]: mapped 403077 bytes (393 KB) for 2 cores Sep 24 04:52:08.509798 dv-cinder-859186-1-iscsi devstack@n-api.service[105407]: *** Operational MODE: preforking *** Sep 24 04:52:08.510034 dv-cinder-859186-1-iscsi devstack@n-api.service[105407]: *** uWSGI is running in multiple interpreter mode *** Sep 24 04:52:08.510034 dv-cinder-859186-1-iscsi devstack@n-api.service[105407]: spawned uWSGI master process (pid: 105407) Sep 24 04:52:08.510217 dv-cinder-859186-1-iscsi systemd[1]: Started Devstack devstack@n-api.service. Sep 24 04:52:08.511105 dv-cinder-859186-1-iscsi devstack@n-api.service[105407]: spawned uWSGI worker 1 (pid: 105408, cores: 1) Sep 24 04:52:08.511105 dv-cinder-859186-1-iscsi devstack@n-api.service[105407]: spawned uWSGI worker 2 (pid: 105409, cores: 1) Sep 24 04:52:08.512607 dv-cinder-859186-1-iscsi devstack@n-api.service[105407]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Sep 24 04:52:09.177423 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Sep 24 04:52:09.178047 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Sep 24 04:52:10.251619 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 24 04:52:10.251619 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: from cryptography.utils import int_from_bytes Sep 24 04:52:10.252336 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 24 04:52:10.252336 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: from cryptography.utils import int_from_bytes Sep 24 04:52:10.255565 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 24 04:52:10.255565 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: from cryptography.utils import int_from_bytes Sep 24 04:52:10.255984 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 24 04:52:10.255984 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: from cryptography.utils import int_from_bytes Sep 24 04:52:12.701336 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Sep 24 04:52:12.701803 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Sep 24 04:52:12.702140 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Sep 24 04:52:12.702501 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Sep 24 04:52:12.702755 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Sep 24 04:52:12.703136 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 04:52:12.703455 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 04:52:12.703775 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 04:52:12.704088 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 04:52:12.704413 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 04:52:12.704716 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 04:52:12.704813 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Sep 24 04:52:12.705193 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Sep 24 04:52:12.705274 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 04:52:12.705350 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 04:52:12.705474 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Sep 24 04:52:12.705634 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 04:52:12.705831 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Sep 24 04:52:12.705917 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 04:52:12.706115 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Sep 24 04:52:12.706219 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 04:52:12.706498 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 04:52:12.706596 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-859186-1-iscsi {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 04:52:12.706815 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 04:52:12.706911 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 04:52:12.707119 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 04:52:12.707256 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 04:52:12.707422 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 04:52:12.707557 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 04:52:12.707733 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 04:52:12.707858 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 04:52:12.708031 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 04:52:12.708163 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 04:52:12.708343 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 04:52:12.708469 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 04:52:12.708641 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 04:52:12.708771 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 04:52:12.708960 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 04:52:12.709140 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 04:52:12.709299 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 04:52:12.709511 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 04:52:12.709621 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 04:52:12.709826 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-859186-1-iscsi {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 04:52:12.709940 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 04:52:12.710163 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 04:52:12.710289 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 04:52:12.710490 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 04:52:12.710655 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 04:52:12.710807 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 04:52:12.710930 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 04:52:12.711059 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 04:52:12.711189 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 04:52:12.711359 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 04:52:12.711485 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 04:52:12.711715 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 04:52:12.711852 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 04:52:12.712035 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 04:52:12.712162 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 04:52:12.712284 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 04:52:12.712456 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 04:52:12.712653 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-859186-1-iscsi {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 04:52:12.712830 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 04:52:12.712964 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 04:52:12.713133 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 04:52:12.713259 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 04:52:12.713437 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 04:52:12.713564 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 04:52:12.713769 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 04:52:12.713950 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 04:52:12.714114 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 04:52:12.714283 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 04:52:12.714411 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 04:52:12.714586 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 04:52:12.714718 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 04:52:12.714901 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 04:52:12.715028 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 04:52:12.715232 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 04:52:12.715370 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 04:52:12.715533 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 04:52:12.715752 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 04:52:12.715892 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 04:52:12.716026 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-859186-1-iscsi {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 04:52:12.716150 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 04:52:12.716272 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 04:52:12.716451 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 04:52:12.716586 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 04:52:12.716765 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 04:52:12.716891 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 04:52:12.717064 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 04:52:12.717222 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 04:52:12.717360 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 04:52:12.717580 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 04:52:12.717726 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 04:52:12.717884 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 04:52:12.718047 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 04:52:12.718223 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 04:52:12.718367 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 04:52:12.718542 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 04:52:12.718670 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 04:52:12.718799 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 04:52:12.718921 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 04:52:12.719093 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 04:52:12.719230 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 04:52:12.719409 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 04:52:12.719536 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 04:52:12.719724 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 04:52:12.719856 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 04:52:12.720040 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 04:52:12.720172 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 04:52:12.720294 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 04:52:12.720424 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 04:52:12.720548 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 04:52:12.720671 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 04:52:12.720805 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 04:52:12.720929 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 04:52:12.721119 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 04:52:12.721246 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 04:52:12.721424 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 04:52:12.721557 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 04:52:12.721725 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 04:52:12.721933 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 04:52:12.722094 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 04:52:12.722216 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 04:52:12.722348 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 04:52:12.722481 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 04:52:12.722611 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 04:52:12.722739 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 04:52:12.722914 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 04:52:12.723044 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 04:52:12.723216 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 04:52:12.723360 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 04:52:12.723494 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 04:52:12.723615 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 04:52:12.723743 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 04:52:12.723866 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 04:52:12.724000 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 04:52:12.724131 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 04:52:12.724291 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 04:52:12.724419 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 04:52:12.724594 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 04:52:12.724725 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 04:52:12.724896 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 04:52:12.725029 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 04:52:12.725198 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 04:52:12.725390 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.50 {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 04:52:12.725516 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 04:52:12.725635 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.50 {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 04:52:12.725787 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 04:52:12.725918 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 04:52:12.726109 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 04:52:12.726277 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 04:52:12.726418 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 04:52:12.726593 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 04:52:12.726722 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 04:52:12.726896 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 04:52:12.727021 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 04:52:12.727208 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 04:52:12.727334 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 04:52:12.727526 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 04:52:12.727653 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 04:52:12.727830 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 04:52:12.727969 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 04:52:12.728131 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 04:52:12.728255 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 04:52:12.728433 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 04:52:12.728561 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.50 {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 04:52:12.728746 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 04:52:12.728877 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.50 {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 04:52:12.729073 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 04:52:12.729197 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 04:52:12.729372 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 04:52:12.729498 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 04:52:12.729627 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 04:52:12.729749 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 04:52:12.729902 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 04:52:12.730070 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 04:52:12.730226 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 04:52:12.730352 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 04:52:12.730538 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 04:52:12.730663 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 04:52:12.730838 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 04:52:12.730979 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 04:52:12.731137 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 04:52:12.731272 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 04:52:12.731436 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 04:52:12.731573 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 04:52:12.731731 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 04:52:12.731871 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 04:52:12.732033 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 04:52:12.732167 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 04:52:12.732333 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 04:52:12.732459 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 04:52:12.732626 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 04:52:12.732768 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 04:52:12.732923 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 04:52:12.733563 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 04:52:12.733759 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 04:52:12.733884 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 04:52:12.734083 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 04:52:12.734225 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 04:52:12.734385 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 04:52:12.734510 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 04:52:12.734687 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 04:52:12.734813 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 04:52:12.734985 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 04:52:12.735240 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 04:52:12.735373 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 04:52:12.735497 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 04:52:12.735618 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 04:52:12.735738 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 04:52:12.735868 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 04:52:12.735993 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 04:52:12.736146 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 04:52:12.736279 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 04:52:12.736448 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 04:52:12.736584 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 04:52:12.736746 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 04:52:12.736879 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 04:52:12.737043 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 04:52:12.737176 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 04:52:12.737344 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 04:52:12.737471 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 04:52:12.737641 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 04:52:12.737766 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 04:52:12.737939 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 04:52:12.738100 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 04:52:12.738265 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 04:52:12.738402 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 04:52:12.738564 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 04:52:12.738689 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 04:52:12.738860 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 04:52:12.738985 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 04:52:12.739168 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 04:52:12.739293 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 04:52:12.739466 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 04:52:12.739599 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 04:52:12.739763 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 04:52:12.739897 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 04:52:12.740065 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 04:52:12.740192 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 04:52:12.740356 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 04:52:12.740481 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 04:52:12.740656 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 04:52:12.740790 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 04:52:12.740957 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 04:52:12.741083 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 04:52:12.741278 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 04:52:12.741402 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 04:52:12.741531 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 04:52:12.741666 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 04:52:12.741823 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 04:52:12.741959 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 04:52:12.742182 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 04:52:12.742310 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 04:52:12.742432 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 04:52:12.742553 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 04:52:12.742707 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 04:52:12.742846 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 04:52:12.743002 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 04:52:12.743128 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 04:52:12.743297 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 04:52:12.743430 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 04:52:12.743593 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 04:52:12.743728 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 04:52:12.743903 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 04:52:12.744037 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 04:52:12.744199 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 04:52:12.744324 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 04:52:12.744501 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 04:52:12.744641 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 04:52:12.744798 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 04:52:12.744934 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 04:52:12.745094 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 04:52:12.745219 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 04:52:12.745388 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 04:52:12.745521 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 04:52:12.745687 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 04:52:12.745812 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.745984 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 04:52:12.746128 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.746305 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 04:52:12.746434 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.746601 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 04:52:12.746720 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.746913 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 04:52:12.747039 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.747230 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 04:52:12.747364 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.747532 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 04:52:12.747657 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.747834 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 04:52:12.747961 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.748132 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 04:52:12.748258 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.748444 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 04:52:12.748570 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.749317 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.749466 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.749628 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.749753 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.749937 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.750099 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.750277 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.750414 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.750594 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.750722 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.750919 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.751052 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.751231 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.751375 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.751541 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.751668 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.751854 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.752005 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.752160 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.752291 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.752469 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.752596 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.752776 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.752902 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.753080 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.753215 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.753381 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.753513 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.753693 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.753818 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.754038 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.754183 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.754354 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.754490 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.754667 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.754805 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.754980 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.755106 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.755284 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.755417 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.755587 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.755714 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.755892 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.756030 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.756207 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.756332 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.756511 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.756653 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.756816 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.756950 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.757129 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.757263 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.757435 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.757569 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.757753 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.757881 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.758081 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.758220 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.758386 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.758525 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.758690 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.758822 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.758992 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.759125 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.759295 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.759429 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.759620 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.759745 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.759927 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.760052 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.760235 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.760369 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.760542 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.760680 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.760849 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.760976 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.761159 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.761293 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.761492 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.761625 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.761747 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.761875 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.762077 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.762213 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.762378 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.762497 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.762677 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.762805 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.762974 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.763103 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.763277 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.763403 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.763580 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.763705 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.763907 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.764033 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.764203 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.764330 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.764792 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.764937 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.765120 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.765255 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.765420 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.765546 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.765725 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.765851 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.766041 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.766172 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.766344 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.766471 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.766642 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.766779 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.766939 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.767072 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.767240 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.767366 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.767542 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.767679 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.767845 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.767981 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.768151 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.768276 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.768451 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.768587 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.768753 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.768886 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.769056 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.769183 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.769355 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.769490 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.769650 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.769774 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.769955 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.770125 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.770280 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.770409 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.770582 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.770709 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.770884 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.771014 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.771197 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.771331 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.771498 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.771637 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.771800 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.771932 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.772100 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.772226 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.772401 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.772521 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.772711 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.772852 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.773016 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.773151 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.773319 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.773453 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.773625 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.773763 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.773925 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.774077 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.774256 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.774383 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.774556 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.774695 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.774856 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.774982 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.775154 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.775280 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.775457 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.775595 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.775754 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.775881 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.776052 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.776180 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.776348 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.776483 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.776645 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.776771 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.776940 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.777066 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.777243 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.777370 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.777541 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.777675 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.777836 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.777961 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.778141 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.778266 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.778441 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.778566 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.778736 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.778873 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.779034 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.779162 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.779332 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.779466 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.779628 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.779755 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.779961 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.780090 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.780278 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.780404 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.780579 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.780714 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.780874 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.781010 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.781177 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.781303 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.781473 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.781609 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.781780 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.781906 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.782108 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.782251 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.782424 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.782567 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.782729 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.782863 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.783042 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.783176 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.783352 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.783488 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.783657 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.783783 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.783961 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.784085 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.784263 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.784388 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.784557 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.784682 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.784859 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.784984 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.785165 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.785294 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.785477 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.785611 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.785781 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.785909 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.786114 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.786247 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.786418 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.786542 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.786727 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.786853 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.787028 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.787147 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.787329 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.787452 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.787624 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.787749 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.787926 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.788062 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.788237 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.788373 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.788540 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.788679 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.788850 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.788977 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.789152 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.789279 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.789455 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.789589 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.789758 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.789883 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.790061 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.790186 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.790372 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.790512 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.790678 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.790803 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.790978 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.791105 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.791297 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.791440 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.791600 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.791737 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.791906 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.792038 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.792240 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.792364 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.792506 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.792633 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.792807 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.792918 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.793112 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.793243 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.793406 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.793531 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.793705 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.793828 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.794042 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.794240 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.794399 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.794552 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.794705 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.794855 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.795028 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.795175 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.795328 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.795451 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.796117 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.796273 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.796406 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.796542 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.796670 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.796793 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.796957 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.797103 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.797255 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.797381 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.797561 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.797687 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.797870 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.798023 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.798198 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.798334 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.798505 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.798678 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.798806 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.799065 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.799199 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.799398 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.799527 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.799684 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.799821 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.799980 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.800107 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.800286 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.800421 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.800595 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.800730 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.800898 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.801025 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.801209 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.801335 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.801523 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.801660 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.801820 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.801946 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.802137 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.802262 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.802454 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.802592 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.802756 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.802875 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.803053 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.803186 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.803350 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.803486 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.803647 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.803773 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.803966 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.804093 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.804272 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.804399 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.804568 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.804694 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.804871 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.804996 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.805178 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.805306 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.805478 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.805602 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.805781 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.805913 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.806093 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.806258 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.806381 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.806510 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.806695 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.806822 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.806997 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.807123 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.807297 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.807421 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.807598 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.807730 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.807900 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.808025 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.808204 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.808460 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.808594 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.808790 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.808918 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.809097 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.809221 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.809400 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.809526 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.809704 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.809832 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.810016 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.810167 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.810325 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.810453 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.810636 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.810773 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.810985 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.811859 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.812174 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.812516 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.812822 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.813134 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.813428 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.813558 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.813727 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.813865 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.814055 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.814196 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.814365 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.814492 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.814665 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.814791 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.814966 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.815102 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.815266 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.815432 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.815559 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.815766 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.815892 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.816082 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.816262 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.816389 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.816511 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.816690 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.816818 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.816997 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.817125 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.817303 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.817423 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.817603 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.817737 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.817936 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.818093 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.818218 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.818340 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.818512 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.818637 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.818822 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.818956 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.819123 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.819255 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.819424 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.819564 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.819727 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.819862 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.820030 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.820157 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.820343 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.820478 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.820645 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.820774 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.820950 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.821076 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.821249 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.821384 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.821546 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.821679 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.821851 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.821985 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.822173 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.822311 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.822471 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.822603 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.822768 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.822900 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.823068 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.823187 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.823370 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.823506 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.823672 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.823798 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.823973 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.824102 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.824273 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.824400 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.824569 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.824702 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.824876 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.825004 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.825178 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.825304 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.825474 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.825615 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.825771 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.825897 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.826089 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.826228 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.826388 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.826521 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.826667 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.826813 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.827011 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.827138 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.827310 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.827447 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.827618 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.827743 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.827913 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.828037 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.828210 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.828346 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.828507 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.828632 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.828806 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.828937 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.829101 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.829238 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.829396 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.829529 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.829704 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.829829 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.830017 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.830147 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.830322 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.830446 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.830620 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.830760 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.830919 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.831046 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.831216 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.831341 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.831514 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.831659 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.831794 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.831916 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.832108 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.832236 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.832407 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.832542 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.832702 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.832828 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.832997 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.833122 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.833294 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.833427 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.833592 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.833718 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.833893 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.834040 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.834216 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.834357 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.834512 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.834645 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.834810 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.834935 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.835102 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.835241 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.835400 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.835529 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.835698 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.835823 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.835997 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.836125 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.836299 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.836458 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.836584 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.836706 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.836882 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.837010 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.837181 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.837309 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.837481 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.837607 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.837780 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.837908 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.838087 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.838224 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.838388 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.838515 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.838692 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.838820 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.838989 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.839115 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.839285 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.839422 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.839583 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.839711 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.839883 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.840017 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.840182 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.840322 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.840497 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.840624 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.840800 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.840927 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.841098 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.841234 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.841392 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.841518 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.841686 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.841813 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.842015 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.842155 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.842312 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.842958 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.843150 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.843271 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.843468 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.843610 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.843783 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.843912 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.844103 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.844238 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.844408 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.844535 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.844713 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.844839 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.845015 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.845140 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.845313 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.845447 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.845616 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.845743 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.845919 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.846062 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.846272 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.846408 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.846566 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.846691 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.846821 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.846945 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.847115 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.847243 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.847421 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.847556 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.847770 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.847914 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.848039 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.848162 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.848314 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.848441 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.848617 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.848758 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.848916 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.849041 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.849219 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.849354 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.849519 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.849654 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.849817 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.849942 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.850139 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.850266 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.850440 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.850579 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.850740 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.850867 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.851044 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.851169 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.851385 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.851525 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.851650 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.851780 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.851922 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.852046 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.852214 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.852344 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.852517 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.852651 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.852810 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.852939 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.853104 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.853240 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.853421 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.853550 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.853725 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.853898 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.854106 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.854236 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.854418 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.854553 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.854717 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.854854 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.855020 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.855148 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.855318 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.855445 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.855684 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.855818 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.856005 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.856131 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.856307 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.856433 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.856603 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.856743 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.856894 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.857020 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.857197 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.857321 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.857502 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.857640 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.857882 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.858115 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.858245 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.858368 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.858606 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.858735 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.858906 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.859034 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.859209 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.859334 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.859518 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.859654 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.859818 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.859944 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.860117 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.860244 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.860423 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.860551 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.860740 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.860867 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.861038 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.861165 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.861338 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.861473 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.861637 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.861767 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.861954 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.862114 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.862260 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.862399 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.862579 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.862707 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.862918 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.863043 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.863222 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.863374 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.863544 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.863672 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.863863 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.864080 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.864209 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.864385 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.864515 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.864694 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.864880 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.865007 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.865198 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.865333 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.865505 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.865632 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.865821 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.865948 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.866167 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.866305 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.866469 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.866596 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.866773 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.866909 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.867079 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.867215 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.867381 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.867509 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.867681 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.867815 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.868035 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.868168 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.868292 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.868420 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.868582 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.868710 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.868890 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.869018 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.869195 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.869329 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.869495 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.869623 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.869795 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.869922 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.870135 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.870264 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.870437 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.870585 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.870754 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.870881 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.871064 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.871191 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.871381 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.871516 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.871692 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.871816 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.871990 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.872114 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.872288 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.872423 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.872597 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.872722 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.872895 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.873020 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.873193 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.873328 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.873495 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.873614 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.874369 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.874498 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.874672 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.874802 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.874977 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.875113 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.875296 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.875426 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.875597 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.875726 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.875910 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.876045 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.876218 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.876342 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.876535 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.876662 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.876847 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.876974 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.877145 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.877270 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.877456 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.877584 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.877757 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.877882 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.878146 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.878297 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.878423 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.878553 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.878677 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.878799 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.878959 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.879098 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.879261 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.879388 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.879560 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.879694 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.879865 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.880006 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.880163 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.880292 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.880460 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.880585 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.880757 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.880982 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.881180 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.881371 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.881569 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.881793 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.882043 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.882258 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.882442 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.882578 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.882578 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.882824 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.882824 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.883066 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.883188 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.883310 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.883439 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.883563 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.883795 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.883965 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.884092 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.884287 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.884413 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.884618 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.884757 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.884927 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.885054 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.885247 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.885386 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.885559 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.885683 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.885852 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.885985 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.886191 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.886317 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.886495 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.886622 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.886796 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.886972 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.887097 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.887219 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.887384 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.887512 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.887694 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.887818 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.888008 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.888134 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.888345 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.888473 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.888620 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.888748 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.888938 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.889156 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.889327 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.890123 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.890268 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.890438 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.890565 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.890750 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.890878 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.891060 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.891188 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.891372 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.891500 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.891683 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.891811 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.891989 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.892116 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.892295 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.892422 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.892601 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.892730 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.892905 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.893032 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.893229 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.893438 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.893578 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.893745 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.893872 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.894076 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.894217 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.894385 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.894522 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.894692 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.894819 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.895001 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.895129 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.895315 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.895444 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.895620 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.895748 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.895924 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.896064 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.896229 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.896358 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.896535 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.896663 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.896858 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.897028 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.897175 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.897303 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.897482 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.897618 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.897790 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.897918 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.898123 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.898263 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.898476 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.898612 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.898752 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.898878 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.899001 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.899123 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.899308 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.899445 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.899617 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.899746 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.899938 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.900065 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.900296 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.900506 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.900635 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.900758 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.900879 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.901003 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.901150 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.901290 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.901457 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.901587 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.901765 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.901970 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.902115 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.902303 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.902432 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.902631 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.902759 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.902951 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.903089 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.903269 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.903394 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.903578 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.903706 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.903889 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.904025 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.904205 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.904331 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.904504 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.904631 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.904805 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.904960 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.905133 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.905261 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.905438 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.905663 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.905803 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.905973 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.906123 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.906328 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.906448 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.906648 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.906792 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.906959 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.907132 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.907258 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.907380 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.907566 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.907776 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.907913 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.908122 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.908248 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.908450 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.908582 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.908750 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.908877 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.909055 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.909200 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.909355 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.909491 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.909655 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.909794 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.909962 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.910109 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.910287 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.910426 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.910591 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.910725 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.910891 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.911017 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.911197 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.911418 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.911547 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.911762 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.911889 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.912073 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.912242 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.912377 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.912500 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.912658 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.912785 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.912963 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.913099 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.913263 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.913391 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.913587 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.913715 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.913884 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.914048 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.914208 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.914335 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.914505 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.914630 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.914812 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.914948 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.915110 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.915244 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.915407 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.915532 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.915710 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.915844 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.916012 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.916138 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.916306 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.916439 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.916605 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.916738 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.916903 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.917028 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.917186 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.917311 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.917491 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.917627 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.917796 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.917928 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.918115 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.918244 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.918421 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.918557 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.918719 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.918848 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.919018 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.919144 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.919317 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.919445 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.919612 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.919738 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.919918 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.920052 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.920213 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.920342 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.920546 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.920674 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.920849 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.920983 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.921155 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.921284 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.921483 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.921608 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.921792 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.922032 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.922165 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.922364 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.922503 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.922683 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.922805 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.922994 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.923120 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.923304 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.923431 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.923608 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.923748 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.923914 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.924040 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.924215 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.924342 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.924519 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.924664 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.924831 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.924956 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.925140 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.925268 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.925446 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.925668 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.925798 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.926017 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.926148 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.926334 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.926477 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.926655 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.926790 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.926960 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.927088 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.927249 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.927384 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.927551 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.927678 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.927849 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.927974 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.928150 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.928285 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.928452 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.928579 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.928756 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.928884 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.929061 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.929268 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.929395 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.929519 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.929640 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.929770 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.929945 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.930139 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.930263 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.930385 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.930564 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.930704 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.930868 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.930997 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.931171 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.931298 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.931473 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.931604 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.931775 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.931902 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.932075 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.932200 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.932378 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.932513 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.932686 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.932815 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.932986 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.933114 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.933322 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.933632 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.933758 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.933940 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.934098 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.934274 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.934410 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.934579 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.934714 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.934883 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.935009 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.935189 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.935323 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.935492 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.935620 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.935802 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.935936 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.936116 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.936763 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.936947 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.937073 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.937295 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.937426 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.937597 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.937922 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.938075 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.938255 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.938382 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.938559 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.938695 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.938860 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.938987 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.939161 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.939288 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.939465 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.939606 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.939780 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.939906 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.940085 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.940210 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.940381 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.940516 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.940681 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.940817 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.940987 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.941113 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.941284 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.941414 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.941583 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.941710 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.941882 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.942028 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.942206 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.942360 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.942507 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.942634 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.942805 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.942932 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.943103 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.943231 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.943401 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.943536 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.943698 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.943825 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.943996 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.944124 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.944292 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.944417 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.944592 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.944726 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.944890 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.945026 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.945188 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.945320 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.945486 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.945625 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.945782 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.945915 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.946106 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.946234 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.946406 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.946546 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.946707 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.946834 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.947005 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.947131 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.947301 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.947474 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.947600 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.947724 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.947886 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.948014 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.948189 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.948317 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.948488 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.948609 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.948789 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.948916 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.949088 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.949224 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.949388 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.949514 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.949685 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.949813 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.950026 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.950157 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.950355 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.950482 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.950663 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.950795 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.950967 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.951093 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.951272 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.951399 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.951578 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.951713 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.952454 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.952586 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.952781 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.952907 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.953086 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.953223 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.953395 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.953520 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.953702 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.953828 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.954030 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.954171 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.954346 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.954474 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.954651 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.954778 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.954958 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.955085 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.955263 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.955400 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.955570 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.955694 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.955876 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.956004 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.956190 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.956318 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.956496 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.956622 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.956801 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.956935 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.957106 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.957239 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.957415 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.957584 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.957730 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.957865 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.958046 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.958171 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.958355 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.958559 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.958676 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.958797 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.958975 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.959100 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.959281 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.959418 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.959586 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.959712 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.959893 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.960028 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.960200 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.960341 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.960510 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.960637 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.960816 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.960943 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.961123 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.961252 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.961448 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.961611 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.961735 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.961866 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.962021 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=105408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Sep 24 04:52:12.962147 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.962382 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.962687 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.963009 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.963329 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.963672 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.963981 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.964416 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.964743 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.965054 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.965364 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.965670 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:52:12.965909 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=105409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Sep 24 04:52:13.113099 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: INFO dbcounter [None req-ec902411-df69-4e8a-9d97-9e9cba2fba1a None None] Registered counter for database nova_api Sep 24 04:52:13.117033 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: INFO dbcounter [None req-64ac51bf-7129-481b-825a-17e3c3a552ab None None] Registered counter for database nova_api Sep 24 04:52:13.133251 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: DEBUG oslo_db.sqlalchemy.engines [None req-ec902411-df69-4e8a-9d97-9e9cba2fba1a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105408) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 24 04:52:13.136726 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: DEBUG oslo_db.sqlalchemy.engines [None req-64ac51bf-7129-481b-825a-17e3c3a552ab None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105409) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 24 04:52:13.140509 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: DEBUG dbcounter [-] [105408] Writer thread running {{(pid=105408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 24 04:52:13.143852 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: DEBUG dbcounter [-] [105409] Writer thread running {{(pid=105409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 24 04:52:13.196737 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: DEBUG nova.context [None req-ec902411-df69-4e8a-9d97-9e9cba2fba1a None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),47a24eaf-35b3-42cb-8a92-f2a747d63cec(cell1) {{(pid=105408) load_cells /opt/stack/nova/nova/context.py:464}} Sep 24 04:52:13.199776 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: DEBUG nova.context [None req-64ac51bf-7129-481b-825a-17e3c3a552ab None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),47a24eaf-35b3-42cb-8a92-f2a747d63cec(cell1) {{(pid=105409) load_cells /opt/stack/nova/nova/context.py:464}} Sep 24 04:52:13.200547 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: DEBUG oslo_concurrency.lockutils [None req-ec902411-df69-4e8a-9d97-9e9cba2fba1a None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 04:52:13.201014 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: DEBUG oslo_concurrency.lockutils [None req-ec902411-df69-4e8a-9d97-9e9cba2fba1a None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=105408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 04:52:13.203144 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: DEBUG oslo_concurrency.lockutils [None req-ec902411-df69-4e8a-9d97-9e9cba2fba1a None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=105408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 04:52:13.203872 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: DEBUG oslo_concurrency.lockutils [None req-ec902411-df69-4e8a-9d97-9e9cba2fba1a None None] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 04:52:13.204213 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: DEBUG oslo_concurrency.lockutils [None req-64ac51bf-7129-481b-825a-17e3c3a552ab None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 04:52:13.204327 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: DEBUG oslo_concurrency.lockutils [None req-ec902411-df69-4e8a-9d97-9e9cba2fba1a None None] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 04:52:13.204687 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: DEBUG oslo_concurrency.lockutils [None req-64ac51bf-7129-481b-825a-17e3c3a552ab None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=105409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 04:52:13.206259 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: DEBUG oslo_concurrency.lockutils [None req-64ac51bf-7129-481b-825a-17e3c3a552ab None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=105409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 04:52:13.206371 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: DEBUG oslo_concurrency.lockutils [None req-ec902411-df69-4e8a-9d97-9e9cba2fba1a None None] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=105408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 04:52:13.206974 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: DEBUG oslo_concurrency.lockutils [None req-64ac51bf-7129-481b-825a-17e3c3a552ab None None] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 04:52:13.207412 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: DEBUG oslo_concurrency.lockutils [None req-64ac51bf-7129-481b-825a-17e3c3a552ab None None] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 04:52:13.208212 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: INFO dbcounter [None req-ec902411-df69-4e8a-9d97-9e9cba2fba1a None None] Registered counter for database nova_cell0 Sep 24 04:52:13.209354 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: DEBUG oslo_concurrency.lockutils [None req-64ac51bf-7129-481b-825a-17e3c3a552ab None None] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=105409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 04:52:13.211347 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: INFO dbcounter [None req-64ac51bf-7129-481b-825a-17e3c3a552ab None None] Registered counter for database nova_cell0 Sep 24 04:52:13.212172 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: INFO dbcounter [None req-ec902411-df69-4e8a-9d97-9e9cba2fba1a None None] Registered counter for database nova_cell1 Sep 24 04:52:13.215253 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: INFO dbcounter [None req-64ac51bf-7129-481b-825a-17e3c3a552ab None None] Registered counter for database nova_cell1 Sep 24 04:52:13.220038 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: DEBUG oslo_db.sqlalchemy.engines [None req-ec902411-df69-4e8a-9d97-9e9cba2fba1a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105408) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 24 04:52:13.222741 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: DEBUG oslo_db.sqlalchemy.engines [None req-ec902411-df69-4e8a-9d97-9e9cba2fba1a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105408) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 24 04:52:13.223658 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: DEBUG oslo_db.sqlalchemy.engines [None req-64ac51bf-7129-481b-825a-17e3c3a552ab None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105409) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 24 04:52:13.227013 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: DEBUG dbcounter [-] [105408] Writer thread running {{(pid=105408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 24 04:52:13.227144 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: DEBUG oslo_db.sqlalchemy.engines [None req-64ac51bf-7129-481b-825a-17e3c3a552ab None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105409) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 24 04:52:13.229572 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: DEBUG dbcounter [-] [105409] Writer thread running {{(pid=105409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 24 04:52:13.364938 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: DEBUG dbcounter [-] [105408] Writer thread running {{(pid=105408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 24 04:52:13.366794 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: DEBUG dbcounter [-] [105409] Writer thread running {{(pid=105409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 24 04:52:13.374754 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: INFO dbcounter [None req-ec902411-df69-4e8a-9d97-9e9cba2fba1a None None] Registered counter for database nova_cell0 Sep 24 04:52:13.375847 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: INFO dbcounter [None req-64ac51bf-7129-481b-825a-17e3c3a552ab None None] Registered counter for database nova_cell0 Sep 24 04:52:13.383674 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: DEBUG oslo_db.sqlalchemy.engines [None req-ec902411-df69-4e8a-9d97-9e9cba2fba1a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105408) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 24 04:52:13.387140 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: DEBUG oslo_db.sqlalchemy.engines [None req-64ac51bf-7129-481b-825a-17e3c3a552ab None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105409) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 24 04:52:13.388312 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: DEBUG dbcounter [-] [105408] Writer thread running {{(pid=105408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 24 04:52:13.392381 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: DEBUG dbcounter [-] [105409] Writer thread running {{(pid=105409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 24 04:52:13.724252 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: WARNING keystonemiddleware.auth_token [None req-64ac51bf-7129-481b-825a-17e3c3a552ab None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 24 04:52:13.726177 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: WARNING keystonemiddleware.auth_token [None req-ec902411-df69-4e8a-9d97-9e9cba2fba1a None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 24 04:52:13.731505 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: WARNING keystonemiddleware.auth_token [None req-64ac51bf-7129-481b-825a-17e3c3a552ab None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 24 04:52:13.733380 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: WARNING keystonemiddleware.auth_token [None req-ec902411-df69-4e8a-9d97-9e9cba2fba1a None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 24 04:52:14.074475 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: WARNING keystonemiddleware.auth_token [None req-64ac51bf-7129-481b-825a-17e3c3a552ab None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 24 04:52:14.080403 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: WARNING keystonemiddleware.auth_token [None req-ec902411-df69-4e8a-9d97-9e9cba2fba1a None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 24 04:52:14.081079 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: WARNING keystonemiddleware.auth_token [None req-64ac51bf-7129-481b-825a-17e3c3a552ab None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 24 04:52:14.086319 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55ef2c6f29c0 pid: 105409 (default app) Sep 24 04:52:14.086447 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: WARNING keystonemiddleware.auth_token [None req-ec902411-df69-4e8a-9d97-9e9cba2fba1a None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 24 04:52:14.088403 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi [None req-64ac51bf-7129-481b-825a-17e3c3a552ab None None] Calling method '>' {{(pid=105409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 04:52:14.089565 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: INFO nova.api.openstack.requestlog [None req-64ac51bf-7129-481b-825a-17e3c3a552ab None None] 10.222.0.50 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001745 Sep 24 04:52:14.089955 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: [pid: 105409|app: 0|req: 1/1] 10.222.0.50 () {50 vars in 788 bytes} [Sat Sep 24 04:52:14 2022] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 04:52:14.091598 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55ef2c6f29c0 pid: 105408 (default app) Sep 24 04:53:35.118531 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi [None req-64ac51bf-7129-481b-825a-17e3c3a552ab None None] Calling method '>' {{(pid=105409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 04:53:35.120251 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: INFO nova.api.openstack.requestlog [None req-64ac51bf-7129-481b-825a-17e3c3a552ab None None] 10.222.0.50 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002188 Sep 24 04:53:35.123583 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: [pid: 105409|app: 0|req: 2/2] 10.222.0.50 () {54 vars in 931 bytes} [Sat Sep 24 04:53:35 2022] GET /compute/v2.1 => generated 388 bytes in 6 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 04:53:35.139352 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: DEBUG dbcounter [-] [105408] Writing DB stats nova_api:SELECT=3 {{(pid=105408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 04:53:35.140957 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: DEBUG dbcounter [-] [105408] Writing DB stats nova_cell1:SELECT=3 {{(pid=105408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 04:53:35.142511 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: DEBUG dbcounter [-] [105408] Writing DB stats nova_cell0:SELECT=3 {{(pid=105408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 04:53:35.143940 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: DEBUG dbcounter [-] [105408] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=105408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 04:53:35.992403 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi [None req-35a44699-ef94-4697-84c2-0b4cc840f67d admin admin] Calling method '>' {{(pid=105408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 04:53:36.025919 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: INFO nova.api.openstack.requestlog [None req-35a44699-ef94-4697-84c2-0b4cc840f67d admin admin] 10.222.0.50 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.897846 Sep 24 04:53:36.026774 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: [pid: 105408|app: 0|req: 1/3] 10.222.0.50 () {60 vars in 1292 bytes} [Sat Sep 24 04:53:35 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 900 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 04:53:38.653613 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi [None req-64ac51bf-7129-481b-825a-17e3c3a552ab None None] Calling method '>' {{(pid=105409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 04:53:38.654636 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: INFO nova.api.openstack.requestlog [None req-64ac51bf-7129-481b-825a-17e3c3a552ab None None] 10.222.0.50 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.003641 Sep 24 04:53:38.656709 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: [pid: 105409|app: 0|req: 3/4] 10.222.0.50 () {54 vars in 931 bytes} [Sat Sep 24 04:53:38 2022] GET /compute/v2.1 => generated 388 bytes in 6 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 04:53:39.122270 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi [None req-fe218398-8906-409c-8dfc-c6e78795d5b0 admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "ram": 256, "swap": 0, "rxtx_factor": 1.0, "id": "c1", "disk": 1, "name": "cirros256", "vcpus": 1, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=105408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 04:53:39.174380 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: INFO nova.api.openstack.requestlog [None req-fe218398-8906-409c-8dfc-c6e78795d5b0 admin admin] 10.222.0.50 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.510887 Sep 24 04:53:39.174939 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: [pid: 105408|app: 0|req: 2/5] 10.222.0.50 () {64 vars in 1283 bytes} [Sat Sep 24 04:53:38 2022] POST /compute/v2.1/flavors => generated 407 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 24 04:53:39.193344 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: DEBUG dbcounter [-] [105409] Writing DB stats nova_api:SELECT=3 {{(pid=105409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 04:53:39.196116 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: DEBUG dbcounter [-] [105409] Writing DB stats nova_cell0:SELECT=3 {{(pid=105409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 04:53:39.197188 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: DEBUG dbcounter [-] [105409] Writing DB stats nova_cell1:SELECT=3 {{(pid=105409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 04:53:39.198635 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: DEBUG dbcounter [-] [105409] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=105409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 04:53:39.428644 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi [None req-580cfec9-c307-4bcf-982b-2962d7688d36 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 04:53:39.498345 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: INFO nova.api.openstack.requestlog [None req-580cfec9-c307-4bcf-982b-2962d7688d36 admin admin] 10.222.0.50 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.314287 Sep 24 04:53:39.498931 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: [pid: 105409|app: 0|req: 4/6] 10.222.0.50 () {64 vars in 1336 bytes} [Sat Sep 24 04:53:39 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 04:53:42.102337 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi [None req-fe218398-8906-409c-8dfc-c6e78795d5b0 admin admin] Calling method '>' {{(pid=105408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 04:53:42.103448 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: INFO nova.api.openstack.requestlog [None req-fe218398-8906-409c-8dfc-c6e78795d5b0 admin admin] 10.222.0.50 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001511 Sep 24 04:53:42.104112 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: [pid: 105408|app: 0|req: 3/7] 10.222.0.50 () {54 vars in 931 bytes} [Sat Sep 24 04:53:42 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 04:53:42.798967 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi [None req-3d8ad4f9-3d9c-445c-aeb3-19c0c5a0a9da admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "id": "d1", "name": "ds512M", "os-flavor-access:is_public": true, "rxtx_factor": 1.0, "ram": 512, "vcpus": 1, "swap": 0, "disk": 5}} {{(pid=105409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 04:53:42.838081 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: INFO nova.api.openstack.requestlog [None req-3d8ad4f9-3d9c-445c-aeb3-19c0c5a0a9da admin admin] 10.222.0.50 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.727971 Sep 24 04:53:42.838872 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: [pid: 105409|app: 0|req: 5/8] 10.222.0.50 () {64 vars in 1283 bytes} [Sat Sep 24 04:53:42 2022] POST /compute/v2.1/flavors => generated 404 bytes in 729 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 24 04:53:42.851578 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi [None req-bff03e62-ef8b-429e-9f9e-d264668e6379 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 04:53:42.904613 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: INFO nova.api.openstack.requestlog [None req-bff03e62-ef8b-429e-9f9e-d264668e6379 admin admin] 10.222.0.50 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.056717 Sep 24 04:53:42.905385 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: [pid: 105408|app: 0|req: 4/9] 10.222.0.50 () {64 vars in 1336 bytes} [Sat Sep 24 04:53:42 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 04:53:45.548285 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi [None req-3d8ad4f9-3d9c-445c-aeb3-19c0c5a0a9da admin admin] Calling method '>' {{(pid=105409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 04:53:45.549301 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: INFO nova.api.openstack.requestlog [None req-3d8ad4f9-3d9c-445c-aeb3-19c0c5a0a9da admin admin] 10.222.0.50 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001488 Sep 24 04:53:45.549743 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: [pid: 105409|app: 0|req: 6/10] 10.222.0.50 () {54 vars in 931 bytes} [Sat Sep 24 04:53:45 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 04:53:45.973002 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi [None req-c7a0452c-e15f-480f-a6a6-b05d76d93683 admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "ram": 1024, "vcpus": 1, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "name": "ds1G", "disk": 10, "os-flavor-access:is_public": true, "id": "d2"}} {{(pid=105408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 04:53:45.991279 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: INFO nova.api.openstack.requestlog [None req-c7a0452c-e15f-480f-a6a6-b05d76d93683 admin admin] 10.222.0.50 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.434628 Sep 24 04:53:45.991834 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: [pid: 105408|app: 0|req: 5/11] 10.222.0.50 () {64 vars in 1283 bytes} [Sat Sep 24 04:53:45 2022] POST /compute/v2.1/flavors => generated 404 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 24 04:53:46.004526 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi [None req-8cf1e5bf-877e-4957-bd69-5238d7747636 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 04:53:46.033509 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: INFO nova.api.openstack.requestlog [None req-8cf1e5bf-877e-4957-bd69-5238d7747636 admin admin] 10.222.0.50 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.033248 Sep 24 04:53:46.034106 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: [pid: 105409|app: 0|req: 7/12] 10.222.0.50 () {64 vars in 1336 bytes} [Sat Sep 24 04:53:45 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 24 04:53:48.653548 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi [None req-c7a0452c-e15f-480f-a6a6-b05d76d93683 admin admin] Calling method '>' {{(pid=105408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 04:53:48.655219 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: INFO nova.api.openstack.requestlog [None req-c7a0452c-e15f-480f-a6a6-b05d76d93683 admin admin] 10.222.0.50 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002195 Sep 24 04:53:48.660023 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: [pid: 105408|app: 0|req: 6/13] 10.222.0.50 () {54 vars in 931 bytes} [Sat Sep 24 04:53:48 2022] GET /compute/v2.1 => generated 388 bytes in 7 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 04:53:49.065616 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi [None req-7d6245a9-2135-4c67-ace3-3816e2040acf admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 2048, "id": "d3", "os-flavor-access:is_public": true, "name": "ds2G", "rxtx_factor": 1.0, "swap": 0, "vcpus": 2, "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 10}} {{(pid=105409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 04:53:49.085630 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: INFO nova.api.openstack.requestlog [None req-7d6245a9-2135-4c67-ace3-3816e2040acf admin admin] 10.222.0.50 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.423301 Sep 24 04:53:49.086558 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: [pid: 105409|app: 0|req: 8/14] 10.222.0.50 () {64 vars in 1283 bytes} [Sat Sep 24 04:53:48 2022] POST /compute/v2.1/flavors => generated 404 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 24 04:53:49.098268 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi [None req-83345ff6-c494-4a3c-9853-0232a30aeb98 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 04:53:49.125742 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: INFO nova.api.openstack.requestlog [None req-83345ff6-c494-4a3c-9853-0232a30aeb98 admin admin] 10.222.0.50 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.031114 Sep 24 04:53:49.127248 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: [pid: 105408|app: 0|req: 7/15] 10.222.0.50 () {64 vars in 1336 bytes} [Sat Sep 24 04:53:49 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 24 04:53:51.722704 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi [None req-7d6245a9-2135-4c67-ace3-3816e2040acf admin admin] Calling method '>' {{(pid=105409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 04:53:51.723714 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: INFO nova.api.openstack.requestlog [None req-7d6245a9-2135-4c67-ace3-3816e2040acf admin admin] 10.222.0.50 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001522 Sep 24 04:53:51.724111 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: [pid: 105409|app: 0|req: 9/16] 10.222.0.50 () {54 vars in 931 bytes} [Sat Sep 24 04:53:51 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 04:53:52.156994 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi [None req-e3ce33c7-fd54-4fd0-92fb-3d049b8de139 admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "name": "ds4G", "vcpus": 4, "id": "d4", "swap": 0, "disk": 20, "ram": 4096}} {{(pid=105408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 04:53:52.175845 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: INFO nova.api.openstack.requestlog [None req-e3ce33c7-fd54-4fd0-92fb-3d049b8de139 admin admin] 10.222.0.50 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.445560 Sep 24 04:53:52.176386 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: [pid: 105408|app: 0|req: 8/17] 10.222.0.50 () {64 vars in 1283 bytes} [Sat Sep 24 04:53:51 2022] POST /compute/v2.1/flavors => generated 404 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 24 04:53:52.189269 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi [None req-e3365e2b-9fc9-43d6-a038-57443a6f0880 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 04:53:52.213847 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: INFO nova.api.openstack.requestlog [None req-e3365e2b-9fc9-43d6-a038-57443a6f0880 admin admin] 10.222.0.50 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.029064 Sep 24 04:53:52.214462 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: [pid: 105409|app: 0|req: 10/18] 10.222.0.50 () {64 vars in 1336 bytes} [Sat Sep 24 04:53:52 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 04:53:55.069053 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi [None req-e3ce33c7-fd54-4fd0-92fb-3d049b8de139 admin admin] Calling method '>' {{(pid=105408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 04:53:55.070143 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: INFO nova.api.openstack.requestlog [None req-e3ce33c7-fd54-4fd0-92fb-3d049b8de139 admin admin] 10.222.0.50 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001560 Sep 24 04:53:55.070559 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: [pid: 105408|app: 0|req: 9/19] 10.222.0.50 () {54 vars in 931 bytes} [Sat Sep 24 04:53:55 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 04:53:55.487070 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi [None req-54bfdfdf-02bc-4217-86cc-61500f726fc6 admin admin] Calling method '>' {{(pid=105409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 04:53:55.518326 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: INFO nova.api.openstack.requestlog [None req-54bfdfdf-02bc-4217-86cc-61500f726fc6 admin admin] 10.222.0.50 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.441303 Sep 24 04:53:55.519021 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: [pid: 105409|app: 0|req: 11/20] 10.222.0.50 () {60 vars in 1292 bytes} [Sat Sep 24 04:53:55 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 04:53:58.189195 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi [None req-e3ce33c7-fd54-4fd0-92fb-3d049b8de139 admin admin] Calling method '>' {{(pid=105408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 04:53:58.190162 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: INFO nova.api.openstack.requestlog [None req-e3ce33c7-fd54-4fd0-92fb-3d049b8de139 admin admin] 10.222.0.50 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002010 Sep 24 04:53:58.190572 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: [pid: 105408|app: 0|req: 10/21] 10.222.0.50 () {54 vars in 931 bytes} [Sat Sep 24 04:53:58 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 04:53:58.599068 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi [None req-96c03d06-63be-481b-bb68-591762c5677c admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "1", "name": "m1.tiny", "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "disk": 1, "rxtx_factor": 1.0, "vcpus": 1, "ram": 512, "swap": 0}} {{(pid=105409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 04:53:58.620128 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: INFO nova.api.openstack.requestlog [None req-96c03d06-63be-481b-bb68-591762c5677c admin admin] 10.222.0.50 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.423443 Sep 24 04:53:58.620904 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: [pid: 105409|app: 0|req: 12/22] 10.222.0.50 () {64 vars in 1283 bytes} [Sat Sep 24 04:53:58 2022] POST /compute/v2.1/flavors => generated 402 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 24 04:53:58.633063 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi [None req-183093fc-255f-480c-969b-9733be4a621f admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 04:53:58.664981 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: INFO nova.api.openstack.requestlog [None req-183093fc-255f-480c-969b-9733be4a621f admin admin] 10.222.0.50 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.035556 Sep 24 04:53:58.665855 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: [pid: 105408|app: 0|req: 11/23] 10.222.0.50 () {64 vars in 1333 bytes} [Sat Sep 24 04:53:58 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 24 04:54:01.262412 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi [None req-96c03d06-63be-481b-bb68-591762c5677c admin admin] Calling method '>' {{(pid=105409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 04:54:01.263426 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: INFO nova.api.openstack.requestlog [None req-96c03d06-63be-481b-bb68-591762c5677c admin admin] 10.222.0.50 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001469 Sep 24 04:54:01.263832 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: [pid: 105409|app: 0|req: 13/24] 10.222.0.50 () {54 vars in 931 bytes} [Sat Sep 24 04:54:01 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 04:54:01.792500 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi [None req-f121e5bd-c84d-4020-905c-a017e26de12d admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 2048, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "name": "m1.small", "swap": 0, "id": "2", "disk": 20, "os-flavor-access:is_public": true, "vcpus": 1}} {{(pid=105408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 04:54:01.814712 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: INFO nova.api.openstack.requestlog [None req-f121e5bd-c84d-4020-905c-a017e26de12d admin admin] 10.222.0.50 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.544284 Sep 24 04:54:01.815532 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: [pid: 105408|app: 0|req: 12/25] 10.222.0.50 () {64 vars in 1283 bytes} [Sat Sep 24 04:54:01 2022] POST /compute/v2.1/flavors => generated 405 bytes in 546 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 24 04:54:01.828592 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi [None req-81395fa5-b61f-47fe-8f24-38d8ae979375 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 04:54:01.853394 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: INFO nova.api.openstack.requestlog [None req-81395fa5-b61f-47fe-8f24-38d8ae979375 admin admin] 10.222.0.50 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.029142 Sep 24 04:54:01.854019 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: [pid: 105409|app: 0|req: 14/26] 10.222.0.50 () {64 vars in 1333 bytes} [Sat Sep 24 04:54:01 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 04:54:04.535257 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi [None req-f121e5bd-c84d-4020-905c-a017e26de12d admin admin] Calling method '>' {{(pid=105408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 04:54:04.536308 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: INFO nova.api.openstack.requestlog [None req-f121e5bd-c84d-4020-905c-a017e26de12d admin admin] 10.222.0.50 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001470 Sep 24 04:54:04.536716 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: [pid: 105408|app: 0|req: 13/27] 10.222.0.50 () {54 vars in 931 bytes} [Sat Sep 24 04:54:04 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 04:54:04.996140 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi [None req-b76a7f11-7e3c-4ce9-9af9-6080048c4389 admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "disk": 40, "name": "m1.medium", "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "id": "3", "ram": 4096, "vcpus": 2}} {{(pid=105409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 04:54:05.018894 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: INFO nova.api.openstack.requestlog [None req-b76a7f11-7e3c-4ce9-9af9-6080048c4389 admin admin] 10.222.0.50 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.470499 Sep 24 04:54:05.025324 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: [pid: 105409|app: 0|req: 15/28] 10.222.0.50 () {64 vars in 1283 bytes} [Sat Sep 24 04:54:04 2022] POST /compute/v2.1/flavors => generated 406 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 24 04:54:05.030302 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi [None req-af479a48-0f7b-4216-8204-d0393e371ca0 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 04:54:05.061313 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: INFO nova.api.openstack.requestlog [None req-af479a48-0f7b-4216-8204-d0393e371ca0 admin admin] 10.222.0.50 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.034773 Sep 24 04:54:05.062650 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: [pid: 105408|app: 0|req: 14/29] 10.222.0.50 () {64 vars in 1333 bytes} [Sat Sep 24 04:54:05 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 24 04:54:07.691310 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi [None req-b76a7f11-7e3c-4ce9-9af9-6080048c4389 admin admin] Calling method '>' {{(pid=105409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 04:54:07.692325 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: INFO nova.api.openstack.requestlog [None req-b76a7f11-7e3c-4ce9-9af9-6080048c4389 admin admin] 10.222.0.50 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001522 Sep 24 04:54:07.692888 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: [pid: 105409|app: 0|req: 16/30] 10.222.0.50 () {54 vars in 931 bytes} [Sat Sep 24 04:54:07 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 04:54:08.136740 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi [None req-c955ee45-1f7c-4d22-957c-c5abb6a9a0c4 admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "disk": 80, "id": "4", "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "ram": 8192, "swap": 0, "vcpus": 4, "name": "m1.large"}} {{(pid=105408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 04:54:08.143101 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: DEBUG dbcounter [-] [105408] Writing DB stats nova_api:SELECT=39,nova_api:INSERT=8,nova_api:SAVEPOINT=4,nova_api:RELEASE=4 {{(pid=105408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 04:54:08.168498 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: INFO nova.api.openstack.requestlog [None req-c955ee45-1f7c-4d22-957c-c5abb6a9a0c4 admin admin] 10.222.0.50 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.469585 Sep 24 04:54:08.169520 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: [pid: 105408|app: 0|req: 15/31] 10.222.0.50 () {64 vars in 1283 bytes} [Sat Sep 24 04:54:07 2022] POST /compute/v2.1/flavors => generated 405 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 24 04:54:08.181379 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi [None req-0e9c2b13-fd7c-4179-8507-30684addc391 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 04:54:08.204992 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: INFO nova.api.openstack.requestlog [None req-0e9c2b13-fd7c-4179-8507-30684addc391 admin admin] 10.222.0.50 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.027555 Sep 24 04:54:08.210544 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: [pid: 105409|app: 0|req: 17/32] 10.222.0.50 () {64 vars in 1333 bytes} [Sat Sep 24 04:54:08 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 04:54:10.827936 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi [None req-c955ee45-1f7c-4d22-957c-c5abb6a9a0c4 admin admin] Calling method '>' {{(pid=105408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 04:54:10.828954 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: INFO nova.api.openstack.requestlog [None req-c955ee45-1f7c-4d22-957c-c5abb6a9a0c4 admin admin] 10.222.0.50 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001548 Sep 24 04:54:10.829350 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: [pid: 105408|app: 0|req: 16/33] 10.222.0.50 () {54 vars in 931 bytes} [Sat Sep 24 04:54:10 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 04:54:11.266802 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi [None req-37991a9d-d55d-4c1a-964e-920281e24d42 admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 160, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "id": "5", "vcpus": 8, "swap": 0, "rxtx_factor": 1.0, "ram": 16384, "name": "m1.xlarge"}} {{(pid=105409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 04:54:11.275070 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: DEBUG dbcounter [-] [105409] Writing DB stats nova_api:SELECT=45,nova_api:SAVEPOINT=5,nova_api:INSERT=9,nova_api:RELEASE=5 {{(pid=105409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 04:54:11.289906 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: INFO nova.api.openstack.requestlog [None req-37991a9d-d55d-4c1a-964e-920281e24d42 admin admin] 10.222.0.50 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.454485 Sep 24 04:54:11.290657 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: [pid: 105409|app: 0|req: 18/34] 10.222.0.50 () {64 vars in 1283 bytes} [Sat Sep 24 04:54:10 2022] POST /compute/v2.1/flavors => generated 408 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 24 04:54:11.302601 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi [None req-d3b42782-b2cf-40a2-ae28-efde4140ccee admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 04:54:11.326228 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: INFO nova.api.openstack.requestlog [None req-d3b42782-b2cf-40a2-ae28-efde4140ccee admin admin] 10.222.0.50 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.027403 Sep 24 04:54:11.330171 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: [pid: 105408|app: 0|req: 17/35] 10.222.0.50 () {64 vars in 1333 bytes} [Sat Sep 24 04:54:11 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 04:54:27.680925 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi [None req-37991a9d-d55d-4c1a-964e-920281e24d42 admin admin] Calling method '>' {{(pid=105409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 04:54:27.681970 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: INFO nova.api.openstack.requestlog [None req-37991a9d-d55d-4c1a-964e-920281e24d42 admin admin] 10.222.0.50 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001516 Sep 24 04:54:27.682404 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: [pid: 105409|app: 0|req: 19/36] 10.222.0.50 () {54 vars in 931 bytes} [Sat Sep 24 04:54:27 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 04:54:27.693466 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: DEBUG dbcounter [-] [105408] Writing DB stats nova_api:INSERT=2,nova_api:SELECT=8,nova_api:SAVEPOINT=1,nova_api:RELEASE=1 {{(pid=105408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 04:54:28.067190 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi [None req-390359f0-46bf-42c4-a57a-5afd45a0ff11 admin admin] Calling method '>' {{(pid=105408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 04:54:28.085344 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: INFO nova.api.openstack.requestlog [None req-390359f0-46bf-42c4-a57a-5afd45a0ff11 admin admin] 10.222.0.50 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.396350 Sep 24 04:54:28.085873 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: [pid: 105408|app: 0|req: 18/37] 10.222.0.50 () {60 vars in 1292 bytes} [Sat Sep 24 04:54:27 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 04:54:29.384464 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi [None req-37991a9d-d55d-4c1a-964e-920281e24d42 admin admin] Calling method '>' {{(pid=105409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 04:54:29.385470 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: INFO nova.api.openstack.requestlog [None req-37991a9d-d55d-4c1a-964e-920281e24d42 admin admin] 10.222.0.50 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001438 Sep 24 04:54:29.385868 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: [pid: 105409|app: 0|req: 20/38] 10.222.0.50 () {56 vars in 1074 bytes} [Sat Sep 24 04:54:29 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 04:54:29.899641 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi [None req-37a8c010-d9b0-4626-8c84-cf90fe63d07b admin admin] Calling method '>' {{(pid=105408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 04:54:29.905538 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: INFO nova.api.openstack.wsgi [None req-37a8c010-d9b0-4626-8c84-cf90fe63d07b admin admin] HTTP exception thrown: Flavor 42 could not be found. Sep 24 04:54:29.908884 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi [None req-37a8c010-d9b0-4626-8c84-cf90fe63d07b admin admin] Request method failure captured: Sep 24 04:54:29.908884 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Sep 24 04:54:29.908884 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: Accept: application/json Sep 24 04:54:29.908884 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: Accept-Encoding: gzip, deflate Sep 24 04:54:29.908884 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: Connection: keep-alive Sep 24 04:54:29.908884 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: Content-Length: 0 Sep 24 04:54:29.908884 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: Host: 10.222.0.50 Sep 24 04:54:29.908884 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: Openstack-Api-Version: compute 2.92 Sep 24 04:54:29.908884 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: Openstack-System-Scope: None Sep 24 04:54:29.908884 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: User-Agent: python-novaclient Sep 24 04:54:29.908884 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: X-Auth-Token: gAAAAABjLo2F_fNDPmayVlq17rtX8OwrrTISCnYmq8rUs5RsYV8fe0OQg5yFOk2iASPrjNWE_B1NgBlJKVYhE-hv4q-1s3MlUmKLYL_zO_mUY1ZPyFESYMOvocG9SqY8F2XuddgsjKniGAt2Y8jn0zW1CY8pGY7kHtFMhXzK3v_CWGY8FlHaFZg Sep 24 04:54:29.908884 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: X-Domain-Id: None Sep 24 04:54:29.908884 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: X-Domain-Name: None Sep 24 04:54:29.908884 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: X-Identity-Status: Confirmed Sep 24 04:54:29.908884 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: X-Is-Admin-Project: True Sep 24 04:54:29.908884 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: X-Openstack-Nova-Api-Version: 2.92 Sep 24 04:54:29.908884 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: X-Project-Domain-Id: default Sep 24 04:54:29.908884 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: X-Project-Domain-Name: Default Sep 24 04:54:29.908884 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: X-Project-Id: f9c9e5a50c664c33aa419611e20c9c00 Sep 24 04:54:29.908884 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: X-Project-Name: admin Sep 24 04:54:29.908884 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: X-Role: member,admin,reader Sep 24 04:54:29.908884 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: X-Roles: member,admin,reader Sep 24 04:54:29.910454 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/f9c9e5a50c664c33aa419611e20c9c00"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/f9c9e5a50c664c33aa419611e20c9c00"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/f9c9e5a50c664c33aa419611e20c9c00"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.50:8080", "publicURL": "http://10.222.0.50:8080/v1/AUTH_f9c9e5a50c664c33aa419611e20c9c00"}]}] Sep 24 04:54:29.910454 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: X-Tenant: admin Sep 24 04:54:29.910454 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: X-Tenant-Id: f9c9e5a50c664c33aa419611e20c9c00 Sep 24 04:54:29.910454 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: X-Tenant-Name: admin Sep 24 04:54:29.910454 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: X-User: admin Sep 24 04:54:29.910454 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: X-User-Domain-Id: default Sep 24 04:54:29.910454 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: X-User-Domain-Name: Default Sep 24 04:54:29.910454 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: X-User-Id: eb0ba9d6a6bf45098fbc94fef46dc27d Sep 24 04:54:29.910454 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: X-User-Name: admin Sep 24 04:54:29.910454 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: method: > Sep 24 04:54:29.910454 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: exception: Flavor 42 could not be found. Sep 24 04:54:29.910454 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: action_args: {'id': '42'} Sep 24 04:54:29.910454 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: {{(pid=105408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 24 04:54:29.910454 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 04:54:29.911306 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Sep 24 04:54:29.911306 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Sep 24 04:54:29.911306 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Sep 24 04:54:29.911306 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Sep 24 04:54:29.911306 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 24 04:54:29.911306 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 24 04:54:29.911306 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Sep 24 04:54:29.911306 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Sep 24 04:54:29.911306 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Sep 24 04:54:29.911306 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 24 04:54:29.911306 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Sep 24 04:54:29.911306 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Sep 24 04:54:29.911306 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Sep 24 04:54:29.911306 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: ERROR nova.api.openstack.wsgi Sep 24 04:54:29.911306 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 04:54:29.911306 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: ERROR nova.api.openstack.wsgi Sep 24 04:54:29.911306 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 04:54:29.911306 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 04:54:29.911306 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 04:54:29.912410 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 24 04:54:29.912410 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 24 04:54:29.912410 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 24 04:54:29.912410 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 24 04:54:29.912410 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Sep 24 04:54:29.912410 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 24 04:54:29.912410 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Sep 24 04:54:29.912410 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: ERROR nova.api.openstack.wsgi Sep 24 04:54:29.912410 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 04:54:29.912410 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: ERROR nova.api.openstack.wsgi Sep 24 04:54:29.912410 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 04:54:29.912410 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 04:54:29.912410 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 04:54:29.912410 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 24 04:54:29.912410 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 24 04:54:29.912410 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Sep 24 04:54:29.912410 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: ERROR nova.api.openstack.wsgi Sep 24 04:54:29.912410 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi [None req-37a8c010-d9b0-4626-8c84-cf90fe63d07b admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=105408) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 24 04:54:29.913407 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: INFO nova.api.openstack.requestlog [None req-37a8c010-d9b0-4626-8c84-cf90fe63d07b admin admin] 10.222.0.50 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.92 time: 0.387580 Sep 24 04:54:29.913407 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: [pid: 105408|app: 0|req: 19/39] 10.222.0.50 () {60 vars in 1190 bytes} [Sat Sep 24 04:54:29 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 389 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Sep 24 04:54:29.920789 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi [None req-59bc57be-39d2-4922-bd0b-b9d4ea79f240 admin admin] Calling method '>' {{(pid=105409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 04:54:29.942847 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: INFO nova.api.openstack.requestlog [None req-59bc57be-39d2-4922-bd0b-b9d4ea79f240 admin admin] 10.222.0.50 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.026287 Sep 24 04:54:29.943385 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: [pid: 105409|app: 0|req: 21/40] 10.222.0.50 () {60 vars in 1210 bytes} [Sat Sep 24 04:54:29 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 04:54:29.954591 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi [None req-451665d3-63fe-4e82-a0d8-5649d6f3adb9 admin admin] Calling method '>' {{(pid=105408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 04:54:29.976797 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: INFO nova.api.openstack.requestlog [None req-451665d3-63fe-4e82-a0d8-5649d6f3adb9 admin admin] 10.222.0.50 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.027211 Sep 24 04:54:29.977328 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: [pid: 105408|app: 0|req: 20/41] 10.222.0.50 () {60 vars in 1210 bytes} [Sat Sep 24 04:54:29 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 24 04:54:29.986420 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi [None req-08946b4f-d72d-447b-b825-6ebbb4d6cf28 admin admin] Calling method '>' {{(pid=105409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 04:54:29.991690 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: INFO nova.api.openstack.wsgi [None req-08946b4f-d72d-447b-b825-6ebbb4d6cf28 admin admin] HTTP exception thrown: Flavor 42 could not be found. Sep 24 04:54:29.994921 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi [None req-08946b4f-d72d-447b-b825-6ebbb4d6cf28 admin admin] Request method failure captured: Sep 24 04:54:29.994921 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Sep 24 04:54:29.994921 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: Accept: application/json Sep 24 04:54:29.994921 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: Accept-Encoding: gzip, deflate Sep 24 04:54:29.994921 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: Connection: keep-alive Sep 24 04:54:29.994921 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: Content-Length: 0 Sep 24 04:54:29.994921 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: Host: 10.222.0.50 Sep 24 04:54:29.994921 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: Openstack-Api-Version: compute 2.92 Sep 24 04:54:29.994921 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: Openstack-System-Scope: None Sep 24 04:54:29.994921 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: User-Agent: python-novaclient Sep 24 04:54:29.994921 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: X-Auth-Token: gAAAAABjLo2F_fNDPmayVlq17rtX8OwrrTISCnYmq8rUs5RsYV8fe0OQg5yFOk2iASPrjNWE_B1NgBlJKVYhE-hv4q-1s3MlUmKLYL_zO_mUY1ZPyFESYMOvocG9SqY8F2XuddgsjKniGAt2Y8jn0zW1CY8pGY7kHtFMhXzK3v_CWGY8FlHaFZg Sep 24 04:54:29.994921 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: X-Domain-Id: None Sep 24 04:54:29.994921 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: X-Domain-Name: None Sep 24 04:54:29.994921 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: X-Identity-Status: Confirmed Sep 24 04:54:29.994921 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: X-Is-Admin-Project: True Sep 24 04:54:29.994921 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: X-Openstack-Nova-Api-Version: 2.92 Sep 24 04:54:29.994921 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: X-Project-Domain-Id: default Sep 24 04:54:29.994921 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: X-Project-Domain-Name: Default Sep 24 04:54:29.994921 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: X-Project-Id: f9c9e5a50c664c33aa419611e20c9c00 Sep 24 04:54:29.994921 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: X-Project-Name: admin Sep 24 04:54:29.994921 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: X-Role: member,admin,reader Sep 24 04:54:29.994921 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: X-Roles: member,admin,reader Sep 24 04:54:29.996304 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/f9c9e5a50c664c33aa419611e20c9c00"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/f9c9e5a50c664c33aa419611e20c9c00"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/f9c9e5a50c664c33aa419611e20c9c00"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.50:8080", "publicURL": "http://10.222.0.50:8080/v1/AUTH_f9c9e5a50c664c33aa419611e20c9c00"}]}] Sep 24 04:54:29.996304 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: X-Tenant: admin Sep 24 04:54:29.996304 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: X-Tenant-Id: f9c9e5a50c664c33aa419611e20c9c00 Sep 24 04:54:29.996304 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: X-Tenant-Name: admin Sep 24 04:54:29.996304 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: X-User: admin Sep 24 04:54:29.996304 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: X-User-Domain-Id: default Sep 24 04:54:29.996304 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: X-User-Domain-Name: Default Sep 24 04:54:29.996304 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: X-User-Id: eb0ba9d6a6bf45098fbc94fef46dc27d Sep 24 04:54:29.996304 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: X-User-Name: admin Sep 24 04:54:29.996304 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: method: > Sep 24 04:54:29.996304 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: exception: Flavor 42 could not be found. Sep 24 04:54:29.996304 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: action_args: {'id': '42'} Sep 24 04:54:29.996304 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: {{(pid=105409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 24 04:54:29.996304 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 04:54:29.997331 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Sep 24 04:54:29.997331 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Sep 24 04:54:29.997331 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Sep 24 04:54:29.997331 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Sep 24 04:54:29.997331 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 24 04:54:29.997331 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 24 04:54:29.997331 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Sep 24 04:54:29.997331 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Sep 24 04:54:29.997331 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Sep 24 04:54:29.997331 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 24 04:54:29.997331 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Sep 24 04:54:29.997331 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Sep 24 04:54:29.997331 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Sep 24 04:54:29.997331 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: ERROR nova.api.openstack.wsgi Sep 24 04:54:29.997331 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 04:54:29.997331 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: ERROR nova.api.openstack.wsgi Sep 24 04:54:29.997331 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 04:54:29.997331 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 04:54:29.997331 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 04:54:29.998724 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 24 04:54:29.998724 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 24 04:54:29.998724 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 24 04:54:29.998724 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 24 04:54:29.998724 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Sep 24 04:54:29.998724 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 24 04:54:29.998724 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Sep 24 04:54:29.998724 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: ERROR nova.api.openstack.wsgi Sep 24 04:54:29.998724 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 04:54:29.998724 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: ERROR nova.api.openstack.wsgi Sep 24 04:54:29.998724 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 04:54:29.998724 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 04:54:29.998724 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 04:54:29.998724 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 24 04:54:29.998724 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 24 04:54:29.998724 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Sep 24 04:54:29.998724 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: ERROR nova.api.openstack.wsgi Sep 24 04:54:29.998724 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi [None req-08946b4f-d72d-447b-b825-6ebbb4d6cf28 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=105409) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 24 04:54:30.000011 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: INFO nova.api.openstack.requestlog [None req-08946b4f-d72d-447b-b825-6ebbb4d6cf28 admin admin] 10.222.0.50 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.92 time: 0.013386 Sep 24 04:54:30.000011 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: [pid: 105409|app: 0|req: 22/42] 10.222.0.50 () {60 vars in 1190 bytes} [Sat Sep 24 04:54:29 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 14 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Sep 24 04:54:31.197819 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi [None req-451665d3-63fe-4e82-a0d8-5649d6f3adb9 admin admin] Calling method '>' {{(pid=105408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 04:54:31.198891 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: INFO nova.api.openstack.requestlog [None req-451665d3-63fe-4e82-a0d8-5649d6f3adb9 admin admin] 10.222.0.50 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001497 Sep 24 04:54:31.199290 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: [pid: 105408|app: 0|req: 21/43] 10.222.0.50 () {56 vars in 1074 bytes} [Sat Sep 24 04:54:31 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 04:54:31.717469 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi [None req-a1919b5d-b193-4ced-80f2-a3f91eacad87 admin admin] Calling method '>' {{(pid=105409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 04:54:31.722478 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: INFO nova.api.openstack.wsgi [None req-a1919b5d-b193-4ced-80f2-a3f91eacad87 admin admin] HTTP exception thrown: Flavor 84 could not be found. Sep 24 04:54:31.723967 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi [None req-a1919b5d-b193-4ced-80f2-a3f91eacad87 admin admin] Request method failure captured: Sep 24 04:54:31.723967 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Sep 24 04:54:31.723967 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: Accept: application/json Sep 24 04:54:31.723967 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: Accept-Encoding: gzip, deflate Sep 24 04:54:31.723967 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: Connection: keep-alive Sep 24 04:54:31.723967 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: Content-Length: 0 Sep 24 04:54:31.723967 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: Host: 10.222.0.50 Sep 24 04:54:31.723967 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: Openstack-Api-Version: compute 2.92 Sep 24 04:54:31.723967 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: Openstack-System-Scope: None Sep 24 04:54:31.723967 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: User-Agent: python-novaclient Sep 24 04:54:31.723967 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: X-Auth-Token: gAAAAABjLo2H2649uIyILYpwhGnw1eSxYgFpj56Ql3ziLEMj0K8AaWd2r9Bc0kRdO0AOIUdqhqsgQIiUpaLAOOI42zStROvhAGGe9Cp6e7iv_v6ZalKpdJbqqtIWYd223DcZovVu3JEeOOJvyO_Kapw-FkPbmOfbScMfmmhA7xK3YkeW3pbqt6s Sep 24 04:54:31.723967 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: X-Domain-Id: None Sep 24 04:54:31.723967 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: X-Domain-Name: None Sep 24 04:54:31.723967 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: X-Identity-Status: Confirmed Sep 24 04:54:31.723967 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: X-Is-Admin-Project: True Sep 24 04:54:31.723967 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: X-Openstack-Nova-Api-Version: 2.92 Sep 24 04:54:31.723967 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: X-Project-Domain-Id: default Sep 24 04:54:31.723967 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: X-Project-Domain-Name: Default Sep 24 04:54:31.723967 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: X-Project-Id: f9c9e5a50c664c33aa419611e20c9c00 Sep 24 04:54:31.723967 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: X-Project-Name: admin Sep 24 04:54:31.723967 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: X-Role: member,admin,reader Sep 24 04:54:31.723967 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: X-Roles: member,admin,reader Sep 24 04:54:31.725210 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/f9c9e5a50c664c33aa419611e20c9c00"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/f9c9e5a50c664c33aa419611e20c9c00"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/f9c9e5a50c664c33aa419611e20c9c00"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.50:8080", "publicURL": "http://10.222.0.50:8080/v1/AUTH_f9c9e5a50c664c33aa419611e20c9c00"}]}] Sep 24 04:54:31.725210 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: X-Tenant: admin Sep 24 04:54:31.725210 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: X-Tenant-Id: f9c9e5a50c664c33aa419611e20c9c00 Sep 24 04:54:31.725210 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: X-Tenant-Name: admin Sep 24 04:54:31.725210 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: X-User: admin Sep 24 04:54:31.725210 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: X-User-Domain-Id: default Sep 24 04:54:31.725210 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: X-User-Domain-Name: Default Sep 24 04:54:31.725210 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: X-User-Id: eb0ba9d6a6bf45098fbc94fef46dc27d Sep 24 04:54:31.725210 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: X-User-Name: admin Sep 24 04:54:31.725210 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: method: > Sep 24 04:54:31.725210 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: exception: Flavor 84 could not be found. Sep 24 04:54:31.725210 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: action_args: {'id': '84'} Sep 24 04:54:31.725210 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: {{(pid=105409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 24 04:54:31.725210 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 04:54:31.726233 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Sep 24 04:54:31.726233 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Sep 24 04:54:31.726233 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Sep 24 04:54:31.726233 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Sep 24 04:54:31.726233 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 24 04:54:31.726233 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 24 04:54:31.726233 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Sep 24 04:54:31.726233 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Sep 24 04:54:31.726233 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Sep 24 04:54:31.726233 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 24 04:54:31.726233 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Sep 24 04:54:31.726233 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Sep 24 04:54:31.726233 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Sep 24 04:54:31.726233 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: ERROR nova.api.openstack.wsgi Sep 24 04:54:31.726233 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 04:54:31.726233 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: ERROR nova.api.openstack.wsgi Sep 24 04:54:31.726233 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 04:54:31.726233 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 04:54:31.726233 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 04:54:31.727559 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 24 04:54:31.727559 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 24 04:54:31.727559 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 24 04:54:31.727559 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 24 04:54:31.727559 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Sep 24 04:54:31.727559 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 24 04:54:31.727559 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Sep 24 04:54:31.727559 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: ERROR nova.api.openstack.wsgi Sep 24 04:54:31.727559 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 04:54:31.727559 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: ERROR nova.api.openstack.wsgi Sep 24 04:54:31.727559 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 04:54:31.727559 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 04:54:31.727559 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 04:54:31.727559 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 24 04:54:31.727559 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 24 04:54:31.727559 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Sep 24 04:54:31.727559 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: ERROR nova.api.openstack.wsgi Sep 24 04:54:31.727559 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi [None req-a1919b5d-b193-4ced-80f2-a3f91eacad87 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=105409) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 24 04:54:31.728753 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: INFO nova.api.openstack.requestlog [None req-a1919b5d-b193-4ced-80f2-a3f91eacad87 admin admin] 10.222.0.50 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.92 time: 0.387595 Sep 24 04:54:31.728753 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: [pid: 105409|app: 0|req: 23/44] 10.222.0.50 () {60 vars in 1190 bytes} [Sat Sep 24 04:54:31 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 389 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Sep 24 04:54:31.735038 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi [None req-5d8cff20-228e-47ff-aa32-21e3125c03ee admin admin] Calling method '>' {{(pid=105408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 04:54:31.750234 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: INFO nova.api.openstack.requestlog [None req-5d8cff20-228e-47ff-aa32-21e3125c03ee admin admin] 10.222.0.50 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.018750 Sep 24 04:54:31.750758 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: [pid: 105408|app: 0|req: 22/45] 10.222.0.50 () {60 vars in 1210 bytes} [Sat Sep 24 04:54:31 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 04:54:31.759752 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi [None req-3e5922c7-3344-49d5-bedd-90ee281ef160 admin admin] Calling method '>' {{(pid=105409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 04:54:31.775470 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: INFO nova.api.openstack.requestlog [None req-3e5922c7-3344-49d5-bedd-90ee281ef160 admin admin] 10.222.0.50 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.019201 Sep 24 04:54:31.775980 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: [pid: 105409|app: 0|req: 24/46] 10.222.0.50 () {60 vars in 1210 bytes} [Sat Sep 24 04:54:31 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 04:54:31.784836 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi [None req-e4a72c61-cd7a-4a0c-81f3-643b5bcc8304 admin admin] Calling method '>' {{(pid=105408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 04:54:31.789675 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: INFO nova.api.openstack.wsgi [None req-e4a72c61-cd7a-4a0c-81f3-643b5bcc8304 admin admin] HTTP exception thrown: Flavor 84 could not be found. Sep 24 04:54:31.791212 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi [None req-e4a72c61-cd7a-4a0c-81f3-643b5bcc8304 admin admin] Request method failure captured: Sep 24 04:54:31.791212 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Sep 24 04:54:31.791212 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: Accept: application/json Sep 24 04:54:31.791212 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: Accept-Encoding: gzip, deflate Sep 24 04:54:31.791212 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: Connection: keep-alive Sep 24 04:54:31.791212 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: Content-Length: 0 Sep 24 04:54:31.791212 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: Host: 10.222.0.50 Sep 24 04:54:31.791212 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: Openstack-Api-Version: compute 2.92 Sep 24 04:54:31.791212 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: Openstack-System-Scope: None Sep 24 04:54:31.791212 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: User-Agent: python-novaclient Sep 24 04:54:31.791212 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: X-Auth-Token: gAAAAABjLo2H2649uIyILYpwhGnw1eSxYgFpj56Ql3ziLEMj0K8AaWd2r9Bc0kRdO0AOIUdqhqsgQIiUpaLAOOI42zStROvhAGGe9Cp6e7iv_v6ZalKpdJbqqtIWYd223DcZovVu3JEeOOJvyO_Kapw-FkPbmOfbScMfmmhA7xK3YkeW3pbqt6s Sep 24 04:54:31.791212 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: X-Domain-Id: None Sep 24 04:54:31.791212 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: X-Domain-Name: None Sep 24 04:54:31.791212 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: X-Identity-Status: Confirmed Sep 24 04:54:31.791212 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: X-Is-Admin-Project: True Sep 24 04:54:31.791212 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: X-Openstack-Nova-Api-Version: 2.92 Sep 24 04:54:31.791212 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: X-Project-Domain-Id: default Sep 24 04:54:31.791212 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: X-Project-Domain-Name: Default Sep 24 04:54:31.791212 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: X-Project-Id: f9c9e5a50c664c33aa419611e20c9c00 Sep 24 04:54:31.791212 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: X-Project-Name: admin Sep 24 04:54:31.791212 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: X-Role: member,admin,reader Sep 24 04:54:31.791212 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: X-Roles: member,admin,reader Sep 24 04:54:31.792683 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/f9c9e5a50c664c33aa419611e20c9c00"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/f9c9e5a50c664c33aa419611e20c9c00"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/f9c9e5a50c664c33aa419611e20c9c00"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.50:8080", "publicURL": "http://10.222.0.50:8080/v1/AUTH_f9c9e5a50c664c33aa419611e20c9c00"}]}] Sep 24 04:54:31.792683 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: X-Tenant: admin Sep 24 04:54:31.792683 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: X-Tenant-Id: f9c9e5a50c664c33aa419611e20c9c00 Sep 24 04:54:31.792683 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: X-Tenant-Name: admin Sep 24 04:54:31.792683 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: X-User: admin Sep 24 04:54:31.792683 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: X-User-Domain-Id: default Sep 24 04:54:31.792683 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: X-User-Domain-Name: Default Sep 24 04:54:31.792683 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: X-User-Id: eb0ba9d6a6bf45098fbc94fef46dc27d Sep 24 04:54:31.792683 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: X-User-Name: admin Sep 24 04:54:31.792683 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: method: > Sep 24 04:54:31.792683 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: exception: Flavor 84 could not be found. Sep 24 04:54:31.792683 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: action_args: {'id': '84'} Sep 24 04:54:31.792683 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: {{(pid=105408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 24 04:54:31.792683 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 04:54:31.793637 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Sep 24 04:54:31.793637 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Sep 24 04:54:31.793637 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Sep 24 04:54:31.793637 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Sep 24 04:54:31.793637 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 24 04:54:31.793637 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 24 04:54:31.793637 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Sep 24 04:54:31.793637 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Sep 24 04:54:31.793637 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Sep 24 04:54:31.793637 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 24 04:54:31.793637 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Sep 24 04:54:31.793637 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Sep 24 04:54:31.793637 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Sep 24 04:54:31.793637 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: ERROR nova.api.openstack.wsgi Sep 24 04:54:31.793637 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 04:54:31.793637 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: ERROR nova.api.openstack.wsgi Sep 24 04:54:31.793637 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 04:54:31.793637 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 04:54:31.793637 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 04:54:31.795066 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 24 04:54:31.795066 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 24 04:54:31.795066 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 24 04:54:31.795066 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 24 04:54:31.795066 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Sep 24 04:54:31.795066 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 24 04:54:31.795066 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Sep 24 04:54:31.795066 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: ERROR nova.api.openstack.wsgi Sep 24 04:54:31.795066 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 04:54:31.795066 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: ERROR nova.api.openstack.wsgi Sep 24 04:54:31.795066 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 04:54:31.795066 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 04:54:31.795066 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 04:54:31.795066 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 24 04:54:31.795066 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 24 04:54:31.795066 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Sep 24 04:54:31.795066 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: ERROR nova.api.openstack.wsgi Sep 24 04:54:31.795066 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi [None req-e4a72c61-cd7a-4a0c-81f3-643b5bcc8304 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=105408) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 24 04:54:31.796051 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: INFO nova.api.openstack.requestlog [None req-e4a72c61-cd7a-4a0c-81f3-643b5bcc8304 admin admin] 10.222.0.50 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.92 time: 0.011178 Sep 24 04:54:31.796051 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: [pid: 105408|app: 0|req: 23/47] 10.222.0.50 () {60 vars in 1190 bytes} [Sat Sep 24 04:54:31 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 12 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Sep 24 04:54:33.008079 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi [None req-3e5922c7-3344-49d5-bedd-90ee281ef160 admin admin] Calling method '>' {{(pid=105409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 04:54:33.009106 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: INFO nova.api.openstack.requestlog [None req-3e5922c7-3344-49d5-bedd-90ee281ef160 admin admin] 10.222.0.50 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001436 Sep 24 04:54:33.009499 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: [pid: 105409|app: 0|req: 25/48] 10.222.0.50 () {56 vars in 1074 bytes} [Sat Sep 24 04:54:33 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 04:54:33.530626 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi [None req-b5b9c072-2275-41ed-b148-19b1700ad7bd admin admin] Calling method '>' {{(pid=105408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 04:54:33.536276 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: INFO nova.api.openstack.wsgi [None req-b5b9c072-2275-41ed-b148-19b1700ad7bd admin admin] HTTP exception thrown: Flavor 451 could not be found. Sep 24 04:54:33.537763 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi [None req-b5b9c072-2275-41ed-b148-19b1700ad7bd admin admin] Request method failure captured: Sep 24 04:54:33.537763 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Sep 24 04:54:33.537763 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: Accept: application/json Sep 24 04:54:33.537763 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: Accept-Encoding: gzip, deflate Sep 24 04:54:33.537763 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: Connection: keep-alive Sep 24 04:54:33.537763 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: Content-Length: 0 Sep 24 04:54:33.537763 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: Host: 10.222.0.50 Sep 24 04:54:33.537763 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: Openstack-Api-Version: compute 2.92 Sep 24 04:54:33.537763 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: Openstack-System-Scope: None Sep 24 04:54:33.537763 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: User-Agent: python-novaclient Sep 24 04:54:33.537763 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: X-Auth-Token: gAAAAABjLo2ICO-wxJaRrJkf1d-_kevGxNAhIJv3JV9_pjxcQ9iTcNZslDH9sabg-h7H5dQs2TCGhhf4SqSuRDKIp966aoZ187zzzz4jc9Y5O6PMxPwrAS_WbDyQprFLhOVrcZtwnT9uHmechcaIrk7rHuIYwH4eA_8v3SUocFu-IWiD1cPDIpI Sep 24 04:54:33.537763 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: X-Domain-Id: None Sep 24 04:54:33.537763 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: X-Domain-Name: None Sep 24 04:54:33.537763 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: X-Identity-Status: Confirmed Sep 24 04:54:33.537763 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: X-Is-Admin-Project: True Sep 24 04:54:33.537763 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: X-Openstack-Nova-Api-Version: 2.92 Sep 24 04:54:33.537763 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: X-Project-Domain-Id: default Sep 24 04:54:33.537763 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: X-Project-Domain-Name: Default Sep 24 04:54:33.537763 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: X-Project-Id: f9c9e5a50c664c33aa419611e20c9c00 Sep 24 04:54:33.537763 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: X-Project-Name: admin Sep 24 04:54:33.537763 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: X-Role: member,admin,reader Sep 24 04:54:33.537763 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: X-Roles: member,admin,reader Sep 24 04:54:33.539307 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/f9c9e5a50c664c33aa419611e20c9c00"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/f9c9e5a50c664c33aa419611e20c9c00"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/f9c9e5a50c664c33aa419611e20c9c00"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.50:8080", "publicURL": "http://10.222.0.50:8080/v1/AUTH_f9c9e5a50c664c33aa419611e20c9c00"}]}] Sep 24 04:54:33.539307 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: X-Tenant: admin Sep 24 04:54:33.539307 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: X-Tenant-Id: f9c9e5a50c664c33aa419611e20c9c00 Sep 24 04:54:33.539307 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: X-Tenant-Name: admin Sep 24 04:54:33.539307 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: X-User: admin Sep 24 04:54:33.539307 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: X-User-Domain-Id: default Sep 24 04:54:33.539307 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: X-User-Domain-Name: Default Sep 24 04:54:33.539307 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: X-User-Id: eb0ba9d6a6bf45098fbc94fef46dc27d Sep 24 04:54:33.539307 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: X-User-Name: admin Sep 24 04:54:33.539307 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: method: > Sep 24 04:54:33.539307 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: exception: Flavor 451 could not be found. Sep 24 04:54:33.539307 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: action_args: {'id': '451'} Sep 24 04:54:33.539307 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: {{(pid=105408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 24 04:54:33.539307 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 04:54:33.540253 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Sep 24 04:54:33.540253 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Sep 24 04:54:33.540253 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Sep 24 04:54:33.540253 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Sep 24 04:54:33.540253 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 24 04:54:33.540253 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 24 04:54:33.540253 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Sep 24 04:54:33.540253 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Sep 24 04:54:33.540253 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Sep 24 04:54:33.540253 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 24 04:54:33.540253 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Sep 24 04:54:33.540253 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Sep 24 04:54:33.540253 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Sep 24 04:54:33.540253 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: ERROR nova.api.openstack.wsgi Sep 24 04:54:33.540253 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 04:54:33.540253 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: ERROR nova.api.openstack.wsgi Sep 24 04:54:33.540253 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 04:54:33.540253 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 04:54:33.540253 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 04:54:33.541344 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 24 04:54:33.541344 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 24 04:54:33.541344 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 24 04:54:33.541344 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 24 04:54:33.541344 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Sep 24 04:54:33.541344 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 24 04:54:33.541344 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Sep 24 04:54:33.541344 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: ERROR nova.api.openstack.wsgi Sep 24 04:54:33.541344 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 04:54:33.541344 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: ERROR nova.api.openstack.wsgi Sep 24 04:54:33.541344 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 04:54:33.541344 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 04:54:33.541344 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 04:54:33.541344 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 24 04:54:33.541344 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 24 04:54:33.541344 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Sep 24 04:54:33.541344 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: ERROR nova.api.openstack.wsgi Sep 24 04:54:33.541344 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi [None req-b5b9c072-2275-41ed-b148-19b1700ad7bd admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=105408) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 24 04:54:33.542408 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: INFO nova.api.openstack.requestlog [None req-b5b9c072-2275-41ed-b148-19b1700ad7bd admin admin] 10.222.0.50 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.92 time: 0.392012 Sep 24 04:54:33.542408 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: [pid: 105408|app: 0|req: 24/49] 10.222.0.50 () {60 vars in 1193 bytes} [Sat Sep 24 04:54:33 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 393 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Sep 24 04:54:33.549334 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi [None req-5232ee2d-405a-4729-9b62-ad321a65d5a5 admin admin] Calling method '>' {{(pid=105409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 04:54:33.564510 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: INFO nova.api.openstack.requestlog [None req-5232ee2d-405a-4729-9b62-ad321a65d5a5 admin admin] 10.222.0.50 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.018686 Sep 24 04:54:33.565027 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: [pid: 105409|app: 0|req: 26/50] 10.222.0.50 () {60 vars in 1210 bytes} [Sat Sep 24 04:54:33 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 04:54:33.573957 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi [None req-a23abc29-5e19-47b4-ac4e-f384fa570ee3 admin admin] Calling method '>' {{(pid=105408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 04:54:33.588440 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: INFO nova.api.openstack.requestlog [None req-a23abc29-5e19-47b4-ac4e-f384fa570ee3 admin admin] 10.222.0.50 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.017871 Sep 24 04:54:33.588954 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: [pid: 105408|app: 0|req: 25/51] 10.222.0.50 () {60 vars in 1210 bytes} [Sat Sep 24 04:54:33 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 04:54:33.597619 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi [None req-6fb382be-d703-4547-81eb-c03444fe852b admin admin] Calling method '>' {{(pid=105409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 04:54:33.602381 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: INFO nova.api.openstack.wsgi [None req-6fb382be-d703-4547-81eb-c03444fe852b admin admin] HTTP exception thrown: Flavor 451 could not be found. Sep 24 04:54:33.603892 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi [None req-6fb382be-d703-4547-81eb-c03444fe852b admin admin] Request method failure captured: Sep 24 04:54:33.603892 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Sep 24 04:54:33.603892 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: Accept: application/json Sep 24 04:54:33.603892 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: Accept-Encoding: gzip, deflate Sep 24 04:54:33.603892 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: Connection: keep-alive Sep 24 04:54:33.603892 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: Content-Length: 0 Sep 24 04:54:33.603892 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: Host: 10.222.0.50 Sep 24 04:54:33.603892 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: Openstack-Api-Version: compute 2.92 Sep 24 04:54:33.603892 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: Openstack-System-Scope: None Sep 24 04:54:33.603892 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: User-Agent: python-novaclient Sep 24 04:54:33.603892 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: X-Auth-Token: gAAAAABjLo2ICO-wxJaRrJkf1d-_kevGxNAhIJv3JV9_pjxcQ9iTcNZslDH9sabg-h7H5dQs2TCGhhf4SqSuRDKIp966aoZ187zzzz4jc9Y5O6PMxPwrAS_WbDyQprFLhOVrcZtwnT9uHmechcaIrk7rHuIYwH4eA_8v3SUocFu-IWiD1cPDIpI Sep 24 04:54:33.603892 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: X-Domain-Id: None Sep 24 04:54:33.603892 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: X-Domain-Name: None Sep 24 04:54:33.603892 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: X-Identity-Status: Confirmed Sep 24 04:54:33.603892 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: X-Is-Admin-Project: True Sep 24 04:54:33.603892 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: X-Openstack-Nova-Api-Version: 2.92 Sep 24 04:54:33.603892 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: X-Project-Domain-Id: default Sep 24 04:54:33.603892 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: X-Project-Domain-Name: Default Sep 24 04:54:33.603892 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: X-Project-Id: f9c9e5a50c664c33aa419611e20c9c00 Sep 24 04:54:33.603892 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: X-Project-Name: admin Sep 24 04:54:33.603892 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: X-Role: member,admin,reader Sep 24 04:54:33.603892 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: X-Roles: member,admin,reader Sep 24 04:54:33.605404 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/f9c9e5a50c664c33aa419611e20c9c00"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/f9c9e5a50c664c33aa419611e20c9c00"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/f9c9e5a50c664c33aa419611e20c9c00"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.50:8080", "publicURL": "http://10.222.0.50:8080/v1/AUTH_f9c9e5a50c664c33aa419611e20c9c00"}]}] Sep 24 04:54:33.605404 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: X-Tenant: admin Sep 24 04:54:33.605404 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: X-Tenant-Id: f9c9e5a50c664c33aa419611e20c9c00 Sep 24 04:54:33.605404 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: X-Tenant-Name: admin Sep 24 04:54:33.605404 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: X-User: admin Sep 24 04:54:33.605404 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: X-User-Domain-Id: default Sep 24 04:54:33.605404 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: X-User-Domain-Name: Default Sep 24 04:54:33.605404 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: X-User-Id: eb0ba9d6a6bf45098fbc94fef46dc27d Sep 24 04:54:33.605404 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: X-User-Name: admin Sep 24 04:54:33.605404 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: method: > Sep 24 04:54:33.605404 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: exception: Flavor 451 could not be found. Sep 24 04:54:33.605404 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: action_args: {'id': '451'} Sep 24 04:54:33.605404 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: {{(pid=105409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 24 04:54:33.605404 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 04:54:33.606924 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Sep 24 04:54:33.606924 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Sep 24 04:54:33.606924 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Sep 24 04:54:33.606924 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Sep 24 04:54:33.606924 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 24 04:54:33.606924 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 24 04:54:33.606924 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Sep 24 04:54:33.606924 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Sep 24 04:54:33.606924 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Sep 24 04:54:33.606924 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 24 04:54:33.606924 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Sep 24 04:54:33.606924 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Sep 24 04:54:33.606924 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Sep 24 04:54:33.606924 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: ERROR nova.api.openstack.wsgi Sep 24 04:54:33.606924 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 04:54:33.606924 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: ERROR nova.api.openstack.wsgi Sep 24 04:54:33.606924 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 04:54:33.606924 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 04:54:33.606924 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 04:54:33.608448 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 24 04:54:33.608448 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 24 04:54:33.608448 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 24 04:54:33.608448 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 24 04:54:33.608448 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Sep 24 04:54:33.608448 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 24 04:54:33.608448 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Sep 24 04:54:33.608448 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: ERROR nova.api.openstack.wsgi Sep 24 04:54:33.608448 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 04:54:33.608448 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: ERROR nova.api.openstack.wsgi Sep 24 04:54:33.608448 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 04:54:33.608448 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 04:54:33.608448 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 04:54:33.608448 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 24 04:54:33.608448 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 24 04:54:33.608448 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Sep 24 04:54:33.608448 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: ERROR nova.api.openstack.wsgi Sep 24 04:54:33.608448 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi [None req-6fb382be-d703-4547-81eb-c03444fe852b admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=105409) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 24 04:54:33.609672 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: INFO nova.api.openstack.requestlog [None req-6fb382be-d703-4547-81eb-c03444fe852b admin admin] 10.222.0.50 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.92 time: 0.010964 Sep 24 04:54:33.609672 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: [pid: 105409|app: 0|req: 27/52] 10.222.0.50 () {60 vars in 1193 bytes} [Sat Sep 24 04:54:33 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 12 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Sep 24 04:54:34.820064 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi [None req-a23abc29-5e19-47b4-ac4e-f384fa570ee3 admin admin] Calling method '>' {{(pid=105408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 04:54:34.821100 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: INFO nova.api.openstack.requestlog [None req-a23abc29-5e19-47b4-ac4e-f384fa570ee3 admin admin] 10.222.0.50 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001458 Sep 24 04:54:34.821528 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: [pid: 105408|app: 0|req: 26/53] 10.222.0.50 () {56 vars in 1074 bytes} [Sat Sep 24 04:54:34 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 04:54:35.341318 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi [None req-9d26eab8-a706-4f49-b9cb-4d4e4cdb58bf admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=105409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 04:54:35.360345 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: INFO nova.api.openstack.requestlog [None req-9d26eab8-a706-4f49-b9cb-4d4e4cdb58bf admin admin] 10.222.0.50 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.92 time: 0.402549 Sep 24 04:54:35.360899 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: [pid: 105409|app: 0|req: 28/54] 10.222.0.50 () {64 vars in 1235 bytes} [Sat Sep 24 04:54:34 2022] POST /compute/v2.1/flavors => generated 404 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 24 04:54:36.574219 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi [None req-a23abc29-5e19-47b4-ac4e-f384fa570ee3 admin admin] Calling method '>' {{(pid=105408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 04:54:36.575706 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: INFO nova.api.openstack.requestlog [None req-a23abc29-5e19-47b4-ac4e-f384fa570ee3 admin admin] 10.222.0.50 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001993 Sep 24 04:54:36.576097 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: [pid: 105408|app: 0|req: 27/55] 10.222.0.50 () {56 vars in 1074 bytes} [Sat Sep 24 04:54:36 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 04:54:37.089476 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi [None req-626dda99-7772-4baa-8f2b-583c28f33873 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=105409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 04:54:37.107263 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: INFO nova.api.openstack.requestlog [None req-626dda99-7772-4baa-8f2b-583c28f33873 admin admin] 10.222.0.50 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.92 time: 0.396267 Sep 24 04:54:37.107797 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: [pid: 105409|app: 0|req: 29/56] 10.222.0.50 () {64 vars in 1235 bytes} [Sat Sep 24 04:54:36 2022] POST /compute/v2.1/flavors => generated 405 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 24 04:54:38.325589 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi [None req-a23abc29-5e19-47b4-ac4e-f384fa570ee3 admin admin] Calling method '>' {{(pid=105408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 04:54:38.326709 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: INFO nova.api.openstack.requestlog [None req-a23abc29-5e19-47b4-ac4e-f384fa570ee3 admin admin] 10.222.0.50 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001544 Sep 24 04:54:38.327108 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: [pid: 105408|app: 0|req: 28/57] 10.222.0.50 () {56 vars in 1074 bytes} [Sat Sep 24 04:54:38 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 04:54:38.856437 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi [None req-2bfed7a7-b03c-4870-badb-f9ba7d6ef387 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=105409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 04:54:38.874998 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: INFO nova.api.openstack.requestlog [None req-2bfed7a7-b03c-4870-badb-f9ba7d6ef387 admin admin] 10.222.0.50 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.92 time: 0.409109 Sep 24 04:54:38.875528 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: [pid: 105409|app: 0|req: 30/58] 10.222.0.50 () {64 vars in 1235 bytes} [Sat Sep 24 04:54:38 2022] POST /compute/v2.1/flavors => generated 407 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 24 04:54:40.080843 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi [None req-a23abc29-5e19-47b4-ac4e-f384fa570ee3 admin admin] Calling method '>' {{(pid=105408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 04:54:40.081859 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: INFO nova.api.openstack.requestlog [None req-a23abc29-5e19-47b4-ac4e-f384fa570ee3 admin admin] 10.222.0.50 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001485 Sep 24 04:54:40.082290 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: [pid: 105408|app: 0|req: 29/59] 10.222.0.50 () {56 vars in 1074 bytes} [Sat Sep 24 04:54:40 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 04:54:40.599146 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi [None req-9098116e-a26c-4317-9744-e5f1881884a6 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=105409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 04:54:40.618210 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: INFO nova.api.openstack.requestlog [None req-9098116e-a26c-4317-9744-e5f1881884a6 admin admin] 10.222.0.50 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.92 time: 0.397269 Sep 24 04:54:40.618754 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: [pid: 105409|app: 0|req: 31/60] 10.222.0.50 () {64 vars in 1235 bytes} [Sat Sep 24 04:54:40 2022] POST /compute/v2.1/flavors => generated 409 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 24 04:54:41.851179 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi [None req-a23abc29-5e19-47b4-ac4e-f384fa570ee3 admin admin] Calling method '>' {{(pid=105408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 04:54:41.852180 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: INFO nova.api.openstack.requestlog [None req-a23abc29-5e19-47b4-ac4e-f384fa570ee3 admin admin] 10.222.0.50 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001456 Sep 24 04:54:41.852577 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: [pid: 105408|app: 0|req: 30/61] 10.222.0.50 () {56 vars in 1074 bytes} [Sat Sep 24 04:54:41 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 04:54:42.369871 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi [None req-a2c05059-dfcc-4d94-bced-8f9cb715bfc2 admin admin] Calling method '>' {{(pid=105409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 04:54:42.389707 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: INFO nova.api.openstack.requestlog [None req-a2c05059-dfcc-4d94-bced-8f9cb715bfc2 admin admin] 10.222.0.50 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.92 time: 0.398808 Sep 24 04:54:42.390266 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: [pid: 105409|app: 0|req: 32/62] 10.222.0.50 () {60 vars in 1202 bytes} [Sat Sep 24 04:54:41 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 04:55:39.214166 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi [None req-a23abc29-5e19-47b4-ac4e-f384fa570ee3 admin admin] Calling method '>' {{(pid=105408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 04:55:39.215181 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: INFO nova.api.openstack.requestlog [None req-a23abc29-5e19-47b4-ac4e-f384fa570ee3 admin admin] 10.222.0.50 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001489 Sep 24 04:55:39.215588 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: [pid: 105408|app: 0|req: 31/63] 10.222.0.50 () {54 vars in 931 bytes} [Sat Sep 24 04:55:39 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 04:55:39.226116 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: DEBUG dbcounter [-] [105409] Writing DB stats nova_api:INSERT=5,nova_api:SELECT=28 {{(pid=105409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 04:55:39.597902 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi [None req-741bf64d-8fc5-4954-8b68-7ecc6b9c456a admin admin] Calling method '>' {{(pid=105409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 04:55:39.619463 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: INFO nova.api.openstack.requestlog [None req-741bf64d-8fc5-4954-8b68-7ecc6b9c456a admin admin] 10.222.0.50 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.397871 Sep 24 04:55:39.619989 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: [pid: 105409|app: 0|req: 33/64] 10.222.0.50 () {60 vars in 1292 bytes} [Sat Sep 24 04:55:39 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 04:55:39.640979 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: DEBUG dbcounter [-] [105408] Writing DB stats nova_api:SELECT=14 {{(pid=105408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 04:55:39.644956 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi [None req-0162d6ee-6261-48e9-b4b1-624f65ac7dc2 admin admin] Calling method '>' {{(pid=105408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 04:55:39.652794 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: INFO nova.api.openstack.requestlog [None req-0162d6ee-6261-48e9-b4b1-624f65ac7dc2 admin admin] 10.222.0.50 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.013416 Sep 24 04:55:39.653354 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: [pid: 105408|app: 0|req: 32/65] 10.222.0.50 () {60 vars in 1283 bytes} [Sat Sep 24 04:55:39 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 15 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 04:55:39.665444 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi [None req-5dd1e6f3-11e9-4b35-a690-1b4eaf800817 admin admin] Calling method '>' {{(pid=105409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 04:55:39.672628 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: INFO nova.api.openstack.requestlog [None req-5dd1e6f3-11e9-4b35-a690-1b4eaf800817 admin admin] 10.222.0.50 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011324 Sep 24 04:55:39.673140 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: [pid: 105409|app: 0|req: 34/66] 10.222.0.50 () {60 vars in 1286 bytes} [Sat Sep 24 04:55:39 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 04:55:39.684839 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi [None req-00a61399-f8bc-4fca-833a-02b00f158a10 admin admin] Calling method '>' {{(pid=105408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 04:55:39.691966 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: INFO nova.api.openstack.requestlog [None req-00a61399-f8bc-4fca-833a-02b00f158a10 admin admin] 10.222.0.50 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.010635 Sep 24 04:55:39.692476 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: [pid: 105408|app: 0|req: 33/67] 10.222.0.50 () {60 vars in 1286 bytes} [Sat Sep 24 04:55:39 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 24 04:55:39.704687 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi [None req-e5efcb1a-28ea-476e-ac18-c9560247a655 admin admin] Calling method '>' {{(pid=105409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 04:55:39.711794 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: INFO nova.api.openstack.requestlog [None req-e5efcb1a-28ea-476e-ac18-c9560247a655 admin admin] 10.222.0.50 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.010565 Sep 24 04:55:39.712298 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: [pid: 105409|app: 0|req: 35/68] 10.222.0.50 () {60 vars in 1283 bytes} [Sat Sep 24 04:55:39 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 04:58:41.753119 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi [None req-00a61399-f8bc-4fca-833a-02b00f158a10 admin admin] Calling method '>' {{(pid=105408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 04:58:41.754175 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: INFO nova.api.openstack.requestlog [None req-00a61399-f8bc-4fca-833a-02b00f158a10 admin admin] 10.222.0.50 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001466 Sep 24 04:58:41.754583 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: [pid: 105408|app: 0|req: 34/69] 10.222.0.50 () {56 vars in 1074 bytes} [Sat Sep 24 04:58:41 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 04:58:41.896190 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: DEBUG dbcounter [-] [105409] Writing DB stats nova_api:SELECT=6 {{(pid=105409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 04:58:42.061842 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi [None req-478aa4ff-d79e-4848-9113-6c504ccd2ea0 admin admin] Calling method '>' {{(pid=105409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 04:58:42.067168 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: DEBUG oslo_concurrency.lockutils [None req-478aa4ff-d79e-4848-9113-6c504ccd2ea0 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 04:58:42.067709 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: DEBUG oslo_concurrency.lockutils [None req-478aa4ff-d79e-4848-9113-6c504ccd2ea0 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=105409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 04:58:42.068144 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: DEBUG oslo_concurrency.lockutils [None req-478aa4ff-d79e-4848-9113-6c504ccd2ea0 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=105409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 04:58:42.068866 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: DEBUG oslo_concurrency.lockutils [None req-478aa4ff-d79e-4848-9113-6c504ccd2ea0 admin admin] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 04:58:42.069315 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: DEBUG oslo_concurrency.lockutils [None req-478aa4ff-d79e-4848-9113-6c504ccd2ea0 admin admin] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 04:58:42.069735 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: DEBUG oslo_concurrency.lockutils [None req-478aa4ff-d79e-4848-9113-6c504ccd2ea0 admin admin] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 04:58:42.103295 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: INFO nova.api.openstack.requestlog [None req-478aa4ff-d79e-4848-9113-6c504ccd2ea0 admin admin] 10.222.0.50 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.92 time: 0.208225 Sep 24 04:58:42.103866 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: [pid: 105409|app: 0|req: 36/70] 10.222.0.50 () {60 vars in 1193 bytes} [Sat Sep 24 04:58:41 2022] GET /compute/v2.1/os-services => generated 791 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 24 04:58:43.179532 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi [None req-00a61399-f8bc-4fca-833a-02b00f158a10 admin admin] Calling method '>' {{(pid=105408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 04:58:43.180585 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: INFO nova.api.openstack.requestlog [None req-00a61399-f8bc-4fca-833a-02b00f158a10 admin admin] 10.222.0.50 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001525 Sep 24 04:58:43.180989 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: [pid: 105408|app: 0|req: 35/71] 10.222.0.50 () {56 vars in 1074 bytes} [Sat Sep 24 04:58:43 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 04:58:43.367761 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi [None req-25951f5c-0754-4204-9d47-63c07274fbe1 admin admin] Calling method '>' {{(pid=105409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 04:58:43.371164 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: DEBUG oslo_concurrency.lockutils [None req-25951f5c-0754-4204-9d47-63c07274fbe1 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 04:58:43.371641 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: DEBUG oslo_concurrency.lockutils [None req-25951f5c-0754-4204-9d47-63c07274fbe1 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 04:58:43.372123 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: DEBUG oslo_concurrency.lockutils [None req-25951f5c-0754-4204-9d47-63c07274fbe1 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 04:58:43.372867 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: DEBUG oslo_concurrency.lockutils [None req-25951f5c-0754-4204-9d47-63c07274fbe1 admin admin] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 04:58:43.373311 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: DEBUG oslo_concurrency.lockutils [None req-25951f5c-0754-4204-9d47-63c07274fbe1 admin admin] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 04:58:43.373728 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: DEBUG oslo_concurrency.lockutils [None req-25951f5c-0754-4204-9d47-63c07274fbe1 admin admin] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 04:58:43.392966 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: INFO nova.api.openstack.requestlog [None req-25951f5c-0754-4204-9d47-63c07274fbe1 admin admin] 10.222.0.50 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.92 time: 0.075565 Sep 24 04:58:43.393500 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: [pid: 105409|app: 0|req: 37/72] 10.222.0.50 () {60 vars in 1193 bytes} [Sat Sep 24 04:58:43 2022] GET /compute/v2.1/os-services => generated 791 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 24 04:58:54.869550 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi [None req-00a61399-f8bc-4fca-833a-02b00f158a10 admin admin] Calling method '>' {{(pid=105408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 04:58:54.870632 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: INFO nova.api.openstack.requestlog [None req-00a61399-f8bc-4fca-833a-02b00f158a10 admin admin] 10.222.0.50 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001497 Sep 24 04:58:54.871027 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: [pid: 105408|app: 0|req: 36/73] 10.222.0.50 () {56 vars in 1074 bytes} [Sat Sep 24 04:58:54 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 04:58:55.013594 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: DEBUG dbcounter [-] [105409] Writing DB stats nova_cell0:SELECT=4 {{(pid=105409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 04:58:55.014312 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: DEBUG dbcounter [-] [105409] Writing DB stats nova_cell1:SELECT=4 {{(pid=105409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 04:58:55.015468 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: DEBUG dbcounter [-] [105409] Writing DB stats nova_api:SELECT=8 {{(pid=105409) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 04:58:55.062931 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi [None req-f8459576-6a01-40a9-9ae2-10e6a2c7bd73 admin admin] Calling method '>' {{(pid=105409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 04:58:55.066259 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: DEBUG oslo_concurrency.lockutils [None req-f8459576-6a01-40a9-9ae2-10e6a2c7bd73 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 04:58:55.066727 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: DEBUG oslo_concurrency.lockutils [None req-f8459576-6a01-40a9-9ae2-10e6a2c7bd73 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=105409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 04:58:55.067150 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: DEBUG oslo_concurrency.lockutils [None req-f8459576-6a01-40a9-9ae2-10e6a2c7bd73 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 04:58:55.067855 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: DEBUG oslo_concurrency.lockutils [None req-f8459576-6a01-40a9-9ae2-10e6a2c7bd73 admin admin] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 04:58:55.068291 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: DEBUG oslo_concurrency.lockutils [None req-f8459576-6a01-40a9-9ae2-10e6a2c7bd73 admin admin] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 04:58:55.068701 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: DEBUG oslo_concurrency.lockutils [None req-f8459576-6a01-40a9-9ae2-10e6a2c7bd73 admin admin] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 04:58:55.094037 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: INFO nova.api.openstack.requestlog [None req-f8459576-6a01-40a9-9ae2-10e6a2c7bd73 admin admin] 10.222.0.50 "GET /compute/v2.1/os-services" status: 200 len: 1035 microversion: 2.92 time: 0.085076 Sep 24 04:58:55.094571 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: [pid: 105409|app: 0|req: 38/74] 10.222.0.50 () {60 vars in 1193 bytes} [Sat Sep 24 04:58:55 2022] GET /compute/v2.1/os-services => generated 1035 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 04:58:56.176912 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: DEBUG nova.api.openstack.wsgi [None req-00a61399-f8bc-4fca-833a-02b00f158a10 admin admin] Calling method '>' {{(pid=105408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 04:58:56.177914 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: INFO nova.api.openstack.requestlog [None req-00a61399-f8bc-4fca-833a-02b00f158a10 admin admin] 10.222.0.50 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001429 Sep 24 04:58:56.178344 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: [pid: 105408|app: 0|req: 37/75] 10.222.0.50 () {56 vars in 1074 bytes} [Sat Sep 24 04:58:56 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 04:58:56.368245 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: DEBUG nova.api.openstack.wsgi [None req-df43b1ff-600a-4aa0-a6cc-9a70b518cdc4 admin admin] Calling method '>' {{(pid=105409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 04:58:56.371644 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: DEBUG oslo_concurrency.lockutils [None req-df43b1ff-600a-4aa0-a6cc-9a70b518cdc4 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 04:58:56.372121 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: DEBUG oslo_concurrency.lockutils [None req-df43b1ff-600a-4aa0-a6cc-9a70b518cdc4 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 04:58:56.372553 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: DEBUG oslo_concurrency.lockutils [None req-df43b1ff-600a-4aa0-a6cc-9a70b518cdc4 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 04:58:56.373289 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: DEBUG oslo_concurrency.lockutils [None req-df43b1ff-600a-4aa0-a6cc-9a70b518cdc4 admin admin] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 04:58:56.373740 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: DEBUG oslo_concurrency.lockutils [None req-df43b1ff-600a-4aa0-a6cc-9a70b518cdc4 admin admin] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 04:58:56.374201 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: DEBUG oslo_concurrency.lockutils [None req-df43b1ff-600a-4aa0-a6cc-9a70b518cdc4 admin admin] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 04:58:56.396732 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: INFO nova.api.openstack.requestlog [None req-df43b1ff-600a-4aa0-a6cc-9a70b518cdc4 admin admin] 10.222.0.50 "GET /compute/v2.1/os-services" status: 200 len: 1035 microversion: 2.92 time: 0.079736 Sep 24 04:58:56.397211 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: [pid: 105409|app: 0|req: 39/76] 10.222.0.50 () {60 vars in 1193 bytes} [Sat Sep 24 04:58:56 2022] GET /compute/v2.1/os-services => generated 1035 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 04:59:54.396248 dv-cinder-859186-1-iscsi devstack@n-api.service[105407]: Sat Sep 24 04:59:54 2022 - graceful shutdown triggered... Sep 24 04:59:54.396381 dv-cinder-859186-1-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... Sep 24 04:59:54.397381 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: Gracefully killing worker 1 (pid: 105408)... Sep 24 04:59:54.398068 dv-cinder-859186-1-iscsi devstack@n-api.service[105409]: Gracefully killing worker 2 (pid: 105409)... Sep 24 04:59:54.523654 dv-cinder-859186-1-iscsi devstack@n-api.service[105408]: DEBUG dbcounter [-] [105408] Writing DB stats nova_api:SELECT=4 {{(pid=105408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 04:59:55.397940 dv-cinder-859186-1-iscsi devstack@n-api.service[105407]: worker 1 buried after 1 seconds Sep 24 04:59:55.397940 dv-cinder-859186-1-iscsi devstack@n-api.service[105407]: worker 2 buried after 1 seconds Sep 24 04:59:55.397940 dv-cinder-859186-1-iscsi devstack@n-api.service[105407]: goodbye to uWSGI. Sep 24 04:59:55.399727 dv-cinder-859186-1-iscsi systemd[1]: devstack@n-api.service: Succeeded. Sep 24 04:59:55.400262 dv-cinder-859186-1-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. Sep 24 04:59:55.403097 dv-cinder-859186-1-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Sep 24 04:59:55.412802 dv-cinder-859186-1-iscsi devstack@n-api.service[120575]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Sep 24 04:59:55.415209 dv-cinder-859186-1-iscsi devstack@n-api.service[120575]: *** Starting uWSGI 2.0.18-debian (64bit) on [Sat Sep 24 04:59:55 2022] *** Sep 24 04:59:55.415209 dv-cinder-859186-1-iscsi devstack@n-api.service[120575]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Sep 24 04:59:55.415209 dv-cinder-859186-1-iscsi devstack@n-api.service[120575]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Sep 24 04:59:55.415209 dv-cinder-859186-1-iscsi devstack@n-api.service[120575]: nodename: dv-cinder-859186-1-iscsi Sep 24 04:59:55.415209 dv-cinder-859186-1-iscsi devstack@n-api.service[120575]: machine: x86_64 Sep 24 04:59:55.415209 dv-cinder-859186-1-iscsi devstack@n-api.service[120575]: clock source: unix Sep 24 04:59:55.415209 dv-cinder-859186-1-iscsi devstack@n-api.service[120575]: pcre jit disabled Sep 24 04:59:55.415209 dv-cinder-859186-1-iscsi devstack@n-api.service[120575]: detected number of CPU cores: 4 Sep 24 04:59:55.415209 dv-cinder-859186-1-iscsi devstack@n-api.service[120575]: current working directory: / Sep 24 04:59:55.415209 dv-cinder-859186-1-iscsi devstack@n-api.service[120575]: detected binary path: /usr/bin/uwsgi-core Sep 24 04:59:55.415209 dv-cinder-859186-1-iscsi devstack@n-api.service[120575]: your processes number limit is 47680 Sep 24 04:59:55.415209 dv-cinder-859186-1-iscsi devstack@n-api.service[120575]: your memory page size is 4096 bytes Sep 24 04:59:55.415209 dv-cinder-859186-1-iscsi devstack@n-api.service[120575]: detected max file descriptor number: 2048 Sep 24 04:59:55.415209 dv-cinder-859186-1-iscsi devstack@n-api.service[120575]: lock engine: pthread robust mutexes Sep 24 04:59:55.415209 dv-cinder-859186-1-iscsi devstack@n-api.service[120575]: thunder lock: enabled Sep 24 04:59:55.416127 dv-cinder-859186-1-iscsi devstack@n-api.service[120575]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Sep 24 04:59:55.416127 dv-cinder-859186-1-iscsi devstack@n-api.service[120575]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Sep 24 04:59:55.455184 dv-cinder-859186-1-iscsi devstack@n-api.service[120575]: Python main interpreter initialized at 0x55712acb69c0 Sep 24 04:59:55.455184 dv-cinder-859186-1-iscsi devstack@n-api.service[120575]: python threads support enabled Sep 24 04:59:55.455184 dv-cinder-859186-1-iscsi devstack@n-api.service[120575]: your server socket listen backlog is limited to 100 connections Sep 24 04:59:55.455184 dv-cinder-859186-1-iscsi devstack@n-api.service[120575]: your mercy for graceful operations on workers is 90 seconds Sep 24 04:59:55.455552 dv-cinder-859186-1-iscsi devstack@n-api.service[120575]: mapped 403077 bytes (393 KB) for 2 cores Sep 24 04:59:55.455620 dv-cinder-859186-1-iscsi devstack@n-api.service[120575]: *** Operational MODE: preforking *** Sep 24 04:59:55.455872 dv-cinder-859186-1-iscsi devstack@n-api.service[120575]: *** uWSGI is running in multiple interpreter mode *** Sep 24 04:59:55.455872 dv-cinder-859186-1-iscsi devstack@n-api.service[120575]: spawned uWSGI master process (pid: 120575) Sep 24 04:59:55.456066 dv-cinder-859186-1-iscsi systemd[1]: Started Devstack devstack@n-api.service. Sep 24 04:59:55.458751 dv-cinder-859186-1-iscsi devstack@n-api.service[120575]: spawned uWSGI worker 1 (pid: 120593, cores: 1) Sep 24 04:59:55.459331 dv-cinder-859186-1-iscsi devstack@n-api.service[120575]: spawned uWSGI worker 2 (pid: 120594, cores: 1) Sep 24 04:59:55.459671 dv-cinder-859186-1-iscsi devstack@n-api.service[120575]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Sep 24 04:59:56.133651 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Sep 24 04:59:56.141387 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Sep 24 04:59:57.289600 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 24 04:59:57.289600 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: from cryptography.utils import int_from_bytes Sep 24 04:59:57.290226 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 24 04:59:57.290226 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: from cryptography.utils import int_from_bytes Sep 24 04:59:57.291996 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 24 04:59:57.291996 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: from cryptography.utils import int_from_bytes Sep 24 04:59:57.292416 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 24 04:59:57.292416 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: from cryptography.utils import int_from_bytes Sep 24 04:59:59.734789 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Sep 24 04:59:59.735464 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Sep 24 04:59:59.735702 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Sep 24 04:59:59.735953 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Sep 24 04:59:59.736213 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Sep 24 04:59:59.736635 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 04:59:59.736753 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Sep 24 04:59:59.737152 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 04:59:59.737248 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Sep 24 04:59:59.737326 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 04:59:59.737529 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Sep 24 04:59:59.737634 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 04:59:59.737889 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Sep 24 04:59:59.738112 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 04:59:59.738192 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Sep 24 04:59:59.738280 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 04:59:59.738540 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 04:59:59.738659 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 04:59:59.738864 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 04:59:59.738972 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 04:59:59.739185 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 04:59:59.739294 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 04:59:59.739466 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 04:59:59.739572 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 04:59:59.739759 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 04:59:59.739869 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 04:59:59.740117 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 04:59:59.740218 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-859186-1-iscsi {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 04:59:59.740440 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 04:59:59.740549 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 04:59:59.740766 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 04:59:59.740950 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 04:59:59.741104 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 04:59:59.741256 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 04:59:59.741416 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 04:59:59.741571 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 04:59:59.741724 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 04:59:59.741875 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 04:59:59.742141 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 04:59:59.742298 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-859186-1-iscsi {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 04:59:59.742462 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 04:59:59.742616 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 04:59:59.742776 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 04:59:59.743018 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 04:59:59.743188 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 04:59:59.743348 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 04:59:59.743612 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 04:59:59.743942 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 04:59:59.744248 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 04:59:59.744673 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 04:59:59.744929 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 04:59:59.745171 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 04:59:59.745418 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 04:59:59.745643 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 04:59:59.745860 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 04:59:59.745860 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 04:59:59.746418 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 04:59:59.746666 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 04:59:59.746888 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 04:59:59.747097 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 04:59:59.747306 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 04:59:59.747525 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 04:59:59.747750 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 04:59:59.747958 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 04:59:59.748200 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 04:59:59.748422 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 04:59:59.748667 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 04:59:59.748887 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 04:59:59.749108 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 04:59:59.749301 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 04:59:59.749524 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-859186-1-iscsi {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 04:59:59.749676 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-859186-1-iscsi {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 04:59:59.750387 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 04:59:59.750543 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 04:59:59.750727 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 04:59:59.750885 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 04:59:59.751442 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 04:59:59.751606 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 04:59:59.751773 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 04:59:59.751931 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 04:59:59.752087 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 04:59:59.752241 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 04:59:59.752397 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 04:59:59.752556 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 04:59:59.752743 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 04:59:59.752948 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 04:59:59.753107 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 04:59:59.753255 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 04:59:59.753400 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 04:59:59.753560 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 04:59:59.753804 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 04:59:59.754190 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 04:59:59.754364 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 04:59:59.754644 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 04:59:59.754810 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 04:59:59.754981 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 04:59:59.755128 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 04:59:59.755291 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 04:59:59.755514 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 04:59:59.755674 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 04:59:59.755965 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 04:59:59.756164 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 04:59:59.756326 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 04:59:59.756498 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 04:59:59.756649 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 04:59:59.756805 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 04:59:59.756962 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 04:59:59.757116 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 04:59:59.757272 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 04:59:59.757424 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 04:59:59.757576 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 04:59:59.757721 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 04:59:59.757879 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 04:59:59.758053 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 04:59:59.758206 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 04:59:59.758359 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 04:59:59.758520 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 04:59:59.758676 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 04:59:59.758836 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 04:59:59.758994 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 04:59:59.759144 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 04:59:59.759296 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 04:59:59.759490 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 04:59:59.759673 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 04:59:59.759829 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 04:59:59.759982 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 04:59:59.760139 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 04:59:59.760285 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 04:59:59.760444 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 04:59:59.760595 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 04:59:59.760754 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 04:59:59.760899 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 04:59:59.761049 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 04:59:59.761630 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 04:59:59.761630 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 04:59:59.761940 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 04:59:59.762112 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 04:59:59.762272 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 04:59:59.762688 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 04:59:59.762859 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 04:59:59.763063 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 04:59:59.763238 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 04:59:59.763504 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 04:59:59.763664 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 04:59:59.763836 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 04:59:59.764071 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 04:59:59.764071 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 04:59:59.764530 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 04:59:59.764530 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 04:59:59.764819 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 04:59:59.764964 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 04:59:59.765260 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 04:59:59.766016 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 04:59:59.766274 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 04:59:59.766442 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.50 {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 04:59:59.766613 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.50 {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 04:59:59.766768 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.50 {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 04:59:59.766928 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.50 {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 04:59:59.767085 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 04:59:59.767230 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 04:59:59.767382 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 04:59:59.767529 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 04:59:59.767680 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 04:59:59.767841 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 04:59:59.767997 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 04:59:59.768142 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 04:59:59.768293 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 04:59:59.768446 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 04:59:59.768603 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 04:59:59.768762 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 04:59:59.768909 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 04:59:59.769059 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 04:59:59.769212 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 04:59:59.769364 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 04:59:59.769523 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 04:59:59.769679 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 04:59:59.769831 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 04:59:59.769985 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 04:59:59.770177 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 04:59:59.770330 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 04:59:59.770486 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 04:59:59.770640 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 04:59:59.770795 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 04:59:59.770948 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 04:59:59.771100 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 04:59:59.771253 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 04:59:59.771826 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 04:59:59.771989 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 04:59:59.772136 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 04:59:59.772288 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 04:59:59.772452 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 04:59:59.772606 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 04:59:59.772767 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 04:59:59.772921 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 04:59:59.773123 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 04:59:59.773282 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 04:59:59.773443 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 04:59:59.773686 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 04:59:59.773840 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 04:59:59.774015 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 04:59:59.774252 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 04:59:59.774572 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 04:59:59.774726 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 04:59:59.774894 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 04:59:59.775040 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 04:59:59.775192 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 04:59:59.775345 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 04:59:59.775502 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 04:59:59.775648 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 04:59:59.775807 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 04:59:59.775954 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 04:59:59.776105 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 04:59:59.776262 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 04:59:59.776406 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 04:59:59.776565 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 04:59:59.776723 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 04:59:59.776887 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 04:59:59.777034 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 04:59:59.777184 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 04:59:59.777337 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 04:59:59.777482 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 04:59:59.777635 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 04:59:59.777780 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 04:59:59.777931 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 04:59:59.778127 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 04:59:59.778275 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 04:59:59.778430 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 04:59:59.778664 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 04:59:59.778828 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 04:59:59.778988 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 04:59:59.779135 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 04:59:59.779135 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 04:59:59.779433 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 04:59:59.779591 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 04:59:59.779744 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 04:59:59.779744 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 04:59:59.780045 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 04:59:59.780199 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 04:59:59.780353 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 04:59:59.780353 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 04:59:59.780636 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 04:59:59.780636 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 04:59:59.780923 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 04:59:59.780923 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 04:59:59.781222 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 04:59:59.781376 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 04:59:59.781549 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 04:59:59.782088 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 04:59:59.782238 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 04:59:59.782391 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 04:59:59.782549 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 04:59:59.782704 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 04:59:59.782849 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 04:59:59.783004 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 04:59:59.783213 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 04:59:59.783364 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 04:59:59.783524 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 04:59:59.783695 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 04:59:59.783921 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 04:59:59.784073 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 04:59:59.784236 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 04:59:59.784489 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 04:59:59.784816 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 04:59:59.784971 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 04:59:59.785118 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 04:59:59.785270 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 04:59:59.785425 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 04:59:59.785597 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 04:59:59.785751 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 04:59:59.785896 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 04:59:59.786058 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 04:59:59.786209 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 04:59:59.786366 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 04:59:59.786521 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 04:59:59.786678 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 04:59:59.786838 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 04:59:59.786991 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 04:59:59.787136 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 04:59:59.787279 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 04:59:59.787432 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 04:59:59.787589 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 04:59:59.787796 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 04:59:59.788038 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 04:59:59.788203 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 04:59:59.788364 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 04:59:59.788512 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.788665 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 04:59:59.788811 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.788955 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.789098 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.789251 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.789404 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.789571 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.789724 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.789877 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.790055 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.790228 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.790383 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.790536 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.790690 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.790835 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.790993 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.791139 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.791289 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.791452 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.791598 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.792144 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.792318 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.792467 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.792739 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.792904 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.793052 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.793195 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.793404 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.793563 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.793710 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.793861 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.794205 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.794358 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.794603 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.794857 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.795036 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.795271 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.795429 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.795584 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.795729 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.795885 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.796038 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.796184 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.796335 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.796500 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.796655 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.796814 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.796968 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.797125 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.797270 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.797414 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.797577 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.797724 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.797880 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.798046 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.798198 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.798365 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.798525 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.798679 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.798824 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.798969 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.799113 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.799257 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.799411 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.799563 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.799708 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.799851 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.799996 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.800139 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.800306 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.800460 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.800627 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.800875 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.801050 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.801214 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.801360 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.801512 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.801664 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.801836 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.802394 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.802567 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.802723 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.802880 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.803035 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.803189 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.803385 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.803550 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.803708 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.803861 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.804014 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.804186 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.804411 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.804589 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.804827 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.805047 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.805221 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.805468 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.805635 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.805792 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.805945 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.806115 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.806273 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.806273 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.806565 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.806722 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.806875 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.807028 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.807531 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.807691 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.807925 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.808073 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.808217 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.808362 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.808514 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.808669 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.808865 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.809024 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.809171 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.809322 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.809469 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.809613 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.809777 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.809931 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.810100 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.810257 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.810411 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.810571 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.810725 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.810871 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.811024 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.811170 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.811313 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.811469 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.811627 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.811771 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.811915 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.812084 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.813071 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.813241 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.813444 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.813597 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.813751 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.813897 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.814100 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.814265 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.814429 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.814663 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.814832 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.815068 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.815297 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.815466 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.815708 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.815861 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.816006 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.816150 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.816304 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.816461 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.816627 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.816782 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.816939 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.817084 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.817250 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.817397 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.817541 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.817693 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.817848 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.818027 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.818189 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.818344 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.818490 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.818642 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.818798 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.818953 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.819111 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.819257 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.819408 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.819554 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.819697 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.819854 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.820008 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.820154 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.820298 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.820442 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.820593 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.820762 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.820914 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.821067 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.821220 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.821366 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.821528 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.821674 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.821834 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.821988 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.822167 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.822322 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.822478 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.822623 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.822779 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.823306 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.823517 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.823669 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.823828 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.823981 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.824135 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.824288 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.824434 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.824577 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.824823 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.824984 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.825222 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.825467 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.825627 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.825887 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.826186 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.826356 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.826511 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.826667 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.826818 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.826973 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.827118 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.827271 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.827424 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.827588 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.827741 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.827934 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.828580 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.828740 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.828899 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.829051 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.829200 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.829364 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.829516 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.829665 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.829814 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.829964 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.830150 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.830319 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.830473 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.830630 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.830789 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.830947 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.831113 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.831264 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.831416 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.831564 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.831714 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.831871 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.832036 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.832197 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.832347 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.832505 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.832655 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.832805 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.832968 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.833498 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.833707 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.833864 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.834065 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.834236 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.834402 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.834608 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.834807 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.835030 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.835030 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.835444 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.835670 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.835836 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.836092 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.836297 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.836456 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.836629 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.836788 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.836950 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.837111 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.837282 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.837434 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.837593 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.837748 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.837906 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.838091 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.838258 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.838410 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.838570 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.838729 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.838889 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.839042 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.839191 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.839350 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.839513 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.839664 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.839824 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.839983 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.840135 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.840368 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.840530 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.840682 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.840832 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.840983 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.841133 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.841303 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.841454 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.841613 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.841763 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.841921 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.842126 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.842299 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.842452 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.842602 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.842758 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.842918 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.843204 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.843789 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.843970 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.844126 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.844277 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.844427 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.844587 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.844739 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.844889 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.845065 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.845296 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.845546 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.845800 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.845979 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.846254 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.846425 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.846576 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.846749 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.846911 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.848305 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.848416 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.848495 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.848567 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.848637 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.848719 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.848801 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.848873 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.848942 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.849019 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.849100 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.849179 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.849257 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.849335 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.849417 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.849488 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.849565 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.849643 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.849721 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.849800 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.849878 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.849949 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.850064 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.850140 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.850215 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.850293 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.850371 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.850473 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.850568 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.850653 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.850734 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.850815 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.850896 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.850990 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.851081 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.851172 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.851255 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.851337 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.851418 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.851513 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.851596 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.851678 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.851759 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.851839 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.851919 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.852020 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.852113 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.852197 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.852286 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.852370 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.852451 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.852541 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.852632 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.852722 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.852806 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.852887 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.852987 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.853072 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.853154 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.853243 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.853335 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.853426 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.853515 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.853595 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.853667 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.853736 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.853736 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.853861 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.853938 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.854027 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.854100 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.854679 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.854679 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.854840 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.854921 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.855000 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.855082 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.855154 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.855222 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.855289 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.855357 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.855430 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.855514 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.855594 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.855672 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.855752 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.855823 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.855891 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.855966 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.856037 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.856037 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.856037 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.856037 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.856325 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.856397 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.856465 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.856532 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.856609 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.856680 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.856753 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.856830 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.856901 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.856977 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.857097 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.857183 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.857356 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.857438 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.857518 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.857590 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.857657 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.857733 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.857882 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.857963 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.862096 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.862445 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.862617 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.862783 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.862968 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.863124 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.863276 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.863428 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.863611 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.863886 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.864051 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.864204 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.864356 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.864515 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.864672 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.864834 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.864988 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.865479 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.865669 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.865970 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.866165 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.866336 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.866498 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.866659 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.866822 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.867056 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.867212 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.867385 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.867540 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.867718 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.867871 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.868028 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.868267 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.868430 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.868583 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.868742 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.868905 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.869057 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.869223 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.869396 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.869550 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.869700 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.869871 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.870065 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.870264 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.871106 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.871276 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.871430 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.871590 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.871743 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.871905 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.872058 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.872209 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.872361 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.872512 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.872684 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.872846 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.873001 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.873151 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.873311 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.873465 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.873625 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.873778 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.874045 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.874221 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.874383 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.874544 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.875242 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.875626 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.875796 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.876300 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.876472 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.876472 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.876779 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.876941 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.877105 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.877105 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.877402 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.877635 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.877789 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.877960 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.878328 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.878491 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.878644 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.878808 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.878960 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.879118 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.879270 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.879427 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.879587 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.879753 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.879931 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.880092 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.880267 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.880428 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.880757 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.880933 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.881086 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.881237 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.881387 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.881559 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.881725 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.881888 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.882066 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.882237 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.882390 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.882556 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.882722 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.882876 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.883034 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.883188 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.883346 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.883497 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.883657 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.883816 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.883994 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.884220 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.884393 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.884547 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.884722 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.884876 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.885028 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.885178 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.885329 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.885734 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.885906 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.886234 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.886492 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.886660 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.886821 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.886984 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.887149 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.887308 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.887733 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.887887 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.888039 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.888204 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.888365 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.888517 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.888668 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.888920 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.889232 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.889409 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.889571 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.889744 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.889909 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.890131 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.890323 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.891241 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.891402 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.891553 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.891714 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.891866 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.892026 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.892178 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.892338 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.892491 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.892653 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.892904 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.893076 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.893230 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.893381 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.893539 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.893691 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.893856 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.894040 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.894219 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.894458 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.894617 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.894776 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.894953 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.895115 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.895267 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.895419 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.895818 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.895988 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.896296 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.896460 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.896724 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.896890 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.897044 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.897196 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.897357 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.897521 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.897682 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.897834 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.898098 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.898275 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.898444 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.898598 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.898748 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.898898 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.899049 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.899198 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.899361 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.899522 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.899694 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.899845 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.900015 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.900182 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.900335 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.900486 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.900645 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.900806 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.901057 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.901397 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.901568 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.901877 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.902078 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.902239 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.902399 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.902568 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.902731 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.902892 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.903053 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.903205 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.903370 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.903523 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.903681 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.903842 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.903994 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.904163 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.904326 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.904572 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.904741 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.904895 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.905046 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.905197 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.905357 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.905509 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.905774 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.906141 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.906443 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.906613 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.906873 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.907036 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.907195 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.907348 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.907498 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.907658 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.907819 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.907972 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.908122 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.908280 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.908433 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.908598 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.908770 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.909514 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.909704 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.910012 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.910190 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.910347 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.910500 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.910660 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.910822 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.910984 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.911138 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.911340 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.911663 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.911896 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.912052 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.912206 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.912410 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.912574 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.912752 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.912917 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.913071 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.913232 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.913389 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.913540 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.913715 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.913884 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.914075 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.914235 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.914399 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.914579 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.914826 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.914993 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.915155 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.915309 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.915468 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.915620 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.915898 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.916243 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.916571 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.916734 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.916903 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.917162 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.917331 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.917485 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.917637 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.917788 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.917949 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.918127 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.918281 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.918444 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.918595 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.918756 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.918918 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.919071 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.919229 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.919390 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.919543 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.919693 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.919866 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.920030 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.920183 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.920342 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.920513 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.920667 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.920827 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.920980 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.921140 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.921294 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.921458 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.921844 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.922066 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.922238 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.922400 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.922554 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.922715 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.922715 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.923037 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.923037 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.923328 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.923487 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.923640 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.923640 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.923961 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.924071 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.924161 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.924247 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.924346 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.924434 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.924529 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.924618 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.924709 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.924812 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.924914 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.925003 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.925087 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.925171 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.925254 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.925337 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.925436 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.925524 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.925608 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.925692 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.925784 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.926067 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.926169 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.926405 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.926544 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.926637 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.926722 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.926821 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.926909 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.926993 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.927076 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.927335 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.927430 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.927531 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.927627 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.927714 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.927805 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.927892 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.927984 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.928080 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.928174 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.928260 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.928344 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.928467 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.928581 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.928679 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.928775 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.928868 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.928964 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.929058 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.929154 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.929248 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.929335 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.929427 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.929513 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.929605 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.929705 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.929793 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.929881 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.929965 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.930105 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.930196 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.930294 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.930389 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.930475 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.930578 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.930667 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.930751 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.930909 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.930998 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.931083 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.931167 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.931251 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.931344 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.931439 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.931533 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.931627 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.931742 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.931985 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.932093 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.932183 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.932267 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.932359 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.932445 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.932529 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.932622 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.932709 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.932793 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.932877 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.932968 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.933062 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.933162 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.933250 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.933344 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.933439 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.933532 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.933627 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.933714 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.933806 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.933899 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.933985 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.934089 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.934189 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.934285 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.934371 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.934455 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.934539 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.934683 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.934789 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.934878 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.934962 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.935046 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.935137 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.935223 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.935321 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.935407 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.935491 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.935582 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.935668 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.935761 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.935856 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.935957 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.936056 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.936127 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.936196 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.936290 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.936386 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.936615 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.936706 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.936844 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.936940 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.937040 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.937134 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.937923 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.938043 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.938125 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.938209 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.938308 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.938405 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.938499 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.938594 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.938749 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.938855 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.938943 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.939035 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.939129 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.939216 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.939307 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.939402 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.939490 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.939573 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.939657 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.939748 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.939841 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.939937 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.940023 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.940114 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.940202 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.940286 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.940393 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.940481 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.940574 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.940668 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.940753 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.940845 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.940946 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.941033 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.941117 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.941200 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.941283 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.941367 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.941459 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.941545 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.941629 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.941721 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.941817 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.941981 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.942133 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.942230 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.942325 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.942411 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.942502 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.942598 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.942686 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.942778 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.942864 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.942956 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.943051 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.943139 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.943230 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.943315 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.943400 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.943494 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.943593 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.943687 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.943781 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.943867 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.943959 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.944045 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.944247 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.944337 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.944421 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.944513 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.944600 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.944699 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.944786 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.944878 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.944971 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.945070 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.945159 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.945252 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.945338 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.945423 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.945506 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.945589 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.945681 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.945776 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.945862 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.945946 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.946090 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.946234 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.946345 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.946435 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.946528 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.946737 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.946900 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.947001 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.947098 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.947185 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.947276 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.947411 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.947526 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.947526 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.947753 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.947974 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.948178 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.948310 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.948437 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.948551 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.948672 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.948793 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.948907 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.949026 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.949139 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.949264 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.949379 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.949490 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.949608 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.949721 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.949831 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.949831 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.950143 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.950257 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.950377 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.950377 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.950606 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.950752 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.950936 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.951063 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.951184 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.951298 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.951417 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.951545 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.951641 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.951728 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.951811 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.951902 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.952002 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.952139 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.952224 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.952304 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.952376 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.952465 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.952559 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.952640 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.952712 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.952781 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.952900 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.952988 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.953086 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.953172 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.953256 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.953339 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.953422 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.953512 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.953606 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.953693 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.953776 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.953859 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.953949 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.954106 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.954184 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.954261 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.954341 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.954419 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.954492 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.954576 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.954650 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.954719 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.954787 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.954864 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.954950 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.955031 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.955109 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.955188 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.955266 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.955336 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.955405 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.955488 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.955560 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.955560 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.955560 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.955560 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.955560 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.955879 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.955948 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.956039 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.956111 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.956188 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.956274 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.956346 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.956416 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.956484 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.956552 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.956628 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.956725 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.956801 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.956879 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.956967 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.957047 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.957126 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.957221 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.957315 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.957408 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.957494 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.957578 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.957670 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.957764 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.957858 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.958122 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.958282 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.958412 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.958557 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.958557 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.958728 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.958728 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.958894 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.958991 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.959091 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.959179 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.959304 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.959396 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.959490 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.959583 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.959683 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.959779 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.959871 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.959994 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.960170 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.960322 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.960480 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.960640 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.960808 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.960958 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.961127 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.961274 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.961492 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.961664 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.961765 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.961891 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.962100 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.962246 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.962383 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.962522 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.962697 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.962830 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.963009 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.963147 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.963321 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.963466 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.963638 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.963780 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.963951 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.964095 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.964262 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.964412 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.964572 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.964726 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.964885 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.965045 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.965197 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.965394 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.965515 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.965718 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.965856 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.966064 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.966219 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.966389 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.966507 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.966712 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.966823 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.967080 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.967192 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.967340 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.967431 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.967653 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.967747 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.967965 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.968064 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.968286 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.968405 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.969135 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.969242 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.969449 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.969579 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.969759 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.969860 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.970115 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.970224 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.970526 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.970623 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.970844 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.970949 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.971166 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.971280 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.971479 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.971574 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.971787 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.971898 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.972109 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.972219 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.972421 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.972540 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.972810 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.972910 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.973043 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.973137 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.973356 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.973448 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.973689 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.973782 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.974038 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.974146 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.974375 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.974476 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.974688 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.974777 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.974995 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.975093 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.975300 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.975401 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.975606 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.975699 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.975920 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.976010 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.976249 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.976355 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.976538 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.976630 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.976842 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.976943 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.977252 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.977361 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.977437 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.977507 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.977742 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.977842 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.978065 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.978161 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.978371 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.978464 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.978679 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.978777 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.978981 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.979072 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.979279 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.979369 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.979582 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.979674 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.979882 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.979980 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.980186 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.980278 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.980489 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.980580 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.980789 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.980880 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.981096 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.981193 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.981398 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.981504 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.981701 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.981794 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.982024 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.982124 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.982326 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.982434 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.982628 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.982736 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.982967 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.983058 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.983284 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.983389 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.983602 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.983702 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.983912 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.984011 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.984839 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.984948 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.985157 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.985449 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.985548 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.986893 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.987012 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.987102 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.987193 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.987311 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.987311 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.987459 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.987553 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.987646 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.987730 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.987812 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.987892 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.988039 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.988178 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.988435 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.988546 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.988653 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.988742 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.988973 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.989092 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.989286 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.989390 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.989596 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.989769 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.989936 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.990127 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.990280 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.990435 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.990592 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.990740 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.990887 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.991036 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.991185 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.991326 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.991475 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.991615 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.991763 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.991913 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.992082 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.992227 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.992396 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.992541 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.992709 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.992851 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.993033 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.993127 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.993331 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.993435 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.993640 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.993768 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.993951 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.994063 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.994290 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.994398 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.994608 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.994699 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.994919 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.995011 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.995232 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.995325 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.995548 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.995648 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.995865 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.995957 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.996191 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.996296 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.996515 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.996613 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.996826 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.996955 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.997153 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.997247 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.997480 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.997580 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.997804 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.997894 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.998150 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.998277 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.998481 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.998598 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.998712 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=120593) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Sep 24 04:59:59.998821 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.999129 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.999442 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 04:59:59.999777 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 05:00:00.000017 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=120594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Sep 24 05:00:00.060616 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: INFO dbcounter [None req-f00e8b52-640c-40b5-8f89-822a6c88a306 None None] Registered counter for database nova_api Sep 24 05:00:00.061072 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: INFO dbcounter [None req-172b72a8-90e0-4af9-a8c6-8d257f7da37e None None] Registered counter for database nova_api Sep 24 05:00:00.081339 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_db.sqlalchemy.engines [None req-f00e8b52-640c-40b5-8f89-822a6c88a306 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120593) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 24 05:00:00.082901 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_db.sqlalchemy.engines [None req-172b72a8-90e0-4af9-a8c6-8d257f7da37e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120594) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 24 05:00:00.088013 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG dbcounter [-] [120593] Writer thread running {{(pid=120593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 24 05:00:00.089353 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG dbcounter [-] [120594] Writer thread running {{(pid=120594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 24 05:00:00.144034 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.context [None req-f00e8b52-640c-40b5-8f89-822a6c88a306 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),47a24eaf-35b3-42cb-8a92-f2a747d63cec(cell1) {{(pid=120593) load_cells /opt/stack/nova/nova/context.py:464}} Sep 24 05:00:00.145223 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.context [None req-172b72a8-90e0-4af9-a8c6-8d257f7da37e None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),47a24eaf-35b3-42cb-8a92-f2a747d63cec(cell1) {{(pid=120594) load_cells /opt/stack/nova/nova/context.py:464}} Sep 24 05:00:00.148077 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-f00e8b52-640c-40b5-8f89-822a6c88a306 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:00:00.148550 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-f00e8b52-640c-40b5-8f89-822a6c88a306 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:00:00.149212 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-172b72a8-90e0-4af9-a8c6-8d257f7da37e None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:00:00.149681 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-172b72a8-90e0-4af9-a8c6-8d257f7da37e None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:00:00.150207 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-f00e8b52-640c-40b5-8f89-822a6c88a306 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:00:00.150957 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-f00e8b52-640c-40b5-8f89-822a6c88a306 None None] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:00:00.151267 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-172b72a8-90e0-4af9-a8c6-8d257f7da37e None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:00:00.151408 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-f00e8b52-640c-40b5-8f89-822a6c88a306 None None] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:00:00.151999 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-172b72a8-90e0-4af9-a8c6-8d257f7da37e None None] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:00:00.152442 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-172b72a8-90e0-4af9-a8c6-8d257f7da37e None None] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:00:00.153410 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-f00e8b52-640c-40b5-8f89-822a6c88a306 None None] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:00:00.154448 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-172b72a8-90e0-4af9-a8c6-8d257f7da37e None None] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:00:00.155456 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: INFO dbcounter [None req-f00e8b52-640c-40b5-8f89-822a6c88a306 None None] Registered counter for database nova_cell0 Sep 24 05:00:00.156508 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: INFO dbcounter [None req-172b72a8-90e0-4af9-a8c6-8d257f7da37e None None] Registered counter for database nova_cell0 Sep 24 05:00:00.159607 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: INFO dbcounter [None req-f00e8b52-640c-40b5-8f89-822a6c88a306 None None] Registered counter for database nova_cell1 Sep 24 05:00:00.160467 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: INFO dbcounter [None req-172b72a8-90e0-4af9-a8c6-8d257f7da37e None None] Registered counter for database nova_cell1 Sep 24 05:00:00.167288 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_db.sqlalchemy.engines [None req-f00e8b52-640c-40b5-8f89-822a6c88a306 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120593) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 24 05:00:00.170053 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_db.sqlalchemy.engines [None req-f00e8b52-640c-40b5-8f89-822a6c88a306 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120593) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 24 05:00:00.170963 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_db.sqlalchemy.engines [None req-172b72a8-90e0-4af9-a8c6-8d257f7da37e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120594) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 24 05:00:00.173739 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_db.sqlalchemy.engines [None req-172b72a8-90e0-4af9-a8c6-8d257f7da37e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120594) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 24 05:00:00.174703 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG dbcounter [-] [120593] Writer thread running {{(pid=120593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 24 05:00:00.178442 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG dbcounter [-] [120594] Writer thread running {{(pid=120594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 24 05:00:00.317199 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG dbcounter [-] [120593] Writer thread running {{(pid=120593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 24 05:00:00.329391 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: INFO dbcounter [None req-f00e8b52-640c-40b5-8f89-822a6c88a306 None None] Registered counter for database nova_cell0 Sep 24 05:00:00.329990 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG dbcounter [-] [120594] Writer thread running {{(pid=120594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 24 05:00:00.336254 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_db.sqlalchemy.engines [None req-f00e8b52-640c-40b5-8f89-822a6c88a306 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120593) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 24 05:00:00.340783 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG dbcounter [-] [120593] Writer thread running {{(pid=120593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 24 05:00:00.342378 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: INFO dbcounter [None req-172b72a8-90e0-4af9-a8c6-8d257f7da37e None None] Registered counter for database nova_cell0 Sep 24 05:00:00.353080 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_db.sqlalchemy.engines [None req-172b72a8-90e0-4af9-a8c6-8d257f7da37e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120594) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 24 05:00:00.357726 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG dbcounter [-] [120594] Writer thread running {{(pid=120594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 24 05:00:00.659937 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: WARNING keystonemiddleware.auth_token [None req-f00e8b52-640c-40b5-8f89-822a6c88a306 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 24 05:00:00.667224 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: WARNING keystonemiddleware.auth_token [None req-f00e8b52-640c-40b5-8f89-822a6c88a306 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 24 05:00:00.679791 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: WARNING keystonemiddleware.auth_token [None req-172b72a8-90e0-4af9-a8c6-8d257f7da37e None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 24 05:00:00.688028 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: WARNING keystonemiddleware.auth_token [None req-172b72a8-90e0-4af9-a8c6-8d257f7da37e None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 24 05:00:01.016487 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: WARNING keystonemiddleware.auth_token [None req-f00e8b52-640c-40b5-8f89-822a6c88a306 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 24 05:00:01.023105 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: WARNING keystonemiddleware.auth_token [None req-f00e8b52-640c-40b5-8f89-822a6c88a306 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 24 05:00:01.028549 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55712acb69c0 pid: 120593 (default app) Sep 24 05:00:01.039765 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: WARNING keystonemiddleware.auth_token [None req-172b72a8-90e0-4af9-a8c6-8d257f7da37e None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 24 05:00:01.048648 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: WARNING keystonemiddleware.auth_token [None req-172b72a8-90e0-4af9-a8c6-8d257f7da37e None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 24 05:00:01.054057 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55712acb69c0 pid: 120594 (default app) Sep 24 05:00:36.716686 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG dbcounter [-] [120593] Writing DB stats nova_api:SELECT=3 {{(pid=120593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 05:00:36.723525 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG dbcounter [-] [120593] Writing DB stats nova_cell1:SELECT=3 {{(pid=120593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 05:00:36.724718 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG dbcounter [-] [120593] Writing DB stats nova_cell0:SELECT=3 {{(pid=120593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 05:00:36.727663 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG dbcounter [-] [120593] Writing DB stats nova_cell0:SELECT=3 {{(pid=120593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 05:00:38.354465 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-2d531319-9b66-4b43-8c2a-e0826acd5280 tempest-VolumesSnapshotsTestJSON-1584225543 tempest-VolumesSnapshotsTestJSON-1584225543-project] Action: 'create', calling method: .version_select at 0x7f79516e94c0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-80383331"}} {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 05:00:39.975644 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-2d531319-9b66-4b43-8c2a-e0826acd5280 tempest-VolumesSnapshotsTestJSON-1584225543 tempest-VolumesSnapshotsTestJSON-1584225543-project] 10.222.0.50 "POST /compute/v2.1/os-volumes" status: 200 len: 343 microversion: 2.1 time: 3.275618 Sep 24 05:00:39.976368 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 1/1] 10.222.0.50 () {60 vars in 1155 bytes} [Sat Sep 24 05:00:36 2022] POST /compute/v2.1/os-volumes => generated 343 bytes in 3278 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Sep 24 05:00:40.001298 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG dbcounter [-] [120594] Writing DB stats nova_api:SELECT=3 {{(pid=120594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 05:00:40.003397 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG dbcounter [-] [120594] Writing DB stats nova_cell0:SELECT=3 {{(pid=120594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 05:00:40.004984 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG dbcounter [-] [120594] Writing DB stats nova_cell1:SELECT=3 {{(pid=120594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 05:00:40.007451 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG dbcounter [-] [120594] Writing DB stats nova_cell0:SELECT=3 {{(pid=120594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 05:00:40.393017 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-d1102731-b68c-4543-a5a2-e08e4a60d860 tempest-VolumesSnapshotsTestJSON-1584225543 tempest-VolumesSnapshotsTestJSON-1584225543-project] Calling method '.version_select at 0x7f795179cf70>' {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:00:40.756593 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [None req-d1102731-b68c-4543-a5a2-e08e4a60d860 tempest-VolumesSnapshotsTestJSON-1584225543 tempest-VolumesSnapshotsTestJSON-1584225543-project] 10.222.0.50 "GET /compute/v2.1/os-volumes/db0ae3b4-2b1b-4d1a-9a06-c8bd268bf7c3" status: 200 len: 343 microversion: 2.1 time: 0.765192 Sep 24 05:00:40.757711 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 1/2] 10.222.0.50 () {58 vars in 1245 bytes} [Sat Sep 24 05:00:39 2022] GET /compute/v2.1/os-volumes/db0ae3b4-2b1b-4d1a-9a06-c8bd268bf7c3 => generated 343 bytes in 768 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 05:00:41.773760 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-be1135bb-09cd-4240-a85c-045c0edcde88 tempest-VolumesSnapshotsTestJSON-1584225543 tempest-VolumesSnapshotsTestJSON-1584225543-project] Calling method '.version_select at 0x7f79515bb3a0>' {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:00:41.945348 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-be1135bb-09cd-4240-a85c-045c0edcde88 tempest-VolumesSnapshotsTestJSON-1584225543 tempest-VolumesSnapshotsTestJSON-1584225543-project] 10.222.0.50 "GET /compute/v2.1/os-volumes/db0ae3b4-2b1b-4d1a-9a06-c8bd268bf7c3" status: 200 len: 344 microversion: 2.1 time: 0.177159 Sep 24 05:00:41.945921 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 2/3] 10.222.0.50 () {58 vars in 1245 bytes} [Sat Sep 24 05:00:41 2022] GET /compute/v2.1/os-volumes/db0ae3b4-2b1b-4d1a-9a06-c8bd268bf7c3 => generated 344 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 05:00:41.971451 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-0bf4b97f-b822-41bc-991d-f36a05b0f646 tempest-VolumesSnapshotsTestJSON-1584225543 tempest-VolumesSnapshotsTestJSON-1584225543-project] Action: 'create', calling method: .version_select at 0x7f79515a9280>, body: {"snapshot": {"volume_id": "db0ae3b4-2b1b-4d1a-9a06-c8bd268bf7c3", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-896425310"}} {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 05:00:42.594768 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [None req-0bf4b97f-b822-41bc-991d-f36a05b0f646 tempest-VolumesSnapshotsTestJSON-1584225543 tempest-VolumesSnapshotsTestJSON-1584225543-project] 10.222.0.50 "POST /compute/v2.1/os-snapshots" status: 200 len: 286 microversion: 2.1 time: 0.626914 Sep 24 05:00:42.595820 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 2/4] 10.222.0.50 () {60 vars in 1162 bytes} [Sat Sep 24 05:00:41 2022] POST /compute/v2.1/os-snapshots => generated 286 bytes in 639 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 05:00:42.609847 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-ddbe1bbb-5af9-469f-b614-a76288bd9894 tempest-VolumesSnapshotsTestJSON-1584225543 tempest-VolumesSnapshotsTestJSON-1584225543-project] Calling method '.version_select at 0x7f79515bba60>' {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:00:42.768762 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-ddbe1bbb-5af9-469f-b614-a76288bd9894 tempest-VolumesSnapshotsTestJSON-1584225543 tempest-VolumesSnapshotsTestJSON-1584225543-project] 10.222.0.50 "GET /compute/v2.1/os-snapshots/a9b372ec-73aa-4757-a4ae-07f976aec10f" status: 200 len: 286 microversion: 2.1 time: 0.165932 Sep 24 05:00:42.769246 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 3/5] 10.222.0.50 () {58 vars in 1251 bytes} [Sat Sep 24 05:00:42 2022] GET /compute/v2.1/os-snapshots/a9b372ec-73aa-4757-a4ae-07f976aec10f => generated 286 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 05:00:42.780957 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-542c37aa-332a-46c2-b736-beb43d210519 tempest-VolumesSnapshotsTestJSON-1584225543 tempest-VolumesSnapshotsTestJSON-1584225543-project] Calling method '.version_select at 0x7f79515c2160>' {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:00:42.878992 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [None req-542c37aa-332a-46c2-b736-beb43d210519 tempest-VolumesSnapshotsTestJSON-1584225543 tempest-VolumesSnapshotsTestJSON-1584225543-project] 10.222.0.50 "GET /compute/v2.1/os-snapshots" status: 200 len: 289 microversion: 2.1 time: 0.102428 Sep 24 05:00:42.880401 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 3/6] 10.222.0.50 () {58 vars in 1140 bytes} [Sat Sep 24 05:00:42 2022] GET /compute/v2.1/os-snapshots => generated 289 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 05:00:42.893343 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-90e89a5b-be0a-484f-bbf0-17b6f8a68c86 tempest-VolumesSnapshotsTestJSON-1584225543 tempest-VolumesSnapshotsTestJSON-1584225543-project] Calling method '.version_select at 0x7f79515531f0>' {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:00:42.962222 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-90e89a5b-be0a-484f-bbf0-17b6f8a68c86 tempest-VolumesSnapshotsTestJSON-1584225543 tempest-VolumesSnapshotsTestJSON-1584225543-project] 10.222.0.50 "GET /compute/v2.1/os-snapshots/a9b372ec-73aa-4757-a4ae-07f976aec10f" status: 200 len: 286 microversion: 2.1 time: 0.073845 Sep 24 05:00:42.963122 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 4/7] 10.222.0.50 () {58 vars in 1251 bytes} [Sat Sep 24 05:00:42 2022] GET /compute/v2.1/os-snapshots/a9b372ec-73aa-4757-a4ae-07f976aec10f => generated 286 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 05:00:43.975647 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-07a00268-56be-45ec-8c11-63876c348591 tempest-VolumesSnapshotsTestJSON-1584225543 tempest-VolumesSnapshotsTestJSON-1584225543-project] Calling method '.version_select at 0x7f79515c8550>' {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:00:44.102643 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [None req-07a00268-56be-45ec-8c11-63876c348591 tempest-VolumesSnapshotsTestJSON-1584225543 tempest-VolumesSnapshotsTestJSON-1584225543-project] 10.222.0.50 "GET /compute/v2.1/os-snapshots/a9b372ec-73aa-4757-a4ae-07f976aec10f" status: 200 len: 286 microversion: 2.1 time: 0.130991 Sep 24 05:00:44.103265 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 4/8] 10.222.0.50 () {58 vars in 1251 bytes} [Sat Sep 24 05:00:43 2022] GET /compute/v2.1/os-snapshots/a9b372ec-73aa-4757-a4ae-07f976aec10f => generated 286 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 05:00:45.116017 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-f81e9f84-c69e-43af-b4c4-8523fb6a64be tempest-VolumesSnapshotsTestJSON-1584225543 tempest-VolumesSnapshotsTestJSON-1584225543-project] Calling method '.version_select at 0x7f79515bbb80>' {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:00:45.221642 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-f81e9f84-c69e-43af-b4c4-8523fb6a64be tempest-VolumesSnapshotsTestJSON-1584225543 tempest-VolumesSnapshotsTestJSON-1584225543-project] 10.222.0.50 "GET /compute/v2.1/os-snapshots/a9b372ec-73aa-4757-a4ae-07f976aec10f" status: 200 len: 286 microversion: 2.1 time: 0.109319 Sep 24 05:00:45.222246 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 5/9] 10.222.0.50 () {58 vars in 1251 bytes} [Sat Sep 24 05:00:45 2022] GET /compute/v2.1/os-snapshots/a9b372ec-73aa-4757-a4ae-07f976aec10f => generated 286 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 05:00:46.234305 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-f3eee03a-d904-4e8c-8bc2-6f71fd0a98d0 tempest-VolumesSnapshotsTestJSON-1584225543 tempest-VolumesSnapshotsTestJSON-1584225543-project] Calling method '.version_select at 0x7f79515c2790>' {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:00:46.292686 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [None req-f3eee03a-d904-4e8c-8bc2-6f71fd0a98d0 tempest-VolumesSnapshotsTestJSON-1584225543 tempest-VolumesSnapshotsTestJSON-1584225543-project] 10.222.0.50 "GET /compute/v2.1/os-snapshots/a9b372ec-73aa-4757-a4ae-07f976aec10f" status: 200 len: 286 microversion: 2.1 time: 0.062158 Sep 24 05:00:46.293535 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 5/10] 10.222.0.50 () {58 vars in 1251 bytes} [Sat Sep 24 05:00:46 2022] GET /compute/v2.1/os-snapshots/a9b372ec-73aa-4757-a4ae-07f976aec10f => generated 286 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 05:00:47.307628 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-3113ecf1-1c00-4eda-8ee0-975e8f4b0ee8 tempest-VolumesSnapshotsTestJSON-1584225543 tempest-VolumesSnapshotsTestJSON-1584225543-project] Calling method '.version_select at 0x7f79515bb4c0>' {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:00:47.348211 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-3113ecf1-1c00-4eda-8ee0-975e8f4b0ee8 tempest-VolumesSnapshotsTestJSON-1584225543 tempest-VolumesSnapshotsTestJSON-1584225543-project] 10.222.0.50 "GET /compute/v2.1/os-snapshots/a9b372ec-73aa-4757-a4ae-07f976aec10f" status: 200 len: 286 microversion: 2.1 time: 0.045366 Sep 24 05:00:47.350876 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 6/11] 10.222.0.50 () {58 vars in 1251 bytes} [Sat Sep 24 05:00:47 2022] GET /compute/v2.1/os-snapshots/a9b372ec-73aa-4757-a4ae-07f976aec10f => generated 286 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 05:00:48.361478 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-05106cd1-8bbd-45a1-9f81-42fbd37ec785 tempest-VolumesSnapshotsTestJSON-1584225543 tempest-VolumesSnapshotsTestJSON-1584225543-project] Calling method '.version_select at 0x7f79515c2040>' {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:00:48.416392 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [None req-05106cd1-8bbd-45a1-9f81-42fbd37ec785 tempest-VolumesSnapshotsTestJSON-1584225543 tempest-VolumesSnapshotsTestJSON-1584225543-project] 10.222.0.50 "GET /compute/v2.1/os-snapshots/a9b372ec-73aa-4757-a4ae-07f976aec10f" status: 200 len: 287 microversion: 2.1 time: 0.059282 Sep 24 05:00:48.417145 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 6/12] 10.222.0.50 () {58 vars in 1251 bytes} [Sat Sep 24 05:00:48 2022] GET /compute/v2.1/os-snapshots/a9b372ec-73aa-4757-a4ae-07f976aec10f => generated 287 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 05:00:48.428575 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-1884a76f-43d1-4cf5-9463-9d7864dc0cc8 tempest-VolumesSnapshotsTestJSON-1584225543 tempest-VolumesSnapshotsTestJSON-1584225543-project] Calling method '.version_select at 0x7f7951553310>' {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:00:48.581142 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-1884a76f-43d1-4cf5-9463-9d7864dc0cc8 tempest-VolumesSnapshotsTestJSON-1584225543 tempest-VolumesSnapshotsTestJSON-1584225543-project] 10.222.0.50 "DELETE /compute/v2.1/os-snapshots/a9b372ec-73aa-4757-a4ae-07f976aec10f" status: 202 len: 0 microversion: 2.1 time: 0.156331 Sep 24 05:00:48.581989 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 7/13] 10.222.0.50 () {58 vars in 1254 bytes} [Sat Sep 24 05:00:48 2022] DELETE /compute/v2.1/os-snapshots/a9b372ec-73aa-4757-a4ae-07f976aec10f => generated 0 bytes in 158 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 24 05:00:48.592824 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-5569b19f-6c76-4eca-9d80-1f559e199b0d tempest-VolumesSnapshotsTestJSON-1584225543 tempest-VolumesSnapshotsTestJSON-1584225543-project] Calling method '.version_select at 0x7f79515a90d0>' {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:00:48.641103 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [None req-5569b19f-6c76-4eca-9d80-1f559e199b0d tempest-VolumesSnapshotsTestJSON-1584225543 tempest-VolumesSnapshotsTestJSON-1584225543-project] 10.222.0.50 "GET /compute/v2.1/os-snapshots/a9b372ec-73aa-4757-a4ae-07f976aec10f" status: 200 len: 286 microversion: 2.1 time: 0.054560 Sep 24 05:00:48.642257 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 7/14] 10.222.0.50 () {58 vars in 1251 bytes} [Sat Sep 24 05:00:48 2022] GET /compute/v2.1/os-snapshots/a9b372ec-73aa-4757-a4ae-07f976aec10f => generated 286 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 05:00:49.657288 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-f6d2cdd0-e310-4174-b107-b51eba8cb7d1 tempest-VolumesSnapshotsTestJSON-1584225543 tempest-VolumesSnapshotsTestJSON-1584225543-project] Calling method '.version_select at 0x7f79515c2a60>' {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:00:49.740854 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [None req-f6d2cdd0-e310-4174-b107-b51eba8cb7d1 tempest-VolumesSnapshotsTestJSON-1584225543 tempest-VolumesSnapshotsTestJSON-1584225543-project] 10.222.0.50 "GET /compute/v2.1/os-snapshots/a9b372ec-73aa-4757-a4ae-07f976aec10f" status: 200 len: 286 microversion: 2.1 time: 0.089416 Sep 24 05:00:49.746420 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 8/15] 10.222.0.50 () {58 vars in 1251 bytes} [Sat Sep 24 05:00:49 2022] GET /compute/v2.1/os-snapshots/a9b372ec-73aa-4757-a4ae-07f976aec10f => generated 286 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 05:00:49.863250 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-b812ea6a-b5dd-4064-8968-8b61b94d0778 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Action: 'create', calling method: .version_select at 0x7f7951f159d0>, body: {"keypair": {"name": "tempest-keypair-2031057050", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPHwt0zJJOjaYolfPNtQwcl3il3ghl7Vkl77GlfINoILBRvefFHUndhz6RXAvFZbghHJRfqn4KGoqm+LgMV2klExmmwQjFnjG567hxUyZen9/k+flDEo3M6dbtA/02sSGQ=="}} {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 05:00:50.002976 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.quota [None req-b812ea6a-b5dd-4064-8968-8b61b94d0778 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Getting quotas for project 66ec8bde739145dda504995dbea0914a. Resources: {'key_pairs'} {{(pid=120593) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 24 05:00:50.023859 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.quota [None req-b812ea6a-b5dd-4064-8968-8b61b94d0778 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Getting quotas for user 4b1b0448e7f54e3aaae49e411699269e and project 66ec8bde739145dda504995dbea0914a. Resources: {'key_pairs'} {{(pid=120593) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 24 05:00:50.138795 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-b812ea6a-b5dd-4064-8968-8b61b94d0778 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] 10.222.0.50 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.950241 Sep 24 05:00:50.140443 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 8/16] 10.222.0.50 () {60 vars in 1159 bytes} [Sat Sep 24 05:00:49 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 953 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 05:00:50.754928 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-dc1397fb-9d6d-45aa-9b0f-0b27d6e0369c tempest-VolumesSnapshotsTestJSON-1584225543 tempest-VolumesSnapshotsTestJSON-1584225543-project] Calling method '.version_select at 0x7f79515c2670>' {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:00:50.826361 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [None req-dc1397fb-9d6d-45aa-9b0f-0b27d6e0369c tempest-VolumesSnapshotsTestJSON-1584225543 tempest-VolumesSnapshotsTestJSON-1584225543-project] 10.222.0.50 "GET /compute/v2.1/os-snapshots/a9b372ec-73aa-4757-a4ae-07f976aec10f" status: 200 len: 286 microversion: 2.1 time: 0.075313 Sep 24 05:00:50.845679 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 9/17] 10.222.0.50 () {58 vars in 1251 bytes} [Sat Sep 24 05:00:50 2022] GET /compute/v2.1/os-snapshots/a9b372ec-73aa-4757-a4ae-07f976aec10f => generated 286 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 05:00:51.372863 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-6d7a33a8-42c1-492b-8049-3c321e01414f tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Action: 'create', calling method: .version_select at 0x7f79515440d0>, body: {"keypair": {"name": "tempest-keypair-367803558", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBInJfreq61PwIIngHon9I6ToFTjqn05X9y854v4AXJDoYbFzRIYgDSg1KdQLzvh1wGzmVIAFp3gNHvZqsns/53gKgVMEGUV5sMWC3o/kwAG733x7Qr2I5O4W3bsZK9buyw=="}} {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 05:00:51.410910 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.quota [None req-6d7a33a8-42c1-492b-8049-3c321e01414f tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Getting quotas for project c1aaf20f480a423ea5feca81585aeeed. Resources: {'key_pairs'} {{(pid=120593) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 24 05:00:51.420401 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.quota [None req-6d7a33a8-42c1-492b-8049-3c321e01414f tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Getting quotas for user 0948754217fc4ff2ba0241fa35feaf90 and project c1aaf20f480a423ea5feca81585aeeed. Resources: {'key_pairs'} {{(pid=120593) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 24 05:00:51.476450 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-6d7a33a8-42c1-492b-8049-3c321e01414f tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] 10.222.0.50 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.20 time: 0.336316 Sep 24 05:00:51.477409 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 9/18] 10.222.0.50 () {62 vars in 1200 bytes} [Sat Sep 24 05:00:51 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 338 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Sep 24 05:00:51.854975 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-1ee62dd9-c743-4812-881b-deecac88f74f tempest-VolumesSnapshotsTestJSON-1584225543 tempest-VolumesSnapshotsTestJSON-1584225543-project] Calling method '.version_select at 0x7f79515a9160>' {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:00:51.905438 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [None req-1ee62dd9-c743-4812-881b-deecac88f74f tempest-VolumesSnapshotsTestJSON-1584225543 tempest-VolumesSnapshotsTestJSON-1584225543-project] 10.222.0.50 "GET /compute/v2.1/os-snapshots/a9b372ec-73aa-4757-a4ae-07f976aec10f" status: 200 len: 286 microversion: 2.1 time: 0.055196 Sep 24 05:00:51.912210 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 10/19] 10.222.0.50 () {58 vars in 1251 bytes} [Sat Sep 24 05:00:51 2022] GET /compute/v2.1/os-snapshots/a9b372ec-73aa-4757-a4ae-07f976aec10f => generated 286 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 05:00:52.049379 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-f14c34b9-06a0-40a1-8211-8680daf4b93a tempest-DeleteServersTestJSON-1630660203 tempest-DeleteServersTestJSON-1630660203-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1317046763", "imageRef": "75ab730a-d8cc-4ea2-b58f-0f3eb476c976", "flavorRef": "452", "networks": [{"uuid": "0eef3b9c-c86e-4192-9c47-1e3382392851"}]}} {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 05:00:52.242080 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.network.neutron [None req-f14c34b9-06a0-40a1-8211-8680daf4b93a tempest-DeleteServersTestJSON-1630660203 tempest-DeleteServersTestJSON-1630660203-project] validate_networks() for [('0eef3b9c-c86e-4192-9c47-1e3382392851', None, None, None, None, None)] {{(pid=120593) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 24 05:00:52.919531 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-970aa69f-7f8d-4d95-943c-2f9a894f4817 tempest-VolumesSnapshotsTestJSON-1584225543 tempest-VolumesSnapshotsTestJSON-1584225543-project] Calling method '.version_select at 0x7f79515a99d0>' {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:00:52.991160 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [None req-970aa69f-7f8d-4d95-943c-2f9a894f4817 tempest-VolumesSnapshotsTestJSON-1584225543 tempest-VolumesSnapshotsTestJSON-1584225543-project] 10.222.0.50 "GET /compute/v2.1/os-snapshots/a9b372ec-73aa-4757-a4ae-07f976aec10f" status: 200 len: 286 microversion: 2.1 time: 0.075818 Sep 24 05:00:52.992436 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 11/20] 10.222.0.50 () {58 vars in 1251 bytes} [Sat Sep 24 05:00:52 2022] GET /compute/v2.1/os-snapshots/a9b372ec-73aa-4757-a4ae-07f976aec10f => generated 286 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 05:00:54.004792 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-f6da9ce2-3d9c-4291-a86b-28b79014054e tempest-VolumesSnapshotsTestJSON-1584225543 tempest-VolumesSnapshotsTestJSON-1584225543-project] Calling method '.version_select at 0x7f79515c28b0>' {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:00:54.046773 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: INFO nova.api.openstack.wsgi [None req-f6da9ce2-3d9c-4291-a86b-28b79014054e tempest-VolumesSnapshotsTestJSON-1584225543 tempest-VolumesSnapshotsTestJSON-1584225543-project] HTTP exception thrown: Snapshot a9b372ec-73aa-4757-a4ae-07f976aec10f could not be found. Sep 24 05:00:54.054462 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-f6da9ce2-3d9c-4291-a86b-28b79014054e tempest-VolumesSnapshotsTestJSON-1584225543 tempest-VolumesSnapshotsTestJSON-1584225543-project] Request method failure captured: Sep 24 05:00:54.054462 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: request: GET /compute/v2.1/os-snapshots/a9b372ec-73aa-4757-a4ae-07f976aec10f HTTP/1.1 Sep 24 05:00:54.054462 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: Accept: application/json Sep 24 05:00:54.054462 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: Accept-Encoding: identity Sep 24 05:00:54.054462 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: Connection: close Sep 24 05:00:54.054462 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: Content-Length: 0 Sep 24 05:00:54.054462 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: Content-Type: application/json Sep 24 05:00:54.054462 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: Host: 10.222.0.50 Sep 24 05:00:54.054462 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: Openstack-System-Scope: None Sep 24 05:00:54.054462 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: User-Agent: python-urllib3/1.26.12 Sep 24 05:00:54.054462 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: X-Auth-Token: gAAAAABjLo706n9gxWGtDhJt3gPCTNi-_oNGH-cBNfc3D0X0VnAdgKmvnLIpzEJNN17fdfxcfkjJcwVX5UAx06dMnF66wBp2Y9ioyatYP2S2HufHY8ir27ijZ6cXr7qdTmW0Zm3spww9nmPvA8PLSaO4fIRbSQ3-EXwjy2InWsJm_NpzckNuLig Sep 24 05:00:54.054462 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: X-Domain-Id: None Sep 24 05:00:54.054462 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: X-Domain-Name: None Sep 24 05:00:54.054462 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: X-Identity-Status: Confirmed Sep 24 05:00:54.054462 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: X-Is-Admin-Project: True Sep 24 05:00:54.054462 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: X-Project-Domain-Id: default Sep 24 05:00:54.054462 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: X-Project-Domain-Name: Default Sep 24 05:00:54.054462 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: X-Project-Id: c8eb924c6ccf498e86777543349f2cf9 Sep 24 05:00:54.054462 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1584225543 Sep 24 05:00:54.054462 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: X-Role: member,reader Sep 24 05:00:54.054462 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: X-Roles: member,reader Sep 24 05:00:54.055603 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/c8eb924c6ccf498e86777543349f2cf9"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/c8eb924c6ccf498e86777543349f2cf9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/c8eb924c6ccf498e86777543349f2cf9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.50:8080", "publicURL": "http://10.222.0.50:8080/v1/AUTH_c8eb924c6ccf498e86777543349f2cf9"}]}] Sep 24 05:00:54.055603 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1584225543 Sep 24 05:00:54.055603 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: X-Tenant-Id: c8eb924c6ccf498e86777543349f2cf9 Sep 24 05:00:54.055603 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1584225543 Sep 24 05:00:54.055603 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: X-User: tempest-VolumesSnapshotsTestJSON-1584225543-project Sep 24 05:00:54.055603 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: X-User-Domain-Id: default Sep 24 05:00:54.055603 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: X-User-Domain-Name: Default Sep 24 05:00:54.055603 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: X-User-Id: 701e9898649546818ca5eef88e24041a Sep 24 05:00:54.055603 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1584225543-project Sep 24 05:00:54.055603 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: method: Sep 24 05:00:54.055603 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: exception: Snapshot a9b372ec-73aa-4757-a4ae-07f976aec10f could not be found. Sep 24 05:00:54.055603 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: action_args: {'id': 'a9b372ec-73aa-4757-a4ae-07f976aec10f'} Sep 24 05:00:54.055603 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 24 05:00:54.056360 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 05:00:54.056360 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Sep 24 05:00:54.056360 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Sep 24 05:00:54.056360 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Sep 24 05:00:54.056360 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Sep 24 05:00:54.056360 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Sep 24 05:00:54.056360 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Sep 24 05:00:54.056360 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 24 05:00:54.056360 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 24 05:00:54.056360 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 24 05:00:54.056360 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 24 05:00:54.056360 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 24 05:00:54.056360 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 24 05:00:54.056360 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 24 05:00:54.056360 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 24 05:00:54.056360 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot a9b372ec-73aa-4757-a4ae-07f976aec10f could not be found. (HTTP 404) (Request-ID: req-245b43c2-837c-4f40-a858-d5ff9317a2ab) Sep 24 05:00:54.056360 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi Sep 24 05:00:54.056360 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 05:00:54.057480 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi Sep 24 05:00:54.057480 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 05:00:54.057480 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show Sep 24 05:00:54.057480 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) Sep 24 05:00:54.057480 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 24 05:00:54.057480 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 24 05:00:54.057480 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper Sep 24 05:00:54.057480 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) Sep 24 05:00:54.057480 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 24 05:00:54.057480 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 24 05:00:54.057480 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Sep 24 05:00:54.057480 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Sep 24 05:00:54.057480 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Sep 24 05:00:54.057480 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Sep 24 05:00:54.057480 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Sep 24 05:00:54.057480 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Sep 24 05:00:54.057480 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 24 05:00:54.057480 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 24 05:00:54.057480 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 24 05:00:54.058566 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 24 05:00:54.058566 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 24 05:00:54.058566 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 24 05:00:54.058566 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 24 05:00:54.058566 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 24 05:00:54.058566 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot a9b372ec-73aa-4757-a4ae-07f976aec10f could not be found. Sep 24 05:00:54.058566 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi Sep 24 05:00:54.058566 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 05:00:54.058566 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi Sep 24 05:00:54.058566 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 05:00:54.058566 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 05:00:54.058566 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 05:00:54.058566 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 24 05:00:54.058566 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 24 05:00:54.058566 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 24 05:00:54.058566 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 24 05:00:54.058566 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 24 05:00:54.058566 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 24 05:00:54.058566 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show Sep 24 05:00:54.058566 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 24 05:00:54.059613 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot a9b372ec-73aa-4757-a4ae-07f976aec10f could not be found. Sep 24 05:00:54.059613 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi Sep 24 05:00:54.059613 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 05:00:54.059613 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi Sep 24 05:00:54.059613 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 05:00:54.059613 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 05:00:54.059613 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 05:00:54.059613 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 24 05:00:54.059613 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 24 05:00:54.059613 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot a9b372ec-73aa-4757-a4ae-07f976aec10f could not be found. Sep 24 05:00:54.059613 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi Sep 24 05:00:54.059613 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-f6da9ce2-3d9c-4291-a86b-28b79014054e tempest-VolumesSnapshotsTestJSON-1584225543 tempest-VolumesSnapshotsTestJSON-1584225543-project] Returning 404 to user: Snapshot a9b372ec-73aa-4757-a4ae-07f976aec10f could not be found. {{(pid=120594) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 24 05:00:54.059613 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [None req-f6da9ce2-3d9c-4291-a86b-28b79014054e tempest-VolumesSnapshotsTestJSON-1584225543 tempest-VolumesSnapshotsTestJSON-1584225543-project] 10.222.0.50 "GET /compute/v2.1/os-snapshots/a9b372ec-73aa-4757-a4ae-07f976aec10f" status: 404 len: 111 microversion: 2.1 time: 0.055494 Sep 24 05:00:54.060257 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 12/21] 10.222.0.50 () {58 vars in 1251 bytes} [Sat Sep 24 05:00:53 2022] GET /compute/v2.1/os-snapshots/a9b372ec-73aa-4757-a4ae-07f976aec10f => generated 111 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 24 05:00:54.071670 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-3180c63a-bf5d-486a-8ead-5e11b441256f tempest-VolumesSnapshotsTestJSON-1584225543 tempest-VolumesSnapshotsTestJSON-1584225543-project] Calling method '.version_select at 0x7f7951f158b0>' {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:00:54.254920 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [None req-3180c63a-bf5d-486a-8ead-5e11b441256f tempest-VolumesSnapshotsTestJSON-1584225543 tempest-VolumesSnapshotsTestJSON-1584225543-project] 10.222.0.50 "DELETE /compute/v2.1/os-volumes/db0ae3b4-2b1b-4d1a-9a06-c8bd268bf7c3" status: 202 len: 0 microversion: 2.1 time: 0.192136 Sep 24 05:00:54.255735 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 13/22] 10.222.0.50 () {58 vars in 1248 bytes} [Sat Sep 24 05:00:54 2022] DELETE /compute/v2.1/os-volumes/db0ae3b4-2b1b-4d1a-9a06-c8bd268bf7c3 => generated 0 bytes in 194 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 24 05:00:54.264228 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-50021946-9042-40a9-9beb-844c4ad65ddc tempest-VolumesSnapshotsTestJSON-1584225543 tempest-VolumesSnapshotsTestJSON-1584225543-project] Calling method '.version_select at 0x7f79515c29d0>' {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:00:54.431726 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [None req-50021946-9042-40a9-9beb-844c4ad65ddc tempest-VolumesSnapshotsTestJSON-1584225543 tempest-VolumesSnapshotsTestJSON-1584225543-project] 10.222.0.50 "GET /compute/v2.1/os-volumes/db0ae3b4-2b1b-4d1a-9a06-c8bd268bf7c3" status: 200 len: 343 microversion: 2.1 time: 0.171303 Sep 24 05:00:54.433449 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 14/23] 10.222.0.50 () {58 vars in 1245 bytes} [Sat Sep 24 05:00:54 2022] GET /compute/v2.1/os-volumes/db0ae3b4-2b1b-4d1a-9a06-c8bd268bf7c3 => generated 343 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 24 05:00:55.159588 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.virt.hardware [None req-f14c34b9-06a0-40a1-8211-8680daf4b93a tempest-DeleteServersTestJSON-1630660203 tempest-DeleteServersTestJSON-1630660203-project] Flavor limits 0:0:0 {{(pid=120593) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 24 05:00:55.160696 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.virt.hardware [None req-f14c34b9-06a0-40a1-8211-8680daf4b93a tempest-DeleteServersTestJSON-1630660203 tempest-DeleteServersTestJSON-1630660203-project] Image limits 0:0:0 {{(pid=120593) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 24 05:00:55.161791 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.virt.hardware [None req-f14c34b9-06a0-40a1-8211-8680daf4b93a tempest-DeleteServersTestJSON-1630660203 tempest-DeleteServersTestJSON-1630660203-project] Flavor pref 0:0:0 {{(pid=120593) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 24 05:00:55.163256 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.virt.hardware [None req-f14c34b9-06a0-40a1-8211-8680daf4b93a tempest-DeleteServersTestJSON-1630660203 tempest-DeleteServersTestJSON-1630660203-project] Image pref 0:0:0 {{(pid=120593) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 24 05:00:55.164078 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.virt.hardware [None req-f14c34b9-06a0-40a1-8211-8680daf4b93a tempest-DeleteServersTestJSON-1630660203 tempest-DeleteServersTestJSON-1630660203-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120593) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 24 05:00:55.209819 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-f14c34b9-06a0-40a1-8211-8680daf4b93a tempest-DeleteServersTestJSON-1630660203 tempest-DeleteServersTestJSON-1630660203-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:00:55.210959 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-f14c34b9-06a0-40a1-8211-8680daf4b93a tempest-DeleteServersTestJSON-1630660203 tempest-DeleteServersTestJSON-1630660203-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:00:55.212556 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-f14c34b9-06a0-40a1-8211-8680daf4b93a tempest-DeleteServersTestJSON-1630660203 tempest-DeleteServersTestJSON-1630660203-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:00:55.213488 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-f14c34b9-06a0-40a1-8211-8680daf4b93a tempest-DeleteServersTestJSON-1630660203 tempest-DeleteServersTestJSON-1630660203-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:00:55.215094 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-f14c34b9-06a0-40a1-8211-8680daf4b93a tempest-DeleteServersTestJSON-1630660203 tempest-DeleteServersTestJSON-1630660203-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:00:55.217323 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-f14c34b9-06a0-40a1-8211-8680daf4b93a tempest-DeleteServersTestJSON-1630660203 tempest-DeleteServersTestJSON-1630660203-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:00:55.333354 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.quota [None req-f14c34b9-06a0-40a1-8211-8680daf4b93a tempest-DeleteServersTestJSON-1630660203 tempest-DeleteServersTestJSON-1630660203-project] Getting quotas for project aa84dfa1cc764dc99b6e804e778c3479. Resources: {'instances', 'ram', 'cores'} {{(pid=120593) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 24 05:00:55.342927 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.quota [None req-f14c34b9-06a0-40a1-8211-8680daf4b93a tempest-DeleteServersTestJSON-1630660203 tempest-DeleteServersTestJSON-1630660203-project] Getting quotas for user 27d1a24c9e15493195744bcbf598ac4a and project aa84dfa1cc764dc99b6e804e778c3479. Resources: {'instances', 'ram', 'cores'} {{(pid=120593) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 24 05:00:55.388187 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.compute.api [None req-f14c34b9-06a0-40a1-8211-8680daf4b93a tempest-DeleteServersTestJSON-1630660203 tempest-DeleteServersTestJSON-1630660203-project] Going to run 1 instances... {{(pid=120593) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 24 05:00:55.404341 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.compute.api [None req-f14c34b9-06a0-40a1-8211-8680daf4b93a tempest-DeleteServersTestJSON-1630660203 tempest-DeleteServersTestJSON-1630660203-project] [instance: ec88b440-40a0-459f-b94b-06c332e86094] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='75ab730a-d8cc-4ea2-b58f-0f3eb476c976',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120593) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 24 05:00:55.448234 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-e86dbb03-6aef-4a49-80d2-e21dadd53fb1 tempest-VolumesSnapshotsTestJSON-1584225543 tempest-VolumesSnapshotsTestJSON-1584225543-project] Calling method '.version_select at 0x7f795152c4c0>' {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:00:55.528388 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: INFO nova.api.openstack.wsgi [None req-e86dbb03-6aef-4a49-80d2-e21dadd53fb1 tempest-VolumesSnapshotsTestJSON-1584225543 tempest-VolumesSnapshotsTestJSON-1584225543-project] HTTP exception thrown: Volume db0ae3b4-2b1b-4d1a-9a06-c8bd268bf7c3 could not be found. Sep 24 05:00:55.531223 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-e86dbb03-6aef-4a49-80d2-e21dadd53fb1 tempest-VolumesSnapshotsTestJSON-1584225543 tempest-VolumesSnapshotsTestJSON-1584225543-project] Request method failure captured: Sep 24 05:00:55.531223 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: request: GET /compute/v2.1/os-volumes/db0ae3b4-2b1b-4d1a-9a06-c8bd268bf7c3 HTTP/1.1 Sep 24 05:00:55.531223 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: Accept: application/json Sep 24 05:00:55.531223 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: Accept-Encoding: identity Sep 24 05:00:55.531223 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: Connection: close Sep 24 05:00:55.531223 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: Content-Length: 0 Sep 24 05:00:55.531223 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: Content-Type: application/json Sep 24 05:00:55.531223 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: Host: 10.222.0.50 Sep 24 05:00:55.531223 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: Openstack-System-Scope: None Sep 24 05:00:55.531223 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: User-Agent: python-urllib3/1.26.12 Sep 24 05:00:55.531223 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: X-Auth-Token: gAAAAABjLo706n9gxWGtDhJt3gPCTNi-_oNGH-cBNfc3D0X0VnAdgKmvnLIpzEJNN17fdfxcfkjJcwVX5UAx06dMnF66wBp2Y9ioyatYP2S2HufHY8ir27ijZ6cXr7qdTmW0Zm3spww9nmPvA8PLSaO4fIRbSQ3-EXwjy2InWsJm_NpzckNuLig Sep 24 05:00:55.531223 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: X-Domain-Id: None Sep 24 05:00:55.531223 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: X-Domain-Name: None Sep 24 05:00:55.531223 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: X-Identity-Status: Confirmed Sep 24 05:00:55.531223 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: X-Is-Admin-Project: True Sep 24 05:00:55.531223 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: X-Project-Domain-Id: default Sep 24 05:00:55.531223 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: X-Project-Domain-Name: Default Sep 24 05:00:55.531223 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: X-Project-Id: c8eb924c6ccf498e86777543349f2cf9 Sep 24 05:00:55.531223 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1584225543 Sep 24 05:00:55.531223 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: X-Role: member,reader Sep 24 05:00:55.531223 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: X-Roles: member,reader Sep 24 05:00:55.532468 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/c8eb924c6ccf498e86777543349f2cf9"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/c8eb924c6ccf498e86777543349f2cf9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/c8eb924c6ccf498e86777543349f2cf9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.50:8080", "publicURL": "http://10.222.0.50:8080/v1/AUTH_c8eb924c6ccf498e86777543349f2cf9"}]}] Sep 24 05:00:55.532468 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1584225543 Sep 24 05:00:55.532468 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: X-Tenant-Id: c8eb924c6ccf498e86777543349f2cf9 Sep 24 05:00:55.532468 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1584225543 Sep 24 05:00:55.532468 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: X-User: tempest-VolumesSnapshotsTestJSON-1584225543-project Sep 24 05:00:55.532468 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: X-User-Domain-Id: default Sep 24 05:00:55.532468 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: X-User-Domain-Name: Default Sep 24 05:00:55.532468 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: X-User-Id: 701e9898649546818ca5eef88e24041a Sep 24 05:00:55.532468 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1584225543-project Sep 24 05:00:55.532468 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: method: Sep 24 05:00:55.532468 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: exception: Volume db0ae3b4-2b1b-4d1a-9a06-c8bd268bf7c3 could not be found. Sep 24 05:00:55.532468 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: action_args: {'id': 'db0ae3b4-2b1b-4d1a-9a06-c8bd268bf7c3'} Sep 24 05:00:55.532468 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 24 05:00:55.533270 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 05:00:55.533270 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 24 05:00:55.533270 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 24 05:00:55.533270 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 24 05:00:55.533270 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 24 05:00:55.533270 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 24 05:00:55.533270 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 24 05:00:55.533270 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 24 05:00:55.533270 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 24 05:00:55.533270 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 24 05:00:55.533270 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 24 05:00:55.533270 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 24 05:00:55.533270 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 24 05:00:55.533270 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 24 05:00:55.533270 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 24 05:00:55.533270 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume db0ae3b4-2b1b-4d1a-9a06-c8bd268bf7c3 could not be found. (HTTP 404) (Request-ID: req-30a99cd4-694a-4347-ae1d-3d56a5b12327) Sep 24 05:00:55.533270 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi Sep 24 05:00:55.533270 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 05:00:55.533270 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi Sep 24 05:00:55.534439 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 05:00:55.534439 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Sep 24 05:00:55.534439 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Sep 24 05:00:55.534439 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 24 05:00:55.534439 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 24 05:00:55.534439 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 24 05:00:55.534439 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 24 05:00:55.534439 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 24 05:00:55.534439 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 24 05:00:55.534439 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 24 05:00:55.534439 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 24 05:00:55.534439 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 24 05:00:55.534439 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 24 05:00:55.534439 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 24 05:00:55.534439 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 24 05:00:55.534439 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 24 05:00:55.534439 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 24 05:00:55.534439 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 24 05:00:55.534439 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 24 05:00:55.535634 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 24 05:00:55.535634 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 24 05:00:55.535634 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 24 05:00:55.535634 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 24 05:00:55.535634 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume db0ae3b4-2b1b-4d1a-9a06-c8bd268bf7c3 could not be found. Sep 24 05:00:55.535634 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi Sep 24 05:00:55.535634 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 05:00:55.535634 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi Sep 24 05:00:55.535634 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 05:00:55.535634 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 05:00:55.535634 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 05:00:55.535634 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 24 05:00:55.535634 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 24 05:00:55.535634 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 24 05:00:55.535634 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 24 05:00:55.535634 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 24 05:00:55.535634 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 24 05:00:55.535634 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Sep 24 05:00:55.535634 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 24 05:00:55.536669 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume db0ae3b4-2b1b-4d1a-9a06-c8bd268bf7c3 could not be found. Sep 24 05:00:55.536669 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi Sep 24 05:00:55.536669 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 05:00:55.536669 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi Sep 24 05:00:55.536669 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 05:00:55.536669 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 05:00:55.536669 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 05:00:55.536669 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 24 05:00:55.536669 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 24 05:00:55.536669 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume db0ae3b4-2b1b-4d1a-9a06-c8bd268bf7c3 could not be found. Sep 24 05:00:55.536669 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi Sep 24 05:00:55.540607 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-e86dbb03-6aef-4a49-80d2-e21dadd53fb1 tempest-VolumesSnapshotsTestJSON-1584225543 tempest-VolumesSnapshotsTestJSON-1584225543-project] Returning 404 to user: Volume db0ae3b4-2b1b-4d1a-9a06-c8bd268bf7c3 could not be found. {{(pid=120594) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 24 05:00:55.542282 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [None req-e86dbb03-6aef-4a49-80d2-e21dadd53fb1 tempest-VolumesSnapshotsTestJSON-1584225543 tempest-VolumesSnapshotsTestJSON-1584225543-project] 10.222.0.50 "GET /compute/v2.1/os-volumes/db0ae3b4-2b1b-4d1a-9a06-c8bd268bf7c3" status: 404 len: 109 microversion: 2.1 time: 0.098173 Sep 24 05:00:55.543530 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 15/24] 10.222.0.50 () {58 vars in 1245 bytes} [Sat Sep 24 05:00:55 2022] GET /compute/v2.1/os-volumes/db0ae3b4-2b1b-4d1a-9a06-c8bd268bf7c3 => generated 109 bytes in 100 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 24 05:00:55.554245 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-1336047c-b16c-4491-acea-9639914fef86 tempest-VolumesSnapshotsTestJSON-1584225543 tempest-VolumesSnapshotsTestJSON-1584225543-project] Calling method '.version_select at 0x7f79515c2c10>' {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:00:55.621288 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-f14c34b9-06a0-40a1-8211-8680daf4b93a tempest-DeleteServersTestJSON-1630660203 tempest-DeleteServersTestJSON-1630660203-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.642642 Sep 24 05:00:55.624692 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 10/25] 10.222.0.50 () {60 vars in 1147 bytes} [Sat Sep 24 05:00:51 2022] POST /compute/v2.1/servers => generated 380 bytes in 3647 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Sep 24 05:00:55.636304 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: INFO nova.api.openstack.wsgi [None req-1336047c-b16c-4491-acea-9639914fef86 tempest-VolumesSnapshotsTestJSON-1584225543 tempest-VolumesSnapshotsTestJSON-1584225543-project] HTTP exception thrown: Volume db0ae3b4-2b1b-4d1a-9a06-c8bd268bf7c3 could not be found. Sep 24 05:00:55.639165 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-1336047c-b16c-4491-acea-9639914fef86 tempest-VolumesSnapshotsTestJSON-1584225543 tempest-VolumesSnapshotsTestJSON-1584225543-project] Request method failure captured: Sep 24 05:00:55.639165 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: request: DELETE /compute/v2.1/os-volumes/db0ae3b4-2b1b-4d1a-9a06-c8bd268bf7c3 HTTP/1.1 Sep 24 05:00:55.639165 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: Accept: application/json Sep 24 05:00:55.639165 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: Accept-Encoding: identity Sep 24 05:00:55.639165 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: Connection: close Sep 24 05:00:55.639165 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: Content-Length: 0 Sep 24 05:00:55.639165 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: Content-Type: application/json Sep 24 05:00:55.639165 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: Host: 10.222.0.50 Sep 24 05:00:55.639165 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: Openstack-System-Scope: None Sep 24 05:00:55.639165 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: User-Agent: python-urllib3/1.26.12 Sep 24 05:00:55.639165 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: X-Auth-Token: gAAAAABjLo706n9gxWGtDhJt3gPCTNi-_oNGH-cBNfc3D0X0VnAdgKmvnLIpzEJNN17fdfxcfkjJcwVX5UAx06dMnF66wBp2Y9ioyatYP2S2HufHY8ir27ijZ6cXr7qdTmW0Zm3spww9nmPvA8PLSaO4fIRbSQ3-EXwjy2InWsJm_NpzckNuLig Sep 24 05:00:55.639165 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: X-Domain-Id: None Sep 24 05:00:55.639165 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: X-Domain-Name: None Sep 24 05:00:55.639165 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: X-Identity-Status: Confirmed Sep 24 05:00:55.639165 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: X-Is-Admin-Project: True Sep 24 05:00:55.639165 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: X-Project-Domain-Id: default Sep 24 05:00:55.639165 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: X-Project-Domain-Name: Default Sep 24 05:00:55.639165 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: X-Project-Id: c8eb924c6ccf498e86777543349f2cf9 Sep 24 05:00:55.639165 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1584225543 Sep 24 05:00:55.639165 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: X-Role: member,reader Sep 24 05:00:55.639165 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: X-Roles: member,reader Sep 24 05:00:55.640347 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/c8eb924c6ccf498e86777543349f2cf9"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/c8eb924c6ccf498e86777543349f2cf9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/c8eb924c6ccf498e86777543349f2cf9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.50:8080", "publicURL": "http://10.222.0.50:8080/v1/AUTH_c8eb924c6ccf498e86777543349f2cf9"}]}] Sep 24 05:00:55.640347 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1584225543 Sep 24 05:00:55.640347 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: X-Tenant-Id: c8eb924c6ccf498e86777543349f2cf9 Sep 24 05:00:55.640347 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1584225543 Sep 24 05:00:55.640347 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: X-User: tempest-VolumesSnapshotsTestJSON-1584225543-project Sep 24 05:00:55.640347 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: X-User-Domain-Id: default Sep 24 05:00:55.640347 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: X-User-Domain-Name: Default Sep 24 05:00:55.640347 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: X-User-Id: 701e9898649546818ca5eef88e24041a Sep 24 05:00:55.640347 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1584225543-project Sep 24 05:00:55.640347 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: method: Sep 24 05:00:55.640347 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: exception: Volume db0ae3b4-2b1b-4d1a-9a06-c8bd268bf7c3 could not be found. Sep 24 05:00:55.640347 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: action_args: {'id': 'db0ae3b4-2b1b-4d1a-9a06-c8bd268bf7c3'} Sep 24 05:00:55.640347 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 24 05:00:55.641743 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 05:00:55.641743 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 24 05:00:55.641743 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 24 05:00:55.641743 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Sep 24 05:00:55.641743 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Sep 24 05:00:55.641743 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Sep 24 05:00:55.641743 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi return self._delete(loc) Sep 24 05:00:55.641743 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Sep 24 05:00:55.641743 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Sep 24 05:00:55.641743 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Sep 24 05:00:55.641743 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Sep 24 05:00:55.641743 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 24 05:00:55.641743 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 24 05:00:55.641743 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 24 05:00:55.641743 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 24 05:00:55.641743 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume db0ae3b4-2b1b-4d1a-9a06-c8bd268bf7c3 could not be found. (HTTP 404) (Request-ID: req-bf2b17cf-a690-4168-a75a-cabf6c33379a) Sep 24 05:00:55.641743 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi Sep 24 05:00:55.641743 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 05:00:55.641743 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi Sep 24 05:00:55.643058 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 05:00:55.643058 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Sep 24 05:00:55.643058 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Sep 24 05:00:55.643058 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 24 05:00:55.643058 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 24 05:00:55.643058 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 24 05:00:55.643058 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 24 05:00:55.643058 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 24 05:00:55.643058 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 24 05:00:55.643058 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 24 05:00:55.643058 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 24 05:00:55.643058 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Sep 24 05:00:55.643058 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Sep 24 05:00:55.643058 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Sep 24 05:00:55.643058 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi return self._delete(loc) Sep 24 05:00:55.643058 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Sep 24 05:00:55.643058 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Sep 24 05:00:55.643058 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Sep 24 05:00:55.643058 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Sep 24 05:00:55.643987 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 24 05:00:55.643987 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 24 05:00:55.643987 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 24 05:00:55.643987 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 24 05:00:55.643987 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume db0ae3b4-2b1b-4d1a-9a06-c8bd268bf7c3 could not be found. Sep 24 05:00:55.643987 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi Sep 24 05:00:55.643987 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 05:00:55.643987 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi Sep 24 05:00:55.643987 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 05:00:55.643987 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 05:00:55.643987 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 05:00:55.643987 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 24 05:00:55.643987 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 24 05:00:55.643987 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 24 05:00:55.643987 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 24 05:00:55.643987 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 24 05:00:55.643987 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 24 05:00:55.643987 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Sep 24 05:00:55.643987 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 24 05:00:55.644906 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume db0ae3b4-2b1b-4d1a-9a06-c8bd268bf7c3 could not be found. Sep 24 05:00:55.644906 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi Sep 24 05:00:55.644906 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 05:00:55.644906 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi Sep 24 05:00:55.644906 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 05:00:55.644906 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 05:00:55.644906 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 05:00:55.644906 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 24 05:00:55.644906 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 24 05:00:55.644906 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume db0ae3b4-2b1b-4d1a-9a06-c8bd268bf7c3 could not be found. Sep 24 05:00:55.644906 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi Sep 24 05:00:55.644906 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-1336047c-b16c-4491-acea-9639914fef86 tempest-VolumesSnapshotsTestJSON-1584225543 tempest-VolumesSnapshotsTestJSON-1584225543-project] Returning 404 to user: Volume db0ae3b4-2b1b-4d1a-9a06-c8bd268bf7c3 could not be found. {{(pid=120594) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 24 05:00:55.644906 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [None req-1336047c-b16c-4491-acea-9639914fef86 tempest-VolumesSnapshotsTestJSON-1584225543 tempest-VolumesSnapshotsTestJSON-1584225543-project] 10.222.0.50 "DELETE /compute/v2.1/os-volumes/db0ae3b4-2b1b-4d1a-9a06-c8bd268bf7c3" status: 404 len: 109 microversion: 2.1 time: 0.091746 Sep 24 05:00:55.644906 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 16/26] 10.222.0.50 () {58 vars in 1248 bytes} [Sat Sep 24 05:00:55 2022] DELETE /compute/v2.1/os-volumes/db0ae3b4-2b1b-4d1a-9a06-c8bd268bf7c3 => generated 109 bytes in 93 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 24 05:00:55.655316 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-7e8a468f-55c1-4f5b-b8fe-b4f298b4bef2 tempest-DeleteServersTestJSON-1630660203 tempest-DeleteServersTestJSON-1630660203-project] Calling method '>' {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:00:55.656804 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-ced87c42-7c0a-4e8b-ab14-941f6be91ff3 tempest-VolumesSnapshotsTestJSON-1584225543 tempest-VolumesSnapshotsTestJSON-1584225543-project] Calling method '.version_select at 0x7f79515c2700>' {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:00:55.660779 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.compute.api [None req-7e8a468f-55c1-4f5b-b8fe-b4f298b4bef2 tempest-DeleteServersTestJSON-1630660203 tempest-DeleteServersTestJSON-1630660203-project] [instance: ec88b440-40a0-459f-b94b-06c332e86094] Fetching instance by UUID {{(pid=120593) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:00:55.786616 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: INFO nova.api.openstack.wsgi [None req-ced87c42-7c0a-4e8b-ab14-941f6be91ff3 tempest-VolumesSnapshotsTestJSON-1584225543 tempest-VolumesSnapshotsTestJSON-1584225543-project] HTTP exception thrown: Volume db0ae3b4-2b1b-4d1a-9a06-c8bd268bf7c3 could not be found. Sep 24 05:00:55.789564 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-ced87c42-7c0a-4e8b-ab14-941f6be91ff3 tempest-VolumesSnapshotsTestJSON-1584225543 tempest-VolumesSnapshotsTestJSON-1584225543-project] Request method failure captured: Sep 24 05:00:55.789564 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: request: GET /compute/v2.1/os-volumes/db0ae3b4-2b1b-4d1a-9a06-c8bd268bf7c3 HTTP/1.1 Sep 24 05:00:55.789564 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: Accept: application/json Sep 24 05:00:55.789564 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: Accept-Encoding: identity Sep 24 05:00:55.789564 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: Connection: close Sep 24 05:00:55.789564 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: Content-Length: 0 Sep 24 05:00:55.789564 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: Content-Type: application/json Sep 24 05:00:55.789564 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: Host: 10.222.0.50 Sep 24 05:00:55.789564 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: Openstack-System-Scope: None Sep 24 05:00:55.789564 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: User-Agent: python-urllib3/1.26.12 Sep 24 05:00:55.789564 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: X-Auth-Token: gAAAAABjLo706n9gxWGtDhJt3gPCTNi-_oNGH-cBNfc3D0X0VnAdgKmvnLIpzEJNN17fdfxcfkjJcwVX5UAx06dMnF66wBp2Y9ioyatYP2S2HufHY8ir27ijZ6cXr7qdTmW0Zm3spww9nmPvA8PLSaO4fIRbSQ3-EXwjy2InWsJm_NpzckNuLig Sep 24 05:00:55.789564 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: X-Domain-Id: None Sep 24 05:00:55.789564 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: X-Domain-Name: None Sep 24 05:00:55.789564 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: X-Identity-Status: Confirmed Sep 24 05:00:55.789564 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: X-Is-Admin-Project: True Sep 24 05:00:55.789564 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: X-Project-Domain-Id: default Sep 24 05:00:55.789564 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: X-Project-Domain-Name: Default Sep 24 05:00:55.789564 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: X-Project-Id: c8eb924c6ccf498e86777543349f2cf9 Sep 24 05:00:55.789564 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1584225543 Sep 24 05:00:55.789564 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: X-Role: member,reader Sep 24 05:00:55.789564 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: X-Roles: member,reader Sep 24 05:00:55.790727 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/c8eb924c6ccf498e86777543349f2cf9"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/c8eb924c6ccf498e86777543349f2cf9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/c8eb924c6ccf498e86777543349f2cf9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.50:8080", "publicURL": "http://10.222.0.50:8080/v1/AUTH_c8eb924c6ccf498e86777543349f2cf9"}]}] Sep 24 05:00:55.790727 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1584225543 Sep 24 05:00:55.790727 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: X-Tenant-Id: c8eb924c6ccf498e86777543349f2cf9 Sep 24 05:00:55.790727 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1584225543 Sep 24 05:00:55.790727 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: X-User: tempest-VolumesSnapshotsTestJSON-1584225543-project Sep 24 05:00:55.790727 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: X-User-Domain-Id: default Sep 24 05:00:55.790727 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: X-User-Domain-Name: Default Sep 24 05:00:55.790727 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: X-User-Id: 701e9898649546818ca5eef88e24041a Sep 24 05:00:55.790727 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1584225543-project Sep 24 05:00:55.790727 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: method: Sep 24 05:00:55.790727 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: exception: Volume db0ae3b4-2b1b-4d1a-9a06-c8bd268bf7c3 could not be found. Sep 24 05:00:55.790727 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: action_args: {'id': 'db0ae3b4-2b1b-4d1a-9a06-c8bd268bf7c3'} Sep 24 05:00:55.790727 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 24 05:00:55.791372 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 05:00:55.791372 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 24 05:00:55.791372 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 24 05:00:55.791372 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 24 05:00:55.791372 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 24 05:00:55.791372 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 24 05:00:55.791372 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 24 05:00:55.791372 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 24 05:00:55.791372 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 24 05:00:55.791372 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 24 05:00:55.791372 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 24 05:00:55.791372 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 24 05:00:55.791372 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 24 05:00:55.791372 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 24 05:00:55.791372 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 24 05:00:55.791372 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume db0ae3b4-2b1b-4d1a-9a06-c8bd268bf7c3 could not be found. (HTTP 404) (Request-ID: req-833ae1c0-d748-4c6e-98c9-e25980ecca15) Sep 24 05:00:55.791372 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi Sep 24 05:00:55.791372 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 05:00:55.791372 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi Sep 24 05:00:55.792268 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 05:00:55.792268 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Sep 24 05:00:55.792268 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Sep 24 05:00:55.792268 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 24 05:00:55.792268 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 24 05:00:55.792268 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 24 05:00:55.792268 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 24 05:00:55.792268 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 24 05:00:55.792268 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 24 05:00:55.792268 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 24 05:00:55.792268 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 24 05:00:55.792268 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 24 05:00:55.792268 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 24 05:00:55.792268 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 24 05:00:55.792268 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 24 05:00:55.792268 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 24 05:00:55.792268 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 24 05:00:55.792268 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 24 05:00:55.792268 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 24 05:00:55.793139 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 24 05:00:55.793139 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 24 05:00:55.793139 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 24 05:00:55.793139 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 24 05:00:55.793139 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume db0ae3b4-2b1b-4d1a-9a06-c8bd268bf7c3 could not be found. Sep 24 05:00:55.793139 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi Sep 24 05:00:55.793139 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 05:00:55.793139 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi Sep 24 05:00:55.793139 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 05:00:55.793139 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 05:00:55.793139 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 05:00:55.793139 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 24 05:00:55.793139 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 24 05:00:55.793139 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 24 05:00:55.793139 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 24 05:00:55.793139 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 24 05:00:55.793139 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 24 05:00:55.793139 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Sep 24 05:00:55.793139 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 24 05:00:55.794127 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume db0ae3b4-2b1b-4d1a-9a06-c8bd268bf7c3 could not be found. Sep 24 05:00:55.794127 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi Sep 24 05:00:55.794127 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 05:00:55.794127 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi Sep 24 05:00:55.794127 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 05:00:55.794127 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 05:00:55.794127 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 05:00:55.794127 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 24 05:00:55.794127 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 24 05:00:55.794127 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume db0ae3b4-2b1b-4d1a-9a06-c8bd268bf7c3 could not be found. Sep 24 05:00:55.794127 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi Sep 24 05:00:55.805197 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-ced87c42-7c0a-4e8b-ab14-941f6be91ff3 tempest-VolumesSnapshotsTestJSON-1584225543 tempest-VolumesSnapshotsTestJSON-1584225543-project] Returning 404 to user: Volume db0ae3b4-2b1b-4d1a-9a06-c8bd268bf7c3 could not be found. {{(pid=120594) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 24 05:00:55.806348 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [None req-ced87c42-7c0a-4e8b-ab14-941f6be91ff3 tempest-VolumesSnapshotsTestJSON-1584225543 tempest-VolumesSnapshotsTestJSON-1584225543-project] 10.222.0.50 "GET /compute/v2.1/os-volumes/db0ae3b4-2b1b-4d1a-9a06-c8bd268bf7c3" status: 404 len: 109 microversion: 2.1 time: 0.159280 Sep 24 05:00:55.809081 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 17/27] 10.222.0.50 () {58 vars in 1245 bytes} [Sat Sep 24 05:00:55 2022] GET /compute/v2.1/os-volumes/db0ae3b4-2b1b-4d1a-9a06-c8bd268bf7c3 => generated 109 bytes in 162 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 24 05:00:56.231868 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-7e8a468f-55c1-4f5b-b8fe-b4f298b4bef2 tempest-DeleteServersTestJSON-1630660203 tempest-DeleteServersTestJSON-1630660203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27d1a24c9e15493195744bcbf598ac4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa84dfa1cc764dc99b6e804e778c3479', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:00:56.279522 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-7e8a468f-55c1-4f5b-b8fe-b4f298b4bef2 tempest-DeleteServersTestJSON-1630660203 tempest-DeleteServersTestJSON-1630660203-project] 10.222.0.50 "GET /compute/v2.1/servers/ec88b440-40a0-459f-b94b-06c332e86094" status: 200 len: 1215 microversion: 2.1 time: 0.639928 Sep 24 05:00:56.281859 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 11/28] 10.222.0.50 () {58 vars in 1236 bytes} [Sat Sep 24 05:00:55 2022] GET /compute/v2.1/servers/ec88b440-40a0-459f-b94b-06c332e86094 => generated 1215 bytes in 646 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 05:00:56.969947 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-ae0ad07f-b59b-424d-a08b-22aef6668e1e tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-516213169", "imageRef": "75ab730a-d8cc-4ea2-b58f-0f3eb476c976", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 05:00:57.304771 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-cf35821e-ce69-40f2-a2c9-84d37f65f881 tempest-DeleteServersTestJSON-1630660203 tempest-DeleteServersTestJSON-1630660203-project] Calling method '>' {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:00:57.305391 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.compute.api [None req-cf35821e-ce69-40f2-a2c9-84d37f65f881 tempest-DeleteServersTestJSON-1630660203 tempest-DeleteServersTestJSON-1630660203-project] [instance: ec88b440-40a0-459f-b94b-06c332e86094] Fetching instance by UUID {{(pid=120593) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:00:57.311329 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.network.neutron [None req-ae0ad07f-b59b-424d-a08b-22aef6668e1e tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] validate_networks() for [('002f39b7-19b2-4fdf-9ca2-a023fea0b5dc', None, None, None, None, None)] {{(pid=120594) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 24 05:00:57.532652 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-cf35821e-ce69-40f2-a2c9-84d37f65f881 tempest-DeleteServersTestJSON-1630660203 tempest-DeleteServersTestJSON-1630660203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27d1a24c9e15493195744bcbf598ac4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa84dfa1cc764dc99b6e804e778c3479', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:00:57.541759 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-cf35821e-ce69-40f2-a2c9-84d37f65f881 tempest-DeleteServersTestJSON-1630660203 tempest-DeleteServersTestJSON-1630660203-project] 10.222.0.50 "GET /compute/v2.1/servers/ec88b440-40a0-459f-b94b-06c332e86094" status: 200 len: 1215 microversion: 2.1 time: 0.240983 Sep 24 05:00:57.542654 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 12/29] 10.222.0.50 () {58 vars in 1236 bytes} [Sat Sep 24 05:00:57 2022] GET /compute/v2.1/servers/ec88b440-40a0-459f-b94b-06c332e86094 => generated 1215 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 24 05:00:58.567199 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-6cac8cdb-72ba-4cf0-b8dd-a95ef7f3f0e7 tempest-DeleteServersTestJSON-1630660203 tempest-DeleteServersTestJSON-1630660203-project] Calling method '>' {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:00:58.567934 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.compute.api [None req-6cac8cdb-72ba-4cf0-b8dd-a95ef7f3f0e7 tempest-DeleteServersTestJSON-1630660203 tempest-DeleteServersTestJSON-1630660203-project] [instance: ec88b440-40a0-459f-b94b-06c332e86094] Fetching instance by UUID {{(pid=120593) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:00:58.584835 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-6cac8cdb-72ba-4cf0-b8dd-a95ef7f3f0e7 tempest-DeleteServersTestJSON-1630660203 tempest-DeleteServersTestJSON-1630660203-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:00:58.594706 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-6cac8cdb-72ba-4cf0-b8dd-a95ef7f3f0e7 tempest-DeleteServersTestJSON-1630660203 tempest-DeleteServersTestJSON-1630660203-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:00:58.595818 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-6cac8cdb-72ba-4cf0-b8dd-a95ef7f3f0e7 tempest-DeleteServersTestJSON-1630660203 tempest-DeleteServersTestJSON-1630660203-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:00:58.596748 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-6cac8cdb-72ba-4cf0-b8dd-a95ef7f3f0e7 tempest-DeleteServersTestJSON-1630660203 tempest-DeleteServersTestJSON-1630660203-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:00:58.597372 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-6cac8cdb-72ba-4cf0-b8dd-a95ef7f3f0e7 tempest-DeleteServersTestJSON-1630660203 tempest-DeleteServersTestJSON-1630660203-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:00:58.597946 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-6cac8cdb-72ba-4cf0-b8dd-a95ef7f3f0e7 tempest-DeleteServersTestJSON-1630660203 tempest-DeleteServersTestJSON-1630660203-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:00:59.341613 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-6cac8cdb-72ba-4cf0-b8dd-a95ef7f3f0e7 tempest-DeleteServersTestJSON-1630660203 tempest-DeleteServersTestJSON-1630660203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27d1a24c9e15493195744bcbf598ac4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa84dfa1cc764dc99b6e804e778c3479', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:00:59.361357 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-6cac8cdb-72ba-4cf0-b8dd-a95ef7f3f0e7 tempest-DeleteServersTestJSON-1630660203 tempest-DeleteServersTestJSON-1630660203-project] 10.222.0.50 "GET /compute/v2.1/servers/ec88b440-40a0-459f-b94b-06c332e86094" status: 200 len: 1211 microversion: 2.1 time: 0.798881 Sep 24 05:00:59.367078 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 13/30] 10.222.0.50 () {58 vars in 1236 bytes} [Sat Sep 24 05:00:58 2022] GET /compute/v2.1/servers/ec88b440-40a0-459f-b94b-06c332e86094 => generated 1211 bytes in 805 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 05:00:59.670835 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-8b906798-5adc-4994-89ad-e5e1999c2ee4 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Action: 'create', calling method: .version_select at 0x7f7951435790>, body: {"keypair": {"name": "tempest-keypair-1733771919", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMsWY39T44P5yptujAoOTmyAzlgTMWiHdanFMSyX0KGJmmvy4bwC2zIMBER/iBnQlK4aj64tDh/VEtvP7jZK28DJVXVTY1V6OG/rqSMxiwnOOBz8Awe/ZQ+4+lU+mB4QPQ=="}} {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 05:00:59.720581 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.quota [None req-8b906798-5adc-4994-89ad-e5e1999c2ee4 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Getting quotas for project 87d5229e39fe4817b5187068d8acecc7. Resources: {'key_pairs'} {{(pid=120593) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 24 05:00:59.730413 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.quota [None req-8b906798-5adc-4994-89ad-e5e1999c2ee4 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Getting quotas for user 74a8cc19ab204424ab23c62915ac2bab and project 87d5229e39fe4817b5187068d8acecc7. Resources: {'key_pairs'} {{(pid=120593) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 24 05:00:59.788045 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-8b906798-5adc-4994-89ad-e5e1999c2ee4 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] 10.222.0.50 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.419616 Sep 24 05:00:59.790871 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.virt.hardware [None req-ae0ad07f-b59b-424d-a08b-22aef6668e1e tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Flavor limits 0:0:0 {{(pid=120594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 24 05:00:59.793200 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.virt.hardware [None req-ae0ad07f-b59b-424d-a08b-22aef6668e1e tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Image limits 0:0:0 {{(pid=120594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 24 05:00:59.796086 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.virt.hardware [None req-ae0ad07f-b59b-424d-a08b-22aef6668e1e tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Flavor pref 0:0:0 {{(pid=120594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 24 05:00:59.797298 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 14/31] 10.222.0.50 () {60 vars in 1159 bytes} [Sat Sep 24 05:00:59 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 05:00:59.797536 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.virt.hardware [None req-ae0ad07f-b59b-424d-a08b-22aef6668e1e tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Image pref 0:0:0 {{(pid=120594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 24 05:00:59.800153 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.virt.hardware [None req-ae0ad07f-b59b-424d-a08b-22aef6668e1e tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 24 05:00:59.806867 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-0619e10a-241a-4941-9d8f-7f9cc2b85188 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-232479686", "imageRef": "75ab730a-d8cc-4ea2-b58f-0f3eb476c976", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "71010379-32a3-4ab2-bca2-8378eefa5ed7"}], "security_groups": [{"name": "tempest-securitygroup--1577802326"}], "key_name": "tempest-keypair-2031057050", "user_data": "}} {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 05:00:59.898612 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-ae0ad07f-b59b-424d-a08b-22aef6668e1e tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:00:59.900827 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-ae0ad07f-b59b-424d-a08b-22aef6668e1e tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:00:59.903752 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-ae0ad07f-b59b-424d-a08b-22aef6668e1e tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:00:59.916508 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-ae0ad07f-b59b-424d-a08b-22aef6668e1e tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:00:59.921146 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-ae0ad07f-b59b-424d-a08b-22aef6668e1e tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:00:59.924104 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-ae0ad07f-b59b-424d-a08b-22aef6668e1e tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:01:00.020144 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.quota [None req-ae0ad07f-b59b-424d-a08b-22aef6668e1e tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Getting quotas for project a18a3756ba2b460d977f738a115ebfe0. Resources: {'instances', 'ram', 'cores'} {{(pid=120594) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 24 05:01:00.032983 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.quota [None req-ae0ad07f-b59b-424d-a08b-22aef6668e1e tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Getting quotas for user 8cdd0da2c7bc4139bcd48ef36a2ee183 and project a18a3756ba2b460d977f738a115ebfe0. Resources: {'instances', 'ram', 'cores'} {{(pid=120594) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 24 05:01:00.061312 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.compute.api [None req-ae0ad07f-b59b-424d-a08b-22aef6668e1e tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Going to run 1 instances... {{(pid=120594) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 24 05:01:00.068827 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.compute.api [None req-ae0ad07f-b59b-424d-a08b-22aef6668e1e tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] [instance: 87dcedb5-91c7-4bc3-b46f-124ccffedf78] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='75ab730a-d8cc-4ea2-b58f-0f3eb476c976',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120594) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 24 05:01:00.300671 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [None req-ae0ad07f-b59b-424d-a08b-22aef6668e1e tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 3.892395 Sep 24 05:01:00.302488 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 18/32] 10.222.0.50 () {60 vars in 1147 bytes} [Sat Sep 24 05:00:56 2022] POST /compute/v2.1/servers => generated 383 bytes in 3900 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 24 05:01:00.329311 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-0aed59e9-ad5e-4cdb-99a8-bb8f78e4ce97 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Calling method '>' {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:01:00.330252 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.compute.api [None req-0aed59e9-ad5e-4cdb-99a8-bb8f78e4ce97 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] [instance: 87dcedb5-91c7-4bc3-b46f-124ccffedf78] Fetching instance by UUID {{(pid=120594) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:01:00.342415 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.network.neutron [None req-0619e10a-241a-4941-9d8f-7f9cc2b85188 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] validate_networks() for [('71010379-32a3-4ab2-bca2-8378eefa5ed7', None, None, None, None, None)] {{(pid=120593) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 24 05:01:00.464511 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.policy [None req-0aed59e9-ad5e-4cdb-99a8-bb8f78e4ce97 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cdd0da2c7bc4139bcd48ef36a2ee183', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a18a3756ba2b460d977f738a115ebfe0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:01:00.511448 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [None req-0aed59e9-ad5e-4cdb-99a8-bb8f78e4ce97 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] 10.222.0.50 "GET /compute/v2.1/servers/87dcedb5-91c7-4bc3-b46f-124ccffedf78" status: 200 len: 1221 microversion: 2.1 time: 0.198094 Sep 24 05:01:00.512384 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 19/33] 10.222.0.50 () {58 vars in 1236 bytes} [Sat Sep 24 05:01:00 2022] GET /compute/v2.1/servers/87dcedb5-91c7-4bc3-b46f-124ccffedf78 => generated 1221 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 05:01:00.527020 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-53837a2a-fb63-4b10-a910-5562c1e07cdf tempest-DeleteServersTestJSON-1630660203 tempest-DeleteServersTestJSON-1630660203-project] Calling method '>' {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:01:00.527986 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.compute.api [None req-53837a2a-fb63-4b10-a910-5562c1e07cdf tempest-DeleteServersTestJSON-1630660203 tempest-DeleteServersTestJSON-1630660203-project] [instance: ec88b440-40a0-459f-b94b-06c332e86094] Fetching instance by UUID {{(pid=120594) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:01:00.543886 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-53837a2a-fb63-4b10-a910-5562c1e07cdf tempest-DeleteServersTestJSON-1630660203 tempest-DeleteServersTestJSON-1630660203-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:01:00.544722 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-53837a2a-fb63-4b10-a910-5562c1e07cdf tempest-DeleteServersTestJSON-1630660203 tempest-DeleteServersTestJSON-1630660203-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:01:00.545295 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-53837a2a-fb63-4b10-a910-5562c1e07cdf tempest-DeleteServersTestJSON-1630660203 tempest-DeleteServersTestJSON-1630660203-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:01:00.546211 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-53837a2a-fb63-4b10-a910-5562c1e07cdf tempest-DeleteServersTestJSON-1630660203 tempest-DeleteServersTestJSON-1630660203-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:01:00.546964 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-53837a2a-fb63-4b10-a910-5562c1e07cdf tempest-DeleteServersTestJSON-1630660203 tempest-DeleteServersTestJSON-1630660203-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:01:00.547591 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-53837a2a-fb63-4b10-a910-5562c1e07cdf tempest-DeleteServersTestJSON-1630660203 tempest-DeleteServersTestJSON-1630660203-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:01:01.124531 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.policy [None req-53837a2a-fb63-4b10-a910-5562c1e07cdf tempest-DeleteServersTestJSON-1630660203 tempest-DeleteServersTestJSON-1630660203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27d1a24c9e15493195744bcbf598ac4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa84dfa1cc764dc99b6e804e778c3479', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:01:01.186920 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [None req-53837a2a-fb63-4b10-a910-5562c1e07cdf tempest-DeleteServersTestJSON-1630660203 tempest-DeleteServersTestJSON-1630660203-project] 10.222.0.50 "GET /compute/v2.1/servers/ec88b440-40a0-459f-b94b-06c332e86094" status: 200 len: 1273 microversion: 2.1 time: 0.672430 Sep 24 05:01:01.194489 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 20/34] 10.222.0.50 () {58 vars in 1236 bytes} [Sat Sep 24 05:01:00 2022] GET /compute/v2.1/servers/ec88b440-40a0-459f-b94b-06c332e86094 => generated 1273 bytes in 681 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 05:01:01.215585 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-308301ca-ddd1-47ce-b849-c5fdee46197f tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1632799554", "imageRef": "75ab730a-d8cc-4ea2-b58f-0f3eb476c976", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 05:01:01.347336 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.network.neutron [None req-308301ca-ddd1-47ce-b849-c5fdee46197f tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] validate_networks() for [('002f39b7-19b2-4fdf-9ca2-a023fea0b5dc', None, None, None, None, None)] {{(pid=120594) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 24 05:01:03.247795 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.virt.hardware [None req-0619e10a-241a-4941-9d8f-7f9cc2b85188 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Flavor limits 0:0:0 {{(pid=120593) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 24 05:01:03.249066 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.virt.hardware [None req-0619e10a-241a-4941-9d8f-7f9cc2b85188 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Image limits 0:0:0 {{(pid=120593) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 24 05:01:03.250107 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.virt.hardware [None req-0619e10a-241a-4941-9d8f-7f9cc2b85188 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Flavor pref 0:0:0 {{(pid=120593) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 24 05:01:03.251933 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.virt.hardware [None req-0619e10a-241a-4941-9d8f-7f9cc2b85188 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Image pref 0:0:0 {{(pid=120593) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 24 05:01:03.252259 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.virt.hardware [None req-0619e10a-241a-4941-9d8f-7f9cc2b85188 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120593) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 24 05:01:03.279664 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-0619e10a-241a-4941-9d8f-7f9cc2b85188 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:01:03.280620 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-0619e10a-241a-4941-9d8f-7f9cc2b85188 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:01:03.281411 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-0619e10a-241a-4941-9d8f-7f9cc2b85188 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:01:03.284047 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-0619e10a-241a-4941-9d8f-7f9cc2b85188 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:01:03.285177 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-0619e10a-241a-4941-9d8f-7f9cc2b85188 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:01:03.285905 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-0619e10a-241a-4941-9d8f-7f9cc2b85188 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:01:03.315559 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.quota [None req-0619e10a-241a-4941-9d8f-7f9cc2b85188 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Getting quotas for project 66ec8bde739145dda504995dbea0914a. Resources: {'instances', 'ram', 'cores'} {{(pid=120593) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 24 05:01:03.321657 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.quota [None req-0619e10a-241a-4941-9d8f-7f9cc2b85188 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Getting quotas for user 4b1b0448e7f54e3aaae49e411699269e and project 66ec8bde739145dda504995dbea0914a. Resources: {'instances', 'ram', 'cores'} {{(pid=120593) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 24 05:01:03.350633 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.compute.api [None req-0619e10a-241a-4941-9d8f-7f9cc2b85188 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Going to run 1 instances... {{(pid=120593) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 24 05:01:03.355099 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.compute.api [None req-0619e10a-241a-4941-9d8f-7f9cc2b85188 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] [instance: b2daebb8-dfea-4ab9-8253-008a21f906e1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='75ab730a-d8cc-4ea2-b58f-0f3eb476c976',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120593) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 24 05:01:03.446405 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-0619e10a-241a-4941-9d8f-7f9cc2b85188 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 3.646469 Sep 24 05:01:03.447565 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 15/35] 10.222.0.50 () {60 vars in 1147 bytes} [Sat Sep 24 05:00:59 2022] POST /compute/v2.1/servers => generated 402 bytes in 3648 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 24 05:01:03.692271 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-9a809f81-706a-4fd2-85bd-2c0d55f1b5a8 tempest-VolumesGetTestJSON-2135720136 tempest-VolumesGetTestJSON-2135720136-project] Action: 'create', calling method: .version_select at 0x7f7950bc5700>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-502232170", "metadata": {"Type": "work"}}} {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 05:01:04.050847 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.virt.hardware [None req-308301ca-ddd1-47ce-b849-c5fdee46197f tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Flavor limits 0:0:0 {{(pid=120594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 24 05:01:04.051385 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.virt.hardware [None req-308301ca-ddd1-47ce-b849-c5fdee46197f tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Image limits 0:0:0 {{(pid=120594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 24 05:01:04.051730 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.virt.hardware [None req-308301ca-ddd1-47ce-b849-c5fdee46197f tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Flavor pref 0:0:0 {{(pid=120594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 24 05:01:04.052143 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.virt.hardware [None req-308301ca-ddd1-47ce-b849-c5fdee46197f tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Image pref 0:0:0 {{(pid=120594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 24 05:01:04.052567 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.virt.hardware [None req-308301ca-ddd1-47ce-b849-c5fdee46197f tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 24 05:01:04.079907 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-308301ca-ddd1-47ce-b849-c5fdee46197f tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:01:04.089388 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-308301ca-ddd1-47ce-b849-c5fdee46197f tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:01:04.093332 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-308301ca-ddd1-47ce-b849-c5fdee46197f tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:01:04.099993 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-308301ca-ddd1-47ce-b849-c5fdee46197f tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:01:04.100577 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-308301ca-ddd1-47ce-b849-c5fdee46197f tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:01:04.101091 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-308301ca-ddd1-47ce-b849-c5fdee46197f tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:01:04.193966 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.quota [None req-308301ca-ddd1-47ce-b849-c5fdee46197f tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Getting quotas for project a18a3756ba2b460d977f738a115ebfe0. Resources: {'instances', 'ram', 'cores'} {{(pid=120594) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 24 05:01:04.200301 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.quota [None req-308301ca-ddd1-47ce-b849-c5fdee46197f tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Getting quotas for user 8cdd0da2c7bc4139bcd48ef36a2ee183 and project a18a3756ba2b460d977f738a115ebfe0. Resources: {'instances', 'ram', 'cores'} {{(pid=120594) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 24 05:01:04.235254 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.compute.api [None req-308301ca-ddd1-47ce-b849-c5fdee46197f tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Going to run 1 instances... {{(pid=120594) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 24 05:01:04.243571 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.compute.api [None req-308301ca-ddd1-47ce-b849-c5fdee46197f tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] [instance: 50eed27b-6da2-4dda-94cc-02fc5cfec071] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='75ab730a-d8cc-4ea2-b58f-0f3eb476c976',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120594) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 24 05:01:04.355711 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [None req-308301ca-ddd1-47ce-b849-c5fdee46197f tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 3.159560 Sep 24 05:01:04.357621 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 21/36] 10.222.0.50 () {60 vars in 1147 bytes} [Sat Sep 24 05:01:01 2022] POST /compute/v2.1/servers => generated 383 bytes in 3162 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 24 05:01:04.372324 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-7e0c00bf-8c03-40b7-b502-fd11d2b6204b tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-616373263", "imageRef": "75ab730a-d8cc-4ea2-b58f-0f3eb476c976", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "c071aac1-7a40-472d-a3df-a9b342b44447"}], "security_groups": [{"name": "tempest-securitygroup--20850603"}], "key_name": "tempest-keypair-367803558", "user_data": "}} {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 05:01:04.839936 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.network.neutron [None req-7e0c00bf-8c03-40b7-b502-fd11d2b6204b tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] validate_networks() for [('c071aac1-7a40-472d-a3df-a9b342b44447', None, None, None, None, None)] {{(pid=120594) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 24 05:01:05.050482 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-9a809f81-706a-4fd2-85bd-2c0d55f1b5a8 tempest-VolumesGetTestJSON-2135720136 tempest-VolumesGetTestJSON-2135720136-project] 10.222.0.50 "POST /compute/v2.1/os-volumes" status: 200 len: 352 microversion: 2.1 time: 1.600872 Sep 24 05:01:05.052338 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 16/37] 10.222.0.50 () {60 vars in 1156 bytes} [Sat Sep 24 05:01:03 2022] POST /compute/v2.1/os-volumes => generated 352 bytes in 1604 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Sep 24 05:01:05.058796 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-d4f76b2b-b9cc-4365-ba24-1b10e639e5dd tempest-DeleteServersTestJSON-1630660203 tempest-DeleteServersTestJSON-1630660203-project] Calling method '>' {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:01:05.061873 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.compute.api [None req-d4f76b2b-b9cc-4365-ba24-1b10e639e5dd tempest-DeleteServersTestJSON-1630660203 tempest-DeleteServersTestJSON-1630660203-project] [instance: ec88b440-40a0-459f-b94b-06c332e86094] Fetching instance by UUID {{(pid=120593) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:01:05.099127 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-d4f76b2b-b9cc-4365-ba24-1b10e639e5dd tempest-DeleteServersTestJSON-1630660203 tempest-DeleteServersTestJSON-1630660203-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:01:05.100756 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-d4f76b2b-b9cc-4365-ba24-1b10e639e5dd tempest-DeleteServersTestJSON-1630660203 tempest-DeleteServersTestJSON-1630660203-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:01:05.102793 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-d4f76b2b-b9cc-4365-ba24-1b10e639e5dd tempest-DeleteServersTestJSON-1630660203 tempest-DeleteServersTestJSON-1630660203-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:01:05.103867 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-d4f76b2b-b9cc-4365-ba24-1b10e639e5dd tempest-DeleteServersTestJSON-1630660203 tempest-DeleteServersTestJSON-1630660203-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:01:05.106286 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-d4f76b2b-b9cc-4365-ba24-1b10e639e5dd tempest-DeleteServersTestJSON-1630660203 tempest-DeleteServersTestJSON-1630660203-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:01:05.107000 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-d4f76b2b-b9cc-4365-ba24-1b10e639e5dd tempest-DeleteServersTestJSON-1630660203 tempest-DeleteServersTestJSON-1630660203-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:01:06.598594 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-d4f76b2b-b9cc-4365-ba24-1b10e639e5dd tempest-DeleteServersTestJSON-1630660203 tempest-DeleteServersTestJSON-1630660203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27d1a24c9e15493195744bcbf598ac4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa84dfa1cc764dc99b6e804e778c3479', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:01:06.611074 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-d4f76b2b-b9cc-4365-ba24-1b10e639e5dd tempest-DeleteServersTestJSON-1630660203 tempest-DeleteServersTestJSON-1630660203-project] 10.222.0.50 "GET /compute/v2.1/servers/ec88b440-40a0-459f-b94b-06c332e86094" status: 200 len: 1315 microversion: 2.1 time: 1.556194 Sep 24 05:01:06.611753 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 17/38] 10.222.0.50 () {58 vars in 1236 bytes} [Sat Sep 24 05:01:05 2022] GET /compute/v2.1/servers/ec88b440-40a0-459f-b94b-06c332e86094 => generated 1315 bytes in 1558 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 05:01:06.628325 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-412e68a6-19f2-4513-8e80-54ff1520212a tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Calling method '>' {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:01:06.629179 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.compute.api [None req-412e68a6-19f2-4513-8e80-54ff1520212a tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] [instance: b2daebb8-dfea-4ab9-8253-008a21f906e1] Fetching instance by UUID {{(pid=120593) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:01:06.649030 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-412e68a6-19f2-4513-8e80-54ff1520212a tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:01:06.649873 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-412e68a6-19f2-4513-8e80-54ff1520212a tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:01:06.650493 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-412e68a6-19f2-4513-8e80-54ff1520212a tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:01:06.652612 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-412e68a6-19f2-4513-8e80-54ff1520212a tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:01:06.653318 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-412e68a6-19f2-4513-8e80-54ff1520212a tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:01:06.658477 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-412e68a6-19f2-4513-8e80-54ff1520212a tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:01:06.855116 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-412e68a6-19f2-4513-8e80-54ff1520212a tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b1b0448e7f54e3aaae49e411699269e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66ec8bde739145dda504995dbea0914a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:01:06.870096 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-412e68a6-19f2-4513-8e80-54ff1520212a tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] 10.222.0.50 "GET /compute/v2.1/servers/b2daebb8-dfea-4ab9-8253-008a21f906e1" status: 200 len: 1289 microversion: 2.1 time: 0.257007 Sep 24 05:01:06.870812 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 18/39] 10.222.0.50 () {58 vars in 1236 bytes} [Sat Sep 24 05:01:06 2022] GET /compute/v2.1/servers/b2daebb8-dfea-4ab9-8253-008a21f906e1 => generated 1289 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 05:01:06.897672 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-b694a816-369e-4095-9f0d-b5a7877243d1 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Calling method '>' {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:01:06.898330 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.compute.api [None req-b694a816-369e-4095-9f0d-b5a7877243d1 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] [instance: 50eed27b-6da2-4dda-94cc-02fc5cfec071] Fetching instance by UUID {{(pid=120593) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:01:06.928033 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-b694a816-369e-4095-9f0d-b5a7877243d1 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:01:06.931834 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-b694a816-369e-4095-9f0d-b5a7877243d1 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:01:06.932676 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-b694a816-369e-4095-9f0d-b5a7877243d1 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:01:06.937830 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-b694a816-369e-4095-9f0d-b5a7877243d1 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:01:06.940105 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-b694a816-369e-4095-9f0d-b5a7877243d1 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:01:06.941559 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-b694a816-369e-4095-9f0d-b5a7877243d1 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:01:07.049576 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.virt.hardware [None req-7e0c00bf-8c03-40b7-b502-fd11d2b6204b tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Flavor limits 0:0:0 {{(pid=120594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 24 05:01:07.051447 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.virt.hardware [None req-7e0c00bf-8c03-40b7-b502-fd11d2b6204b tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Image limits 0:0:0 {{(pid=120594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 24 05:01:07.053034 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.virt.hardware [None req-7e0c00bf-8c03-40b7-b502-fd11d2b6204b tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Flavor pref 0:0:0 {{(pid=120594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 24 05:01:07.055103 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.virt.hardware [None req-7e0c00bf-8c03-40b7-b502-fd11d2b6204b tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Image pref 0:0:0 {{(pid=120594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 24 05:01:07.056529 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.virt.hardware [None req-7e0c00bf-8c03-40b7-b502-fd11d2b6204b tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 24 05:01:07.087600 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-7e0c00bf-8c03-40b7-b502-fd11d2b6204b tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:01:07.089232 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-7e0c00bf-8c03-40b7-b502-fd11d2b6204b tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:01:07.091523 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-7e0c00bf-8c03-40b7-b502-fd11d2b6204b tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:01:07.095938 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-7e0c00bf-8c03-40b7-b502-fd11d2b6204b tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:01:07.097456 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-7e0c00bf-8c03-40b7-b502-fd11d2b6204b tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:01:07.098503 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-7e0c00bf-8c03-40b7-b502-fd11d2b6204b tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:01:07.165901 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.quota [None req-7e0c00bf-8c03-40b7-b502-fd11d2b6204b tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Getting quotas for project c1aaf20f480a423ea5feca81585aeeed. Resources: {'instances', 'ram', 'cores'} {{(pid=120594) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 24 05:01:07.172406 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.quota [None req-7e0c00bf-8c03-40b7-b502-fd11d2b6204b tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Getting quotas for user 0948754217fc4ff2ba0241fa35feaf90 and project c1aaf20f480a423ea5feca81585aeeed. Resources: {'instances', 'ram', 'cores'} {{(pid=120594) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 24 05:01:07.228695 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.compute.api [None req-7e0c00bf-8c03-40b7-b502-fd11d2b6204b tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Going to run 1 instances... {{(pid=120594) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 24 05:01:07.238212 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.compute.api [None req-7e0c00bf-8c03-40b7-b502-fd11d2b6204b tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] [instance: 08fb826b-e891-46c4-990d-ca03cf3f4222] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='75ab730a-d8cc-4ea2-b58f-0f3eb476c976',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120594) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 24 05:01:07.354690 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-b694a816-369e-4095-9f0d-b5a7877243d1 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cdd0da2c7bc4139bcd48ef36a2ee183', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a18a3756ba2b460d977f738a115ebfe0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:01:07.369732 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-b694a816-369e-4095-9f0d-b5a7877243d1 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] 10.222.0.50 "GET /compute/v2.1/servers/50eed27b-6da2-4dda-94cc-02fc5cfec071" status: 200 len: 1218 microversion: 2.1 time: 0.492437 Sep 24 05:01:07.370430 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 19/40] 10.222.0.50 () {58 vars in 1236 bytes} [Sat Sep 24 05:01:06 2022] GET /compute/v2.1/servers/50eed27b-6da2-4dda-94cc-02fc5cfec071 => generated 1218 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 05:01:07.425058 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-1d34264b-1136-4265-9780-2ee4d436f681 tempest-VolumesGetTestJSON-2135720136 tempest-VolumesGetTestJSON-2135720136-project] Calling method '.version_select at 0x7f7950bbbaf0>' {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:01:07.498546 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [None req-7e0c00bf-8c03-40b7-b502-fd11d2b6204b tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 202 len: 400 microversion: 2.20 time: 3.137873 Sep 24 05:01:07.509063 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 22/41] 10.222.0.50 () {62 vars in 1188 bytes} [Sat Sep 24 05:01:04 2022] POST /compute/v2.1/servers => generated 400 bytes in 3150 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Sep 24 05:01:07.523514 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-e5fd7f79-d4a2-4c4f-8ccb-90c0275babaa tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Calling method '>' {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:01:07.526527 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.compute.api [None req-e5fd7f79-d4a2-4c4f-8ccb-90c0275babaa tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] [instance: 08fb826b-e891-46c4-990d-ca03cf3f4222] Fetching instance by UUID {{(pid=120594) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:01:07.594580 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-1d34264b-1136-4265-9780-2ee4d436f681 tempest-VolumesGetTestJSON-2135720136 tempest-VolumesGetTestJSON-2135720136-project] 10.222.0.50 "GET /compute/v2.1/os-volumes/70fe173b-df27-4fba-841f-49d20a8279b0" status: 200 len: 353 microversion: 2.1 time: 0.198690 Sep 24 05:01:07.596706 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 20/42] 10.222.0.50 () {58 vars in 1245 bytes} [Sat Sep 24 05:01:07 2022] GET /compute/v2.1/os-volumes/70fe173b-df27-4fba-841f-49d20a8279b0 => generated 353 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 05:01:07.609074 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-162bdc7b-1593-4374-bdea-c23d395a65ab tempest-VolumesGetTestJSON-2135720136 tempest-VolumesGetTestJSON-2135720136-project] Calling method '.version_select at 0x7f7950b64f70>' {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:01:07.731943 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-162bdc7b-1593-4374-bdea-c23d395a65ab tempest-VolumesGetTestJSON-2135720136 tempest-VolumesGetTestJSON-2135720136-project] 10.222.0.50 "GET /compute/v2.1/os-volumes/70fe173b-df27-4fba-841f-49d20a8279b0" status: 200 len: 353 microversion: 2.1 time: 0.126967 Sep 24 05:01:07.732991 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 21/43] 10.222.0.50 () {58 vars in 1245 bytes} [Sat Sep 24 05:01:07 2022] GET /compute/v2.1/os-volumes/70fe173b-df27-4fba-841f-49d20a8279b0 => generated 353 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 24 05:01:07.738900 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-14a7a4ed-71f0-4087-bcc5-969a7bed451e tempest-DeleteServersTestJSON-1630660203 tempest-DeleteServersTestJSON-1630660203-project] Calling method '>' {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:01:07.741097 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.compute.api [None req-14a7a4ed-71f0-4087-bcc5-969a7bed451e tempest-DeleteServersTestJSON-1630660203 tempest-DeleteServersTestJSON-1630660203-project] [instance: ec88b440-40a0-459f-b94b-06c332e86094] Fetching instance by UUID {{(pid=120593) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:01:07.760542 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-14a7a4ed-71f0-4087-bcc5-969a7bed451e tempest-DeleteServersTestJSON-1630660203 tempest-DeleteServersTestJSON-1630660203-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:01:07.761303 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-14a7a4ed-71f0-4087-bcc5-969a7bed451e tempest-DeleteServersTestJSON-1630660203 tempest-DeleteServersTestJSON-1630660203-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:01:07.762029 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-14a7a4ed-71f0-4087-bcc5-969a7bed451e tempest-DeleteServersTestJSON-1630660203 tempest-DeleteServersTestJSON-1630660203-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:01:07.762940 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-14a7a4ed-71f0-4087-bcc5-969a7bed451e tempest-DeleteServersTestJSON-1630660203 tempest-DeleteServersTestJSON-1630660203-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:01:07.763622 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-14a7a4ed-71f0-4087-bcc5-969a7bed451e tempest-DeleteServersTestJSON-1630660203 tempest-DeleteServersTestJSON-1630660203-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:01:07.768416 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-14a7a4ed-71f0-4087-bcc5-969a7bed451e tempest-DeleteServersTestJSON-1630660203 tempest-DeleteServersTestJSON-1630660203-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:01:07.798111 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.policy [None req-e5fd7f79-d4a2-4c4f-8ccb-90c0275babaa tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0948754217fc4ff2ba0241fa35feaf90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1aaf20f480a423ea5feca81585aeeed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:01:07.839229 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.policy [None req-e5fd7f79-d4a2-4c4f-8ccb-90c0275babaa tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0948754217fc4ff2ba0241fa35feaf90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1aaf20f480a423ea5feca81585aeeed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:01:07.841040 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.policy [None req-e5fd7f79-d4a2-4c4f-8ccb-90c0275babaa tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0948754217fc4ff2ba0241fa35feaf90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1aaf20f480a423ea5feca81585aeeed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:01:07.842240 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [None req-e5fd7f79-d4a2-4c4f-8ccb-90c0275babaa tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] 10.222.0.50 "GET /compute/v2.1/servers/08fb826b-e891-46c4-990d-ca03cf3f4222" status: 200 len: 1280 microversion: 2.20 time: 0.324450 Sep 24 05:01:07.842807 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 23/44] 10.222.0.50 () {60 vars in 1277 bytes} [Sat Sep 24 05:01:07 2022] GET /compute/v2.1/servers/08fb826b-e891-46c4-990d-ca03cf3f4222 => generated 1280 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 05:01:07.869490 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-403da48d-1ebc-4fba-936d-93fdc6989278 tempest-VolumesGetTestJSON-2135720136 tempest-VolumesGetTestJSON-2135720136-project] Calling method '.version_select at 0x7f7950b31940>' {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:01:08.087470 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [None req-403da48d-1ebc-4fba-936d-93fdc6989278 tempest-VolumesGetTestJSON-2135720136 tempest-VolumesGetTestJSON-2135720136-project] 10.222.0.50 "DELETE /compute/v2.1/os-volumes/70fe173b-df27-4fba-841f-49d20a8279b0" status: 202 len: 0 microversion: 2.1 time: 0.243587 Sep 24 05:01:08.088059 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 24/45] 10.222.0.50 () {58 vars in 1248 bytes} [Sat Sep 24 05:01:07 2022] DELETE /compute/v2.1/os-volumes/70fe173b-df27-4fba-841f-49d20a8279b0 => generated 0 bytes in 245 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 24 05:01:08.097112 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-60d5e905-a3d9-43f3-8279-452b84c5e63f tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Calling method '>' {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:01:08.098364 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.compute.api [None req-60d5e905-a3d9-43f3-8279-452b84c5e63f tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] [instance: b2daebb8-dfea-4ab9-8253-008a21f906e1] Fetching instance by UUID {{(pid=120594) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:01:08.141195 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-60d5e905-a3d9-43f3-8279-452b84c5e63f tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:01:08.142756 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-60d5e905-a3d9-43f3-8279-452b84c5e63f tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:01:08.146854 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-60d5e905-a3d9-43f3-8279-452b84c5e63f tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:01:08.159802 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-60d5e905-a3d9-43f3-8279-452b84c5e63f tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:01:08.162509 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-60d5e905-a3d9-43f3-8279-452b84c5e63f tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:01:08.166531 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-60d5e905-a3d9-43f3-8279-452b84c5e63f tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:01:08.734702 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-14a7a4ed-71f0-4087-bcc5-969a7bed451e tempest-DeleteServersTestJSON-1630660203 tempest-DeleteServersTestJSON-1630660203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27d1a24c9e15493195744bcbf598ac4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa84dfa1cc764dc99b6e804e778c3479', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:01:08.745936 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-14a7a4ed-71f0-4087-bcc5-969a7bed451e tempest-DeleteServersTestJSON-1630660203 tempest-DeleteServersTestJSON-1630660203-project] 10.222.0.50 "GET /compute/v2.1/servers/ec88b440-40a0-459f-b94b-06c332e86094" status: 200 len: 1315 microversion: 2.1 time: 1.008977 Sep 24 05:01:08.750681 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 22/46] 10.222.0.50 () {58 vars in 1236 bytes} [Sat Sep 24 05:01:07 2022] GET /compute/v2.1/servers/ec88b440-40a0-459f-b94b-06c332e86094 => generated 1315 bytes in 1017 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 05:01:08.766827 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-bd4294a4-ea91-4567-bf7b-359dcfc31406 tempest-VolumesGetTestJSON-2135720136 tempest-VolumesGetTestJSON-2135720136-project] Calling method '.version_select at 0x7f7950b1ab80>' {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:01:08.844863 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.policy [None req-60d5e905-a3d9-43f3-8279-452b84c5e63f tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b1b0448e7f54e3aaae49e411699269e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66ec8bde739145dda504995dbea0914a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:01:08.849264 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.wsgi [None req-bd4294a4-ea91-4567-bf7b-359dcfc31406 tempest-VolumesGetTestJSON-2135720136 tempest-VolumesGetTestJSON-2135720136-project] HTTP exception thrown: Volume 70fe173b-df27-4fba-841f-49d20a8279b0 could not be found. Sep 24 05:01:08.865099 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-bd4294a4-ea91-4567-bf7b-359dcfc31406 tempest-VolumesGetTestJSON-2135720136 tempest-VolumesGetTestJSON-2135720136-project] Request method failure captured: Sep 24 05:01:08.865099 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: request: GET /compute/v2.1/os-volumes/70fe173b-df27-4fba-841f-49d20a8279b0 HTTP/1.1 Sep 24 05:01:08.865099 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: Accept: application/json Sep 24 05:01:08.865099 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: Accept-Encoding: identity Sep 24 05:01:08.865099 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: Connection: close Sep 24 05:01:08.865099 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: Content-Length: 0 Sep 24 05:01:08.865099 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: Content-Type: application/json Sep 24 05:01:08.865099 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: Host: 10.222.0.50 Sep 24 05:01:08.865099 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: Openstack-System-Scope: None Sep 24 05:01:08.865099 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: User-Agent: python-urllib3/1.26.12 Sep 24 05:01:08.865099 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: X-Auth-Token: gAAAAABjLo8Nam0ruZur7aQQdb_-IRG-nFLqXt4COIxVDnZ4s2j2LtCGhaBMqGxRnpDXlp5viQR86wWGx9F6lhUkBOUHiDgo1Mjq3oVs019X50zcStF9PkJvwHuC6WTa8HgyRVtFZ3WIf-0Q47t-8bZGsnL0a9lSS_mWt4Us61HMrHWBmG-pAgs Sep 24 05:01:08.865099 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: X-Domain-Id: None Sep 24 05:01:08.865099 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: X-Domain-Name: None Sep 24 05:01:08.865099 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: X-Identity-Status: Confirmed Sep 24 05:01:08.865099 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: X-Is-Admin-Project: True Sep 24 05:01:08.865099 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: X-Project-Domain-Id: default Sep 24 05:01:08.865099 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: X-Project-Domain-Name: Default Sep 24 05:01:08.865099 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: X-Project-Id: 8b0a47b2b3704d5180258eb3c5b7cfef Sep 24 05:01:08.865099 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: X-Project-Name: tempest-VolumesGetTestJSON-2135720136 Sep 24 05:01:08.865099 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: X-Role: member,reader Sep 24 05:01:08.865099 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: X-Roles: member,reader Sep 24 05:01:08.866695 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/8b0a47b2b3704d5180258eb3c5b7cfef"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/8b0a47b2b3704d5180258eb3c5b7cfef"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/8b0a47b2b3704d5180258eb3c5b7cfef"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.50:8080", "publicURL": "http://10.222.0.50:8080/v1/AUTH_8b0a47b2b3704d5180258eb3c5b7cfef"}]}] Sep 24 05:01:08.866695 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: X-Tenant: tempest-VolumesGetTestJSON-2135720136 Sep 24 05:01:08.866695 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: X-Tenant-Id: 8b0a47b2b3704d5180258eb3c5b7cfef Sep 24 05:01:08.866695 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: X-Tenant-Name: tempest-VolumesGetTestJSON-2135720136 Sep 24 05:01:08.866695 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: X-User: tempest-VolumesGetTestJSON-2135720136-project Sep 24 05:01:08.866695 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: X-User-Domain-Id: default Sep 24 05:01:08.866695 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: X-User-Domain-Name: Default Sep 24 05:01:08.866695 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: X-User-Id: a3aa1a166c4f4108b76f2fd174117694 Sep 24 05:01:08.866695 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: X-User-Name: tempest-VolumesGetTestJSON-2135720136-project Sep 24 05:01:08.866695 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: method: Sep 24 05:01:08.866695 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: exception: Volume 70fe173b-df27-4fba-841f-49d20a8279b0 could not be found. Sep 24 05:01:08.866695 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: action_args: {'id': '70fe173b-df27-4fba-841f-49d20a8279b0'} Sep 24 05:01:08.866695 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 24 05:01:08.867465 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 05:01:08.867465 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 24 05:01:08.867465 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 24 05:01:08.867465 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 24 05:01:08.867465 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 24 05:01:08.867465 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 24 05:01:08.867465 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 24 05:01:08.867465 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 24 05:01:08.867465 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 24 05:01:08.867465 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 24 05:01:08.867465 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 24 05:01:08.867465 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 24 05:01:08.867465 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 24 05:01:08.867465 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 24 05:01:08.867465 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 24 05:01:08.867465 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 70fe173b-df27-4fba-841f-49d20a8279b0 could not be found. (HTTP 404) (Request-ID: req-7813cc61-a88a-4256-bcff-7497fc264551) Sep 24 05:01:08.867465 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi Sep 24 05:01:08.867465 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 05:01:08.867465 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi Sep 24 05:01:08.868432 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 05:01:08.868432 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Sep 24 05:01:08.868432 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Sep 24 05:01:08.868432 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 24 05:01:08.868432 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 24 05:01:08.868432 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 24 05:01:08.868432 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 24 05:01:08.868432 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 24 05:01:08.868432 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 24 05:01:08.868432 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 24 05:01:08.868432 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 24 05:01:08.868432 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 24 05:01:08.868432 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 24 05:01:08.868432 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 24 05:01:08.868432 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 24 05:01:08.868432 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 24 05:01:08.868432 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 24 05:01:08.868432 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 24 05:01:08.868432 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 24 05:01:08.869379 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 24 05:01:08.869379 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 24 05:01:08.869379 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 24 05:01:08.869379 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 24 05:01:08.869379 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 70fe173b-df27-4fba-841f-49d20a8279b0 could not be found. Sep 24 05:01:08.869379 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi Sep 24 05:01:08.869379 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 05:01:08.869379 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi Sep 24 05:01:08.869379 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 05:01:08.869379 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 05:01:08.869379 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 05:01:08.869379 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 24 05:01:08.869379 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 24 05:01:08.869379 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 24 05:01:08.869379 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 24 05:01:08.869379 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 24 05:01:08.869379 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 24 05:01:08.869379 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Sep 24 05:01:08.869379 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 24 05:01:08.870408 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 70fe173b-df27-4fba-841f-49d20a8279b0 could not be found. Sep 24 05:01:08.870408 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi Sep 24 05:01:08.870408 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 05:01:08.870408 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi Sep 24 05:01:08.870408 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 05:01:08.870408 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 05:01:08.870408 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 05:01:08.870408 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 24 05:01:08.870408 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 24 05:01:08.870408 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 70fe173b-df27-4fba-841f-49d20a8279b0 could not be found. Sep 24 05:01:08.870408 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi Sep 24 05:01:08.872048 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [None req-60d5e905-a3d9-43f3-8279-452b84c5e63f tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] 10.222.0.50 "GET /compute/v2.1/servers/b2daebb8-dfea-4ab9-8253-008a21f906e1" status: 200 len: 1295 microversion: 2.1 time: 0.782573 Sep 24 05:01:08.874291 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 25/47] 10.222.0.50 () {58 vars in 1236 bytes} [Sat Sep 24 05:01:08 2022] GET /compute/v2.1/servers/b2daebb8-dfea-4ab9-8253-008a21f906e1 => generated 1295 bytes in 786 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 05:01:08.875314 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-bd4294a4-ea91-4567-bf7b-359dcfc31406 tempest-VolumesGetTestJSON-2135720136 tempest-VolumesGetTestJSON-2135720136-project] Returning 404 to user: Volume 70fe173b-df27-4fba-841f-49d20a8279b0 could not be found. {{(pid=120593) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 24 05:01:08.876821 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-bd4294a4-ea91-4567-bf7b-359dcfc31406 tempest-VolumesGetTestJSON-2135720136 tempest-VolumesGetTestJSON-2135720136-project] 10.222.0.50 "GET /compute/v2.1/os-volumes/70fe173b-df27-4fba-841f-49d20a8279b0" status: 404 len: 109 microversion: 2.1 time: 0.125133 Sep 24 05:01:08.878637 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 23/48] 10.222.0.50 () {58 vars in 1245 bytes} [Sat Sep 24 05:01:08 2022] GET /compute/v2.1/os-volumes/70fe173b-df27-4fba-841f-49d20a8279b0 => generated 109 bytes in 127 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 24 05:01:08.933516 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-c45a05b4-fae8-4152-806b-5bb5542ff45e tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Calling method '>' {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:01:08.935334 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.compute.api [None req-c45a05b4-fae8-4152-806b-5bb5542ff45e tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] [instance: 50eed27b-6da2-4dda-94cc-02fc5cfec071] Fetching instance by UUID {{(pid=120593) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:01:08.950442 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-c45a05b4-fae8-4152-806b-5bb5542ff45e tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:01:08.950959 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-c45a05b4-fae8-4152-806b-5bb5542ff45e tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:01:08.951409 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-c45a05b4-fae8-4152-806b-5bb5542ff45e tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:01:08.952173 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-c45a05b4-fae8-4152-806b-5bb5542ff45e tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:01:08.952639 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-c45a05b4-fae8-4152-806b-5bb5542ff45e tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:01:08.956260 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-c45a05b4-fae8-4152-806b-5bb5542ff45e tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:01:09.133136 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [req-6936562e-d86d-438d-8248-8b38bdf7d61c req-5564bc78-9a27-4bb2-b28a-6233f27c6ebf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ec88b440-40a0-459f-b94b-06c332e86094", "tag": "290d6de0-525c-40c7-8eec-34ce73fcc7b9"}]} {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 05:01:09.184502 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [req-6936562e-d86d-438d-8248-8b38bdf7d61c req-5564bc78-9a27-4bb2-b28a-6233f27c6ebf service nova] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:01:09.189977 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [req-6936562e-d86d-438d-8248-8b38bdf7d61c req-5564bc78-9a27-4bb2-b28a-6233f27c6ebf service nova] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:01:09.191567 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [req-6936562e-d86d-438d-8248-8b38bdf7d61c req-5564bc78-9a27-4bb2-b28a-6233f27c6ebf service nova] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:01:09.243386 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-c45a05b4-fae8-4152-806b-5bb5542ff45e tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cdd0da2c7bc4139bcd48ef36a2ee183', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a18a3756ba2b460d977f738a115ebfe0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:01:09.264290 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-c45a05b4-fae8-4152-806b-5bb5542ff45e tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] 10.222.0.50 "GET /compute/v2.1/servers/50eed27b-6da2-4dda-94cc-02fc5cfec071" status: 200 len: 1280 microversion: 2.1 time: 0.375966 Sep 24 05:01:09.268229 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 24/49] 10.222.0.50 () {58 vars in 1236 bytes} [Sat Sep 24 05:01:08 2022] GET /compute/v2.1/servers/50eed27b-6da2-4dda-94cc-02fc5cfec071 => generated 1280 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 05:01:09.273596 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-10667bc9-794c-4c62-90dd-dc07307405fb tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Calling method '>' {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:01:09.295949 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.compute.api [None req-10667bc9-794c-4c62-90dd-dc07307405fb tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] [instance: 08fb826b-e891-46c4-990d-ca03cf3f4222] Fetching instance by UUID {{(pid=120593) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:01:09.308456 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: INFO nova.api.openstack.compute.server_external_events [req-6936562e-d86d-438d-8248-8b38bdf7d61c req-5564bc78-9a27-4bb2-b28a-6233f27c6ebf service nova] Creating event network-changed:290d6de0-525c-40c7-8eec-34ce73fcc7b9 for instance ec88b440-40a0-459f-b94b-06c332e86094 on hv-cinder-85918 Sep 24 05:01:09.312887 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [req-6936562e-d86d-438d-8248-8b38bdf7d61c req-5564bc78-9a27-4bb2-b28a-6233f27c6ebf service nova] Acquiring lock "compute-rpcapi-router" {{(pid=120594) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Sep 24 05:01:09.313341 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [req-6936562e-d86d-438d-8248-8b38bdf7d61c req-5564bc78-9a27-4bb2-b28a-6233f27c6ebf service nova] Acquired lock "compute-rpcapi-router" {{(pid=120594) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Sep 24 05:01:09.317926 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-10667bc9-794c-4c62-90dd-dc07307405fb tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:01:09.318744 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-b0e68f7d-b157-496b-b3a3-67d011e31ff8 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:01:09.320511 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-b0e68f7d-b157-496b-b3a3-67d011e31ff8 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:01:09.322551 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-b0e68f7d-b157-496b-b3a3-67d011e31ff8 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:01:09.323465 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-b0e68f7d-b157-496b-b3a3-67d011e31ff8 None None] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:01:09.324281 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-10667bc9-794c-4c62-90dd-dc07307405fb tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:01:09.324776 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-b0e68f7d-b157-496b-b3a3-67d011e31ff8 None None] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:01:09.326597 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-b0e68f7d-b157-496b-b3a3-67d011e31ff8 None None] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:01:09.327299 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-10667bc9-794c-4c62-90dd-dc07307405fb tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:01:09.340905 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-10667bc9-794c-4c62-90dd-dc07307405fb tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:01:09.346851 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-10667bc9-794c-4c62-90dd-dc07307405fb tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:01:09.347505 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-10667bc9-794c-4c62-90dd-dc07307405fb tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:01:09.356491 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: INFO nova.compute.rpcapi [None req-b0e68f7d-b157-496b-b3a3-67d011e31ff8 None None] Automatically selected compute RPC version 6.1 from minimum service version 64 Sep 24 05:01:09.360933 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-b0e68f7d-b157-496b-b3a3-67d011e31ff8 None None] Releasing lock "compute-rpcapi-router" {{(pid=120594) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Sep 24 05:01:09.406916 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [None req-b0e68f7d-b157-496b-b3a3-67d011e31ff8 None None] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.528857 Sep 24 05:01:09.409988 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 26/50] 10.222.0.50 () {64 vars in 1317 bytes} [Sat Sep 24 05:01:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 05:01:09.777493 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-670149a9-c364-4e41-9d43-d4d1ec8286bc tempest-DeleteServersTestJSON-1630660203 tempest-DeleteServersTestJSON-1630660203-project] Calling method '>' {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:01:09.778768 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.compute.api [None req-670149a9-c364-4e41-9d43-d4d1ec8286bc tempest-DeleteServersTestJSON-1630660203 tempest-DeleteServersTestJSON-1630660203-project] [instance: ec88b440-40a0-459f-b94b-06c332e86094] Fetching instance by UUID {{(pid=120594) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:01:09.805005 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-670149a9-c364-4e41-9d43-d4d1ec8286bc tempest-DeleteServersTestJSON-1630660203 tempest-DeleteServersTestJSON-1630660203-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:01:09.806470 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-670149a9-c364-4e41-9d43-d4d1ec8286bc tempest-DeleteServersTestJSON-1630660203 tempest-DeleteServersTestJSON-1630660203-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:01:09.807878 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-670149a9-c364-4e41-9d43-d4d1ec8286bc tempest-DeleteServersTestJSON-1630660203 tempest-DeleteServersTestJSON-1630660203-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:01:09.809030 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-670149a9-c364-4e41-9d43-d4d1ec8286bc tempest-DeleteServersTestJSON-1630660203 tempest-DeleteServersTestJSON-1630660203-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:01:09.810124 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-670149a9-c364-4e41-9d43-d4d1ec8286bc tempest-DeleteServersTestJSON-1630660203 tempest-DeleteServersTestJSON-1630660203-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:01:09.814586 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-670149a9-c364-4e41-9d43-d4d1ec8286bc tempest-DeleteServersTestJSON-1630660203 tempest-DeleteServersTestJSON-1630660203-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:01:10.836395 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-10667bc9-794c-4c62-90dd-dc07307405fb tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0948754217fc4ff2ba0241fa35feaf90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1aaf20f480a423ea5feca81585aeeed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:01:10.859801 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-10667bc9-794c-4c62-90dd-dc07307405fb tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0948754217fc4ff2ba0241fa35feaf90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1aaf20f480a423ea5feca81585aeeed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:01:10.867233 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-10667bc9-794c-4c62-90dd-dc07307405fb tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0948754217fc4ff2ba0241fa35feaf90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1aaf20f480a423ea5feca81585aeeed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:01:10.868412 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-10667bc9-794c-4c62-90dd-dc07307405fb tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] 10.222.0.50 "GET /compute/v2.1/servers/08fb826b-e891-46c4-990d-ca03cf3f4222" status: 200 len: 1284 microversion: 2.20 time: 1.598748 Sep 24 05:01:10.868978 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 25/51] 10.222.0.50 () {60 vars in 1277 bytes} [Sat Sep 24 05:01:09 2022] GET /compute/v2.1/servers/08fb826b-e891-46c4-990d-ca03cf3f4222 => generated 1284 bytes in 1600 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 05:01:10.899941 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-ebb973fe-eb01-4e00-bd53-23405211a244 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Calling method '>' {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:01:10.900836 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.compute.api [None req-ebb973fe-eb01-4e00-bd53-23405211a244 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] [instance: b2daebb8-dfea-4ab9-8253-008a21f906e1] Fetching instance by UUID {{(pid=120593) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:01:10.931348 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-ebb973fe-eb01-4e00-bd53-23405211a244 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:01:10.932153 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-ebb973fe-eb01-4e00-bd53-23405211a244 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:01:10.932885 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-ebb973fe-eb01-4e00-bd53-23405211a244 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:01:10.934971 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-ebb973fe-eb01-4e00-bd53-23405211a244 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:01:10.940174 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.policy [None req-670149a9-c364-4e41-9d43-d4d1ec8286bc tempest-DeleteServersTestJSON-1630660203 tempest-DeleteServersTestJSON-1630660203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27d1a24c9e15493195744bcbf598ac4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa84dfa1cc764dc99b6e804e778c3479', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:01:10.945124 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-ebb973fe-eb01-4e00-bd53-23405211a244 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:01:10.948387 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-ebb973fe-eb01-4e00-bd53-23405211a244 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:01:10.967657 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [None req-670149a9-c364-4e41-9d43-d4d1ec8286bc tempest-DeleteServersTestJSON-1630660203 tempest-DeleteServersTestJSON-1630660203-project] 10.222.0.50 "GET /compute/v2.1/servers/ec88b440-40a0-459f-b94b-06c332e86094" status: 200 len: 1315 microversion: 2.1 time: 1.194411 Sep 24 05:01:10.977683 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 27/52] 10.222.0.50 () {58 vars in 1236 bytes} [Sat Sep 24 05:01:09 2022] GET /compute/v2.1/servers/ec88b440-40a0-459f-b94b-06c332e86094 => generated 1315 bytes in 1203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 05:01:10.989175 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-443a775e-4496-4a6d-bfc8-7b4d52b6accf tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Calling method '>' {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:01:10.989802 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.compute.api [None req-443a775e-4496-4a6d-bfc8-7b4d52b6accf tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] [instance: 50eed27b-6da2-4dda-94cc-02fc5cfec071] Fetching instance by UUID {{(pid=120594) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:01:11.021796 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-443a775e-4496-4a6d-bfc8-7b4d52b6accf tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:01:11.022273 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-443a775e-4496-4a6d-bfc8-7b4d52b6accf tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:01:11.026512 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-443a775e-4496-4a6d-bfc8-7b4d52b6accf tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:01:11.027367 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-443a775e-4496-4a6d-bfc8-7b4d52b6accf tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:01:11.027855 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-443a775e-4496-4a6d-bfc8-7b4d52b6accf tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:01:11.028310 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-443a775e-4496-4a6d-bfc8-7b4d52b6accf tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:01:11.267107 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-ebb973fe-eb01-4e00-bd53-23405211a244 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b1b0448e7f54e3aaae49e411699269e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66ec8bde739145dda504995dbea0914a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:01:11.287511 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-ebb973fe-eb01-4e00-bd53-23405211a244 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] 10.222.0.50 "GET /compute/v2.1/servers/b2daebb8-dfea-4ab9-8253-008a21f906e1" status: 200 len: 1295 microversion: 2.1 time: 0.402113 Sep 24 05:01:11.290111 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 26/53] 10.222.0.50 () {58 vars in 1236 bytes} [Sat Sep 24 05:01:10 2022] GET /compute/v2.1/servers/b2daebb8-dfea-4ab9-8253-008a21f906e1 => generated 1295 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 05:01:11.310342 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.policy [None req-443a775e-4496-4a6d-bfc8-7b4d52b6accf tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cdd0da2c7bc4139bcd48ef36a2ee183', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a18a3756ba2b460d977f738a115ebfe0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:01:11.319595 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [None req-443a775e-4496-4a6d-bfc8-7b4d52b6accf tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] 10.222.0.50 "GET /compute/v2.1/servers/50eed27b-6da2-4dda-94cc-02fc5cfec071" status: 200 len: 1280 microversion: 2.1 time: 0.347518 Sep 24 05:01:11.324977 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 28/54] 10.222.0.50 () {58 vars in 1236 bytes} [Sat Sep 24 05:01:10 2022] GET /compute/v2.1/servers/50eed27b-6da2-4dda-94cc-02fc5cfec071 => generated 1280 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 05:01:11.898163 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-304e2f15-c736-4f71-91f7-46da6433beda tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Calling method '>' {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:01:11.899522 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.compute.api [None req-304e2f15-c736-4f71-91f7-46da6433beda tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] [instance: 08fb826b-e891-46c4-990d-ca03cf3f4222] Fetching instance by UUID {{(pid=120593) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:01:11.918280 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-304e2f15-c736-4f71-91f7-46da6433beda tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:01:11.919150 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-304e2f15-c736-4f71-91f7-46da6433beda tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:01:11.920750 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-304e2f15-c736-4f71-91f7-46da6433beda tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:01:11.921812 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-304e2f15-c736-4f71-91f7-46da6433beda tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:01:11.926618 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-304e2f15-c736-4f71-91f7-46da6433beda tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:01:11.928140 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-304e2f15-c736-4f71-91f7-46da6433beda tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:01:11.994979 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-7130a616-ef96-476c-95e0-d3996f0aebcd tempest-DeleteServersTestJSON-1630660203 tempest-DeleteServersTestJSON-1630660203-project] Calling method '>' {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:01:11.995811 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.compute.api [None req-7130a616-ef96-476c-95e0-d3996f0aebcd tempest-DeleteServersTestJSON-1630660203 tempest-DeleteServersTestJSON-1630660203-project] [instance: ec88b440-40a0-459f-b94b-06c332e86094] Fetching instance by UUID {{(pid=120594) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:01:12.012773 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-7130a616-ef96-476c-95e0-d3996f0aebcd tempest-DeleteServersTestJSON-1630660203 tempest-DeleteServersTestJSON-1630660203-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:01:12.016752 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-7130a616-ef96-476c-95e0-d3996f0aebcd tempest-DeleteServersTestJSON-1630660203 tempest-DeleteServersTestJSON-1630660203-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:01:12.017438 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-7130a616-ef96-476c-95e0-d3996f0aebcd tempest-DeleteServersTestJSON-1630660203 tempest-DeleteServersTestJSON-1630660203-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:01:12.018325 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-7130a616-ef96-476c-95e0-d3996f0aebcd tempest-DeleteServersTestJSON-1630660203 tempest-DeleteServersTestJSON-1630660203-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:01:12.019741 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-7130a616-ef96-476c-95e0-d3996f0aebcd tempest-DeleteServersTestJSON-1630660203 tempest-DeleteServersTestJSON-1630660203-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:01:12.020435 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-7130a616-ef96-476c-95e0-d3996f0aebcd tempest-DeleteServersTestJSON-1630660203 tempest-DeleteServersTestJSON-1630660203-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:01:12.461009 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-304e2f15-c736-4f71-91f7-46da6433beda tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0948754217fc4ff2ba0241fa35feaf90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1aaf20f480a423ea5feca81585aeeed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:01:12.474174 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-304e2f15-c736-4f71-91f7-46da6433beda tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0948754217fc4ff2ba0241fa35feaf90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1aaf20f480a423ea5feca81585aeeed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:01:12.480241 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-304e2f15-c736-4f71-91f7-46da6433beda tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0948754217fc4ff2ba0241fa35feaf90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1aaf20f480a423ea5feca81585aeeed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:01:12.485891 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-304e2f15-c736-4f71-91f7-46da6433beda tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] 10.222.0.50 "GET /compute/v2.1/servers/08fb826b-e891-46c4-990d-ca03cf3f4222" status: 200 len: 1338 microversion: 2.20 time: 0.591993 Sep 24 05:01:12.497790 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 27/55] 10.222.0.50 () {60 vars in 1277 bytes} [Sat Sep 24 05:01:11 2022] GET /compute/v2.1/servers/08fb826b-e891-46c4-990d-ca03cf3f4222 => generated 1338 bytes in 604 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 05:01:12.521134 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-165f244a-8cf2-4f99-9e08-99746d16e9a9 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1466494375", "imageRef": "75ab730a-d8cc-4ea2-b58f-0f3eb476c976", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "17f0f6dc-1b39-4c78-b39c-2031585b359a"}], "security_groups": [{"name": "tempest-securitygroup--551043629"}], "key_name": "tempest-keypair-1733771919", "user_data": "}} {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 05:01:13.129803 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.network.neutron [None req-165f244a-8cf2-4f99-9e08-99746d16e9a9 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] validate_networks() for [('17f0f6dc-1b39-4c78-b39c-2031585b359a', None, None, None, None, None)] {{(pid=120593) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 24 05:01:13.208492 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.policy [None req-7130a616-ef96-476c-95e0-d3996f0aebcd tempest-DeleteServersTestJSON-1630660203 tempest-DeleteServersTestJSON-1630660203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27d1a24c9e15493195744bcbf598ac4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa84dfa1cc764dc99b6e804e778c3479', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:01:13.215964 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [None req-7130a616-ef96-476c-95e0-d3996f0aebcd tempest-DeleteServersTestJSON-1630660203 tempest-DeleteServersTestJSON-1630660203-project] 10.222.0.50 "GET /compute/v2.1/servers/ec88b440-40a0-459f-b94b-06c332e86094" status: 200 len: 1315 microversion: 2.1 time: 1.227040 Sep 24 05:01:13.220871 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 29/56] 10.222.0.50 () {58 vars in 1236 bytes} [Sat Sep 24 05:01:11 2022] GET /compute/v2.1/servers/ec88b440-40a0-459f-b94b-06c332e86094 => generated 1315 bytes in 1232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 05:01:13.225552 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-f4901498-bcd4-47bd-8136-84ad0da3a8d1 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Calling method '>' {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:01:13.226197 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.compute.api [None req-f4901498-bcd4-47bd-8136-84ad0da3a8d1 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] [instance: b2daebb8-dfea-4ab9-8253-008a21f906e1] Fetching instance by UUID {{(pid=120594) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:01:13.262360 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-f4901498-bcd4-47bd-8136-84ad0da3a8d1 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:01:13.262910 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-f4901498-bcd4-47bd-8136-84ad0da3a8d1 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:01:13.263353 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-f4901498-bcd4-47bd-8136-84ad0da3a8d1 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:01:13.264332 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-f4901498-bcd4-47bd-8136-84ad0da3a8d1 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:01:13.264781 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-f4901498-bcd4-47bd-8136-84ad0da3a8d1 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:01:13.266589 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-f4901498-bcd4-47bd-8136-84ad0da3a8d1 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:01:13.298197 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG dbcounter [-] [120593] Writing DB stats nova_cell0:SELECT=4 {{(pid=120593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 05:01:13.336266 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG dbcounter [-] [120593] Writing DB stats nova_cell0:SELECT=28 {{(pid=120593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 05:01:13.581457 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.policy [None req-f4901498-bcd4-47bd-8136-84ad0da3a8d1 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b1b0448e7f54e3aaae49e411699269e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66ec8bde739145dda504995dbea0914a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:01:13.597856 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [None req-f4901498-bcd4-47bd-8136-84ad0da3a8d1 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] 10.222.0.50 "GET /compute/v2.1/servers/b2daebb8-dfea-4ab9-8253-008a21f906e1" status: 200 len: 1363 microversion: 2.1 time: 0.375816 Sep 24 05:01:13.602683 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 30/57] 10.222.0.50 () {58 vars in 1236 bytes} [Sat Sep 24 05:01:13 2022] GET /compute/v2.1/servers/b2daebb8-dfea-4ab9-8253-008a21f906e1 => generated 1363 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 05:01:13.608883 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-6839533d-968b-4962-b61d-0635bfa79740 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Calling method '>' {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:01:13.610377 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.compute.api [None req-6839533d-968b-4962-b61d-0635bfa79740 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] [instance: 50eed27b-6da2-4dda-94cc-02fc5cfec071] Fetching instance by UUID {{(pid=120594) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:01:13.619022 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG dbcounter [-] [120593] Writing DB stats nova_api:SELECT=91,nova_api:INSERT=9 {{(pid=120593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 05:01:13.622125 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-6839533d-968b-4962-b61d-0635bfa79740 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:01:13.622919 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-6839533d-968b-4962-b61d-0635bfa79740 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:01:13.623528 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-6839533d-968b-4962-b61d-0635bfa79740 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:01:13.624859 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-6839533d-968b-4962-b61d-0635bfa79740 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:01:13.625475 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-6839533d-968b-4962-b61d-0635bfa79740 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:01:13.626170 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-6839533d-968b-4962-b61d-0635bfa79740 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:01:14.054233 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.policy [None req-6839533d-968b-4962-b61d-0635bfa79740 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cdd0da2c7bc4139bcd48ef36a2ee183', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a18a3756ba2b460d977f738a115ebfe0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:01:14.064878 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [None req-6839533d-968b-4962-b61d-0635bfa79740 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] 10.222.0.50 "GET /compute/v2.1/servers/50eed27b-6da2-4dda-94cc-02fc5cfec071" status: 200 len: 1322 microversion: 2.1 time: 0.460646 Sep 24 05:01:14.065938 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 31/58] 10.222.0.50 () {58 vars in 1236 bytes} [Sat Sep 24 05:01:13 2022] GET /compute/v2.1/servers/50eed27b-6da2-4dda-94cc-02fc5cfec071 => generated 1322 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 05:01:14.108755 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.virt.hardware [None req-165f244a-8cf2-4f99-9e08-99746d16e9a9 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Flavor limits 0:0:0 {{(pid=120593) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 24 05:01:14.109285 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.virt.hardware [None req-165f244a-8cf2-4f99-9e08-99746d16e9a9 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Image limits 0:0:0 {{(pid=120593) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 24 05:01:14.109984 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.virt.hardware [None req-165f244a-8cf2-4f99-9e08-99746d16e9a9 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Flavor pref 0:0:0 {{(pid=120593) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 24 05:01:14.110639 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.virt.hardware [None req-165f244a-8cf2-4f99-9e08-99746d16e9a9 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Image pref 0:0:0 {{(pid=120593) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 24 05:01:14.111273 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.virt.hardware [None req-165f244a-8cf2-4f99-9e08-99746d16e9a9 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120593) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 24 05:01:14.120607 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-165f244a-8cf2-4f99-9e08-99746d16e9a9 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:01:14.121690 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-165f244a-8cf2-4f99-9e08-99746d16e9a9 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:01:14.122659 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-165f244a-8cf2-4f99-9e08-99746d16e9a9 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:01:14.123740 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-165f244a-8cf2-4f99-9e08-99746d16e9a9 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:01:14.124400 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-165f244a-8cf2-4f99-9e08-99746d16e9a9 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:01:14.125570 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-165f244a-8cf2-4f99-9e08-99746d16e9a9 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:01:14.145629 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.quota [None req-165f244a-8cf2-4f99-9e08-99746d16e9a9 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Getting quotas for project 87d5229e39fe4817b5187068d8acecc7. Resources: {'instances', 'ram', 'cores'} {{(pid=120593) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 24 05:01:14.151966 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.quota [None req-165f244a-8cf2-4f99-9e08-99746d16e9a9 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Getting quotas for user 74a8cc19ab204424ab23c62915ac2bab and project 87d5229e39fe4817b5187068d8acecc7. Resources: {'instances', 'ram', 'cores'} {{(pid=120593) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 24 05:01:14.166376 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.compute.api [None req-165f244a-8cf2-4f99-9e08-99746d16e9a9 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Going to run 1 instances... {{(pid=120593) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 24 05:01:14.168880 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.compute.api [None req-165f244a-8cf2-4f99-9e08-99746d16e9a9 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] [instance: 201433d5-db4e-4e57-a800-42fe5cfc95ca] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='75ab730a-d8cc-4ea2-b58f-0f3eb476c976',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120593) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 24 05:01:14.224681 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-165f244a-8cf2-4f99-9e08-99746d16e9a9 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 1.724669 Sep 24 05:01:14.225802 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 28/59] 10.222.0.50 () {60 vars in 1147 bytes} [Sat Sep 24 05:01:12 2022] POST /compute/v2.1/servers => generated 401 bytes in 1727 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 24 05:01:14.236489 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-e2de6bf7-4d97-4edd-93f5-3fc004f5e50e tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Calling method '>' {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:01:14.237484 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.compute.api [None req-e2de6bf7-4d97-4edd-93f5-3fc004f5e50e tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] [instance: 08fb826b-e891-46c4-990d-ca03cf3f4222] Fetching instance by UUID {{(pid=120593) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:01:14.245374 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-e2de6bf7-4d97-4edd-93f5-3fc004f5e50e tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:01:14.246217 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-e2de6bf7-4d97-4edd-93f5-3fc004f5e50e tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:01:14.246803 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-e2de6bf7-4d97-4edd-93f5-3fc004f5e50e tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:01:14.247919 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-e2de6bf7-4d97-4edd-93f5-3fc004f5e50e tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:01:14.248653 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-e2de6bf7-4d97-4edd-93f5-3fc004f5e50e tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:01:14.249219 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-e2de6bf7-4d97-4edd-93f5-3fc004f5e50e tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:01:14.264870 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [req-fb8c662b-f3a3-4ea4-a5f6-451362d426fa req-c9a8308d-d669-4391-9b4c-459b5600ec8b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "87dcedb5-91c7-4bc3-b46f-124ccffedf78", "tag": "0dd07bd5-e74b-434c-a105-6a9c537c3c96"}]} {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 05:01:14.304694 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [req-fb8c662b-f3a3-4ea4-a5f6-451362d426fa req-c9a8308d-d669-4391-9b4c-459b5600ec8b service nova] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:01:14.305183 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [req-fb8c662b-f3a3-4ea4-a5f6-451362d426fa req-c9a8308d-d669-4391-9b4c-459b5600ec8b service nova] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:01:14.305613 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [req-fb8c662b-f3a3-4ea4-a5f6-451362d426fa req-c9a8308d-d669-4391-9b4c-459b5600ec8b service nova] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:01:14.327843 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: INFO nova.api.openstack.compute.server_external_events [req-fb8c662b-f3a3-4ea4-a5f6-451362d426fa req-c9a8308d-d669-4391-9b4c-459b5600ec8b service nova] Creating event network-changed:0dd07bd5-e74b-434c-a105-6a9c537c3c96 for instance 87dcedb5-91c7-4bc3-b46f-124ccffedf78 on hv-cinder-85918 Sep 24 05:01:14.333067 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [req-fb8c662b-f3a3-4ea4-a5f6-451362d426fa req-c9a8308d-d669-4391-9b4c-459b5600ec8b service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.265822 Sep 24 05:01:14.333661 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 32/60] 10.222.0.50 () {64 vars in 1317 bytes} [Sat Sep 24 05:01:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 05:01:14.339765 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-de1003b6-3238-439c-93c9-c530012c4202 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Calling method '>' {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:01:14.341409 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.compute.api [None req-de1003b6-3238-439c-93c9-c530012c4202 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] [instance: 201433d5-db4e-4e57-a800-42fe5cfc95ca] Fetching instance by UUID {{(pid=120594) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:01:14.387622 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-e2de6bf7-4d97-4edd-93f5-3fc004f5e50e tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0948754217fc4ff2ba0241fa35feaf90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1aaf20f480a423ea5feca81585aeeed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:01:14.397726 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-e2de6bf7-4d97-4edd-93f5-3fc004f5e50e tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0948754217fc4ff2ba0241fa35feaf90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1aaf20f480a423ea5feca81585aeeed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:01:14.413949 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-e2de6bf7-4d97-4edd-93f5-3fc004f5e50e tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0948754217fc4ff2ba0241fa35feaf90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1aaf20f480a423ea5feca81585aeeed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:01:14.417464 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-e2de6bf7-4d97-4edd-93f5-3fc004f5e50e tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] 10.222.0.50 "GET /compute/v2.1/servers/08fb826b-e891-46c4-990d-ca03cf3f4222" status: 200 len: 1338 microversion: 2.20 time: 0.190501 Sep 24 05:01:14.418495 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 29/61] 10.222.0.50 () {60 vars in 1277 bytes} [Sat Sep 24 05:01:14 2022] GET /compute/v2.1/servers/08fb826b-e891-46c4-990d-ca03cf3f4222 => generated 1338 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 05:01:14.433302 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-17f1ec84-50a0-40f2-b9f4-39caf0cecff2 tempest-DeleteServersTestJSON-1630660203 tempest-DeleteServersTestJSON-1630660203-project] Calling method '>' {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:01:14.433931 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.compute.api [None req-17f1ec84-50a0-40f2-b9f4-39caf0cecff2 tempest-DeleteServersTestJSON-1630660203 tempest-DeleteServersTestJSON-1630660203-project] [instance: ec88b440-40a0-459f-b94b-06c332e86094] Fetching instance by UUID {{(pid=120593) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:01:14.436702 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.policy [None req-de1003b6-3238-439c-93c9-c530012c4202 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74a8cc19ab204424ab23c62915ac2bab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87d5229e39fe4817b5187068d8acecc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:01:14.445955 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [None req-de1003b6-3238-439c-93c9-c530012c4202 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] 10.222.0.50 "GET /compute/v2.1/servers/201433d5-db4e-4e57-a800-42fe5cfc95ca" status: 200 len: 1242 microversion: 2.1 time: 0.110567 Sep 24 05:01:14.447616 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-17f1ec84-50a0-40f2-b9f4-39caf0cecff2 tempest-DeleteServersTestJSON-1630660203 tempest-DeleteServersTestJSON-1630660203-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:01:14.448118 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-17f1ec84-50a0-40f2-b9f4-39caf0cecff2 tempest-DeleteServersTestJSON-1630660203 tempest-DeleteServersTestJSON-1630660203-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:01:14.448557 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-17f1ec84-50a0-40f2-b9f4-39caf0cecff2 tempest-DeleteServersTestJSON-1630660203 tempest-DeleteServersTestJSON-1630660203-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:01:14.448741 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 33/62] 10.222.0.50 () {58 vars in 1236 bytes} [Sat Sep 24 05:01:14 2022] GET /compute/v2.1/servers/201433d5-db4e-4e57-a800-42fe5cfc95ca => generated 1242 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 05:01:14.452058 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-17f1ec84-50a0-40f2-b9f4-39caf0cecff2 tempest-DeleteServersTestJSON-1630660203 tempest-DeleteServersTestJSON-1630660203-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:01:14.452533 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-17f1ec84-50a0-40f2-b9f4-39caf0cecff2 tempest-DeleteServersTestJSON-1630660203 tempest-DeleteServersTestJSON-1630660203-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:01:14.453503 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-17f1ec84-50a0-40f2-b9f4-39caf0cecff2 tempest-DeleteServersTestJSON-1630660203 tempest-DeleteServersTestJSON-1630660203-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:01:14.621963 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-17f1ec84-50a0-40f2-b9f4-39caf0cecff2 tempest-DeleteServersTestJSON-1630660203 tempest-DeleteServersTestJSON-1630660203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27d1a24c9e15493195744bcbf598ac4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa84dfa1cc764dc99b6e804e778c3479', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:01:14.625923 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-a68f1f5d-ca9c-41e5-ab54-fb1800552cbe tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Calling method '>' {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:01:14.626773 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.compute.api [None req-a68f1f5d-ca9c-41e5-ab54-fb1800552cbe tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] [instance: b2daebb8-dfea-4ab9-8253-008a21f906e1] Fetching instance by UUID {{(pid=120594) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:01:14.631240 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-17f1ec84-50a0-40f2-b9f4-39caf0cecff2 tempest-DeleteServersTestJSON-1630660203 tempest-DeleteServersTestJSON-1630660203-project] 10.222.0.50 "GET /compute/v2.1/servers/ec88b440-40a0-459f-b94b-06c332e86094" status: 200 len: 1315 microversion: 2.1 time: 0.209422 Sep 24 05:01:14.632501 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 30/63] 10.222.0.50 () {58 vars in 1236 bytes} [Sat Sep 24 05:01:14 2022] GET /compute/v2.1/servers/ec88b440-40a0-459f-b94b-06c332e86094 => generated 1315 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 05:01:14.665332 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-a68f1f5d-ca9c-41e5-ab54-fb1800552cbe tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:01:14.665977 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-a68f1f5d-ca9c-41e5-ab54-fb1800552cbe tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:01:14.666523 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-a68f1f5d-ca9c-41e5-ab54-fb1800552cbe tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:01:14.667332 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-a68f1f5d-ca9c-41e5-ab54-fb1800552cbe tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:01:14.667846 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-a68f1f5d-ca9c-41e5-ab54-fb1800552cbe tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:01:14.668459 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-a68f1f5d-ca9c-41e5-ab54-fb1800552cbe tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:01:14.831786 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.policy [None req-a68f1f5d-ca9c-41e5-ab54-fb1800552cbe tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b1b0448e7f54e3aaae49e411699269e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66ec8bde739145dda504995dbea0914a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:01:14.840120 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [None req-a68f1f5d-ca9c-41e5-ab54-fb1800552cbe tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] 10.222.0.50 "GET /compute/v2.1/servers/b2daebb8-dfea-4ab9-8253-008a21f906e1" status: 200 len: 1363 microversion: 2.1 time: 0.219250 Sep 24 05:01:14.840692 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 34/64] 10.222.0.50 () {58 vars in 1236 bytes} [Sat Sep 24 05:01:14 2022] GET /compute/v2.1/servers/b2daebb8-dfea-4ab9-8253-008a21f906e1 => generated 1363 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 24 05:01:15.090716 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-465bc2a7-b478-4c81-90f7-a20e6a856845 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Calling method '>' {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:01:15.091394 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.compute.api [None req-465bc2a7-b478-4c81-90f7-a20e6a856845 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] [instance: 50eed27b-6da2-4dda-94cc-02fc5cfec071] Fetching instance by UUID {{(pid=120593) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:01:15.097339 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-465bc2a7-b478-4c81-90f7-a20e6a856845 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:01:15.097810 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-465bc2a7-b478-4c81-90f7-a20e6a856845 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:01:15.098450 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-465bc2a7-b478-4c81-90f7-a20e6a856845 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:01:15.099193 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-465bc2a7-b478-4c81-90f7-a20e6a856845 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:01:15.099813 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-465bc2a7-b478-4c81-90f7-a20e6a856845 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:01:15.100226 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-465bc2a7-b478-4c81-90f7-a20e6a856845 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:01:15.245854 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-465bc2a7-b478-4c81-90f7-a20e6a856845 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cdd0da2c7bc4139bcd48ef36a2ee183', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a18a3756ba2b460d977f738a115ebfe0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:01:15.252483 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-465bc2a7-b478-4c81-90f7-a20e6a856845 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] 10.222.0.50 "GET /compute/v2.1/servers/50eed27b-6da2-4dda-94cc-02fc5cfec071" status: 200 len: 1322 microversion: 2.1 time: 0.165906 Sep 24 05:01:15.253040 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 31/65] 10.222.0.50 () {58 vars in 1236 bytes} [Sat Sep 24 05:01:15 2022] GET /compute/v2.1/servers/50eed27b-6da2-4dda-94cc-02fc5cfec071 => generated 1322 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 05:01:15.444939 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-bdd24170-8c0a-477e-9d00-230518aa9dc8 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Calling method '>' {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:01:15.445537 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.compute.api [None req-bdd24170-8c0a-477e-9d00-230518aa9dc8 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] [instance: 08fb826b-e891-46c4-990d-ca03cf3f4222] Fetching instance by UUID {{(pid=120594) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:01:15.451685 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-bdd24170-8c0a-477e-9d00-230518aa9dc8 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:01:15.452109 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-bdd24170-8c0a-477e-9d00-230518aa9dc8 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:01:15.452533 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-bdd24170-8c0a-477e-9d00-230518aa9dc8 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:01:15.453207 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-bdd24170-8c0a-477e-9d00-230518aa9dc8 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:01:15.453646 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-bdd24170-8c0a-477e-9d00-230518aa9dc8 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:01:15.454087 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-bdd24170-8c0a-477e-9d00-230518aa9dc8 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:01:15.471886 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-3fd1e2bf-6d92-439f-827e-01824ed24373 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Calling method '>' {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:01:15.472673 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.compute.api [None req-3fd1e2bf-6d92-439f-827e-01824ed24373 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] [instance: 201433d5-db4e-4e57-a800-42fe5cfc95ca] Fetching instance by UUID {{(pid=120593) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:01:15.479790 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-3fd1e2bf-6d92-439f-827e-01824ed24373 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:01:15.480916 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-3fd1e2bf-6d92-439f-827e-01824ed24373 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:01:15.481571 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-3fd1e2bf-6d92-439f-827e-01824ed24373 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:01:15.482527 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-3fd1e2bf-6d92-439f-827e-01824ed24373 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:01:15.483175 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-3fd1e2bf-6d92-439f-827e-01824ed24373 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:01:15.483855 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-3fd1e2bf-6d92-439f-827e-01824ed24373 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:01:15.527735 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.policy [None req-bdd24170-8c0a-477e-9d00-230518aa9dc8 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0948754217fc4ff2ba0241fa35feaf90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1aaf20f480a423ea5feca81585aeeed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:01:15.534338 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.policy [None req-bdd24170-8c0a-477e-9d00-230518aa9dc8 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0948754217fc4ff2ba0241fa35feaf90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1aaf20f480a423ea5feca81585aeeed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:01:15.535902 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.policy [None req-bdd24170-8c0a-477e-9d00-230518aa9dc8 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0948754217fc4ff2ba0241fa35feaf90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1aaf20f480a423ea5feca81585aeeed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:01:15.537109 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [None req-bdd24170-8c0a-477e-9d00-230518aa9dc8 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] 10.222.0.50 "GET /compute/v2.1/servers/08fb826b-e891-46c4-990d-ca03cf3f4222" status: 200 len: 1338 microversion: 2.20 time: 0.096217 Sep 24 05:01:15.537661 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 35/66] 10.222.0.50 () {60 vars in 1277 bytes} [Sat Sep 24 05:01:15 2022] GET /compute/v2.1/servers/08fb826b-e891-46c4-990d-ca03cf3f4222 => generated 1338 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 24 05:01:15.558812 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-3fd1e2bf-6d92-439f-827e-01824ed24373 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74a8cc19ab204424ab23c62915ac2bab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87d5229e39fe4817b5187068d8acecc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:01:15.566437 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-3fd1e2bf-6d92-439f-827e-01824ed24373 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] 10.222.0.50 "GET /compute/v2.1/servers/201433d5-db4e-4e57-a800-42fe5cfc95ca" status: 200 len: 1246 microversion: 2.1 time: 0.099492 Sep 24 05:01:15.567012 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 32/67] 10.222.0.50 () {58 vars in 1236 bytes} [Sat Sep 24 05:01:15 2022] GET /compute/v2.1/servers/201433d5-db4e-4e57-a800-42fe5cfc95ca => generated 1246 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 24 05:01:15.653824 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-6a384747-7d10-4a31-8e69-c051506832ac tempest-DeleteServersTestJSON-1630660203 tempest-DeleteServersTestJSON-1630660203-project] Calling method '>' {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:01:15.654453 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.compute.api [None req-6a384747-7d10-4a31-8e69-c051506832ac tempest-DeleteServersTestJSON-1630660203 tempest-DeleteServersTestJSON-1630660203-project] [instance: ec88b440-40a0-459f-b94b-06c332e86094] Fetching instance by UUID {{(pid=120594) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:01:15.660889 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-6a384747-7d10-4a31-8e69-c051506832ac tempest-DeleteServersTestJSON-1630660203 tempest-DeleteServersTestJSON-1630660203-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:01:15.661372 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-6a384747-7d10-4a31-8e69-c051506832ac tempest-DeleteServersTestJSON-1630660203 tempest-DeleteServersTestJSON-1630660203-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:01:15.661791 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-6a384747-7d10-4a31-8e69-c051506832ac tempest-DeleteServersTestJSON-1630660203 tempest-DeleteServersTestJSON-1630660203-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:01:15.662501 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-6a384747-7d10-4a31-8e69-c051506832ac tempest-DeleteServersTestJSON-1630660203 tempest-DeleteServersTestJSON-1630660203-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:01:15.662943 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-6a384747-7d10-4a31-8e69-c051506832ac tempest-DeleteServersTestJSON-1630660203 tempest-DeleteServersTestJSON-1630660203-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:01:15.663356 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-6a384747-7d10-4a31-8e69-c051506832ac tempest-DeleteServersTestJSON-1630660203 tempest-DeleteServersTestJSON-1630660203-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:01:15.791634 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.policy [None req-6a384747-7d10-4a31-8e69-c051506832ac tempest-DeleteServersTestJSON-1630660203 tempest-DeleteServersTestJSON-1630660203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27d1a24c9e15493195744bcbf598ac4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa84dfa1cc764dc99b6e804e778c3479', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:01:15.799107 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [None req-6a384747-7d10-4a31-8e69-c051506832ac tempest-DeleteServersTestJSON-1630660203 tempest-DeleteServersTestJSON-1630660203-project] 10.222.0.50 "GET /compute/v2.1/servers/ec88b440-40a0-459f-b94b-06c332e86094" status: 200 len: 1315 microversion: 2.1 time: 0.149107 Sep 24 05:01:15.799663 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 36/68] 10.222.0.50 () {58 vars in 1236 bytes} [Sat Sep 24 05:01:15 2022] GET /compute/v2.1/servers/ec88b440-40a0-459f-b94b-06c332e86094 => generated 1315 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 05:01:15.862956 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-e8338a52-9c6d-4b2b-87cc-9c055c141c7a tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Calling method '>' {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:01:15.863559 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.compute.api [None req-e8338a52-9c6d-4b2b-87cc-9c055c141c7a tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] [instance: b2daebb8-dfea-4ab9-8253-008a21f906e1] Fetching instance by UUID {{(pid=120593) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:01:15.869300 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-e8338a52-9c6d-4b2b-87cc-9c055c141c7a tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:01:15.869779 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-e8338a52-9c6d-4b2b-87cc-9c055c141c7a tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:01:15.870248 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-e8338a52-9c6d-4b2b-87cc-9c055c141c7a tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:01:15.870926 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-e8338a52-9c6d-4b2b-87cc-9c055c141c7a tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:01:15.871373 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-e8338a52-9c6d-4b2b-87cc-9c055c141c7a tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:01:15.871795 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-e8338a52-9c6d-4b2b-87cc-9c055c141c7a tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:01:16.002153 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-e8338a52-9c6d-4b2b-87cc-9c055c141c7a tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b1b0448e7f54e3aaae49e411699269e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66ec8bde739145dda504995dbea0914a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:01:16.009720 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-e8338a52-9c6d-4b2b-87cc-9c055c141c7a tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] 10.222.0.50 "GET /compute/v2.1/servers/b2daebb8-dfea-4ab9-8253-008a21f906e1" status: 200 len: 1363 microversion: 2.1 time: 0.150552 Sep 24 05:01:16.010320 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 33/69] 10.222.0.50 () {58 vars in 1236 bytes} [Sat Sep 24 05:01:15 2022] GET /compute/v2.1/servers/b2daebb8-dfea-4ab9-8253-008a21f906e1 => generated 1363 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 05:01:16.275971 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-572f7b7f-bdf0-434e-996b-bb52554265e7 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Calling method '>' {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:01:16.276575 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.compute.api [None req-572f7b7f-bdf0-434e-996b-bb52554265e7 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] [instance: 50eed27b-6da2-4dda-94cc-02fc5cfec071] Fetching instance by UUID {{(pid=120594) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:01:16.282620 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-572f7b7f-bdf0-434e-996b-bb52554265e7 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:01:16.283096 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-572f7b7f-bdf0-434e-996b-bb52554265e7 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:01:16.283532 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-572f7b7f-bdf0-434e-996b-bb52554265e7 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:01:16.284213 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-572f7b7f-bdf0-434e-996b-bb52554265e7 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:01:16.284660 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-572f7b7f-bdf0-434e-996b-bb52554265e7 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:01:16.285080 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-572f7b7f-bdf0-434e-996b-bb52554265e7 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:01:16.413843 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.policy [None req-572f7b7f-bdf0-434e-996b-bb52554265e7 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cdd0da2c7bc4139bcd48ef36a2ee183', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a18a3756ba2b460d977f738a115ebfe0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:01:16.421466 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [None req-572f7b7f-bdf0-434e-996b-bb52554265e7 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] 10.222.0.50 "GET /compute/v2.1/servers/50eed27b-6da2-4dda-94cc-02fc5cfec071" status: 200 len: 1322 microversion: 2.1 time: 0.149457 Sep 24 05:01:16.422643 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 37/70] 10.222.0.50 () {58 vars in 1236 bytes} [Sat Sep 24 05:01:16 2022] GET /compute/v2.1/servers/50eed27b-6da2-4dda-94cc-02fc5cfec071 => generated 1322 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 05:01:16.562559 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-8ea60deb-9887-4514-9712-660fdde4a4e4 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Calling method '>' {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:01:16.563161 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.compute.api [None req-8ea60deb-9887-4514-9712-660fdde4a4e4 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] [instance: 08fb826b-e891-46c4-990d-ca03cf3f4222] Fetching instance by UUID {{(pid=120593) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:01:16.568990 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-8ea60deb-9887-4514-9712-660fdde4a4e4 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:01:16.569465 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-8ea60deb-9887-4514-9712-660fdde4a4e4 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:01:16.569920 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-8ea60deb-9887-4514-9712-660fdde4a4e4 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:01:16.570617 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-8ea60deb-9887-4514-9712-660fdde4a4e4 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:01:16.571074 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-8ea60deb-9887-4514-9712-660fdde4a4e4 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:01:16.571472 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-8ea60deb-9887-4514-9712-660fdde4a4e4 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:01:16.592531 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-0e25a806-8090-4c58-941e-4633fe8e2dbd tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Calling method '>' {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:01:16.593213 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.compute.api [None req-0e25a806-8090-4c58-941e-4633fe8e2dbd tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] [instance: 201433d5-db4e-4e57-a800-42fe5cfc95ca] Fetching instance by UUID {{(pid=120594) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:01:16.599677 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-0e25a806-8090-4c58-941e-4633fe8e2dbd tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:01:16.600155 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-0e25a806-8090-4c58-941e-4633fe8e2dbd tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:01:16.600636 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-0e25a806-8090-4c58-941e-4633fe8e2dbd tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:01:16.601324 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-0e25a806-8090-4c58-941e-4633fe8e2dbd tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:01:16.601769 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-0e25a806-8090-4c58-941e-4633fe8e2dbd tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:01:16.602215 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-0e25a806-8090-4c58-941e-4633fe8e2dbd tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:01:16.632016 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-8ea60deb-9887-4514-9712-660fdde4a4e4 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0948754217fc4ff2ba0241fa35feaf90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1aaf20f480a423ea5feca81585aeeed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:01:16.640876 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-8ea60deb-9887-4514-9712-660fdde4a4e4 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0948754217fc4ff2ba0241fa35feaf90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1aaf20f480a423ea5feca81585aeeed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:01:16.642600 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-8ea60deb-9887-4514-9712-660fdde4a4e4 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0948754217fc4ff2ba0241fa35feaf90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1aaf20f480a423ea5feca81585aeeed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:01:16.643878 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-8ea60deb-9887-4514-9712-660fdde4a4e4 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] 10.222.0.50 "GET /compute/v2.1/servers/08fb826b-e891-46c4-990d-ca03cf3f4222" status: 200 len: 1338 microversion: 2.20 time: 0.085592 Sep 24 05:01:16.644754 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 34/71] 10.222.0.50 () {60 vars in 1277 bytes} [Sat Sep 24 05:01:16 2022] GET /compute/v2.1/servers/08fb826b-e891-46c4-990d-ca03cf3f4222 => generated 1338 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 05:01:16.670166 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.policy [None req-0e25a806-8090-4c58-941e-4633fe8e2dbd tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74a8cc19ab204424ab23c62915ac2bab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87d5229e39fe4817b5187068d8acecc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:01:16.677869 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [None req-0e25a806-8090-4c58-941e-4633fe8e2dbd tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] 10.222.0.50 "GET /compute/v2.1/servers/201433d5-db4e-4e57-a800-42fe5cfc95ca" status: 200 len: 1246 microversion: 2.1 time: 0.089216 Sep 24 05:01:16.678464 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 38/72] 10.222.0.50 () {58 vars in 1236 bytes} [Sat Sep 24 05:01:16 2022] GET /compute/v2.1/servers/201433d5-db4e-4e57-a800-42fe5cfc95ca => generated 1246 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 24 05:01:16.821696 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-f5a0e456-f7af-4fdf-bb7a-9e1fdebda583 tempest-DeleteServersTestJSON-1630660203 tempest-DeleteServersTestJSON-1630660203-project] Calling method '>' {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:01:16.822264 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.compute.api [None req-f5a0e456-f7af-4fdf-bb7a-9e1fdebda583 tempest-DeleteServersTestJSON-1630660203 tempest-DeleteServersTestJSON-1630660203-project] [instance: ec88b440-40a0-459f-b94b-06c332e86094] Fetching instance by UUID {{(pid=120593) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:01:16.828702 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-f5a0e456-f7af-4fdf-bb7a-9e1fdebda583 tempest-DeleteServersTestJSON-1630660203 tempest-DeleteServersTestJSON-1630660203-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:01:16.829176 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-f5a0e456-f7af-4fdf-bb7a-9e1fdebda583 tempest-DeleteServersTestJSON-1630660203 tempest-DeleteServersTestJSON-1630660203-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:01:16.829608 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-f5a0e456-f7af-4fdf-bb7a-9e1fdebda583 tempest-DeleteServersTestJSON-1630660203 tempest-DeleteServersTestJSON-1630660203-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:01:16.830326 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-f5a0e456-f7af-4fdf-bb7a-9e1fdebda583 tempest-DeleteServersTestJSON-1630660203 tempest-DeleteServersTestJSON-1630660203-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:01:16.830775 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-f5a0e456-f7af-4fdf-bb7a-9e1fdebda583 tempest-DeleteServersTestJSON-1630660203 tempest-DeleteServersTestJSON-1630660203-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:01:16.831193 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-f5a0e456-f7af-4fdf-bb7a-9e1fdebda583 tempest-DeleteServersTestJSON-1630660203 tempest-DeleteServersTestJSON-1630660203-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:01:16.848829 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG dbcounter [-] [120593] Writing DB stats nova_cell1:SELECT=100 {{(pid=120593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 05:01:16.959550 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-f5a0e456-f7af-4fdf-bb7a-9e1fdebda583 tempest-DeleteServersTestJSON-1630660203 tempest-DeleteServersTestJSON-1630660203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27d1a24c9e15493195744bcbf598ac4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa84dfa1cc764dc99b6e804e778c3479', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:01:16.967007 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-f5a0e456-f7af-4fdf-bb7a-9e1fdebda583 tempest-DeleteServersTestJSON-1630660203 tempest-DeleteServersTestJSON-1630660203-project] 10.222.0.50 "GET /compute/v2.1/servers/ec88b440-40a0-459f-b94b-06c332e86094" status: 200 len: 1315 microversion: 2.1 time: 0.149171 Sep 24 05:01:16.967581 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 35/73] 10.222.0.50 () {58 vars in 1236 bytes} [Sat Sep 24 05:01:16 2022] GET /compute/v2.1/servers/ec88b440-40a0-459f-b94b-06c332e86094 => generated 1315 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 05:01:17.032547 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-c6b8563c-1359-4f01-a22a-7630cff68b54 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Calling method '>' {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:01:17.033156 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.compute.api [None req-c6b8563c-1359-4f01-a22a-7630cff68b54 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] [instance: b2daebb8-dfea-4ab9-8253-008a21f906e1] Fetching instance by UUID {{(pid=120594) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:01:17.039065 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-c6b8563c-1359-4f01-a22a-7630cff68b54 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:01:17.039545 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-c6b8563c-1359-4f01-a22a-7630cff68b54 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:01:17.039976 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-c6b8563c-1359-4f01-a22a-7630cff68b54 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:01:17.040659 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-c6b8563c-1359-4f01-a22a-7630cff68b54 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:01:17.041111 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-c6b8563c-1359-4f01-a22a-7630cff68b54 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:01:17.041530 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-c6b8563c-1359-4f01-a22a-7630cff68b54 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:01:17.188863 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.policy [None req-c6b8563c-1359-4f01-a22a-7630cff68b54 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b1b0448e7f54e3aaae49e411699269e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66ec8bde739145dda504995dbea0914a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:01:17.199592 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [None req-c6b8563c-1359-4f01-a22a-7630cff68b54 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] 10.222.0.50 "GET /compute/v2.1/servers/b2daebb8-dfea-4ab9-8253-008a21f906e1" status: 200 len: 1363 microversion: 2.1 time: 0.170839 Sep 24 05:01:17.200523 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 39/74] 10.222.0.50 () {58 vars in 1236 bytes} [Sat Sep 24 05:01:17 2022] GET /compute/v2.1/servers/b2daebb8-dfea-4ab9-8253-008a21f906e1 => generated 1363 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 05:01:17.449986 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-56d98bb2-26f4-4e27-a6d5-8558060cb2d1 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Calling method '>' {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:01:17.450541 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.compute.api [None req-56d98bb2-26f4-4e27-a6d5-8558060cb2d1 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] [instance: 50eed27b-6da2-4dda-94cc-02fc5cfec071] Fetching instance by UUID {{(pid=120593) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:01:17.456543 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-56d98bb2-26f4-4e27-a6d5-8558060cb2d1 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:01:17.457024 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-56d98bb2-26f4-4e27-a6d5-8558060cb2d1 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:01:17.457459 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-56d98bb2-26f4-4e27-a6d5-8558060cb2d1 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:01:17.458499 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-56d98bb2-26f4-4e27-a6d5-8558060cb2d1 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:01:17.459034 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-56d98bb2-26f4-4e27-a6d5-8558060cb2d1 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:01:17.459462 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-56d98bb2-26f4-4e27-a6d5-8558060cb2d1 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:01:17.595480 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-56d98bb2-26f4-4e27-a6d5-8558060cb2d1 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cdd0da2c7bc4139bcd48ef36a2ee183', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a18a3756ba2b460d977f738a115ebfe0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:01:17.605657 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-56d98bb2-26f4-4e27-a6d5-8558060cb2d1 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] 10.222.0.50 "GET /compute/v2.1/servers/50eed27b-6da2-4dda-94cc-02fc5cfec071" status: 200 len: 1322 microversion: 2.1 time: 0.164921 Sep 24 05:01:17.607040 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 36/75] 10.222.0.50 () {58 vars in 1236 bytes} [Sat Sep 24 05:01:17 2022] GET /compute/v2.1/servers/50eed27b-6da2-4dda-94cc-02fc5cfec071 => generated 1322 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 05:01:17.669072 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-2ce63e58-dd84-4c2e-841b-7e27faf054d3 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Calling method '>' {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:01:17.670442 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.compute.api [None req-2ce63e58-dd84-4c2e-841b-7e27faf054d3 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] [instance: 08fb826b-e891-46c4-990d-ca03cf3f4222] Fetching instance by UUID {{(pid=120594) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:01:17.680438 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-2ce63e58-dd84-4c2e-841b-7e27faf054d3 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:01:17.681073 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-2ce63e58-dd84-4c2e-841b-7e27faf054d3 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:01:17.681520 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-2ce63e58-dd84-4c2e-841b-7e27faf054d3 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:01:17.682262 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-2ce63e58-dd84-4c2e-841b-7e27faf054d3 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:01:17.682714 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-2ce63e58-dd84-4c2e-841b-7e27faf054d3 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:01:17.683134 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-2ce63e58-dd84-4c2e-841b-7e27faf054d3 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:01:17.700396 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-24706715-10e0-42bd-9572-ae1a1775d5ee tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Calling method '>' {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:01:17.700941 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.compute.api [None req-24706715-10e0-42bd-9572-ae1a1775d5ee tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] [instance: 201433d5-db4e-4e57-a800-42fe5cfc95ca] Fetching instance by UUID {{(pid=120593) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:01:17.715055 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-24706715-10e0-42bd-9572-ae1a1775d5ee tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:01:17.715055 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-24706715-10e0-42bd-9572-ae1a1775d5ee tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:01:17.715055 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-24706715-10e0-42bd-9572-ae1a1775d5ee tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:01:17.715055 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-24706715-10e0-42bd-9572-ae1a1775d5ee tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:01:17.715682 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-24706715-10e0-42bd-9572-ae1a1775d5ee tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:01:17.715682 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-24706715-10e0-42bd-9572-ae1a1775d5ee tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:01:17.797819 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.policy [None req-2ce63e58-dd84-4c2e-841b-7e27faf054d3 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0948754217fc4ff2ba0241fa35feaf90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1aaf20f480a423ea5feca81585aeeed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:01:17.810126 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.policy [None req-2ce63e58-dd84-4c2e-841b-7e27faf054d3 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0948754217fc4ff2ba0241fa35feaf90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1aaf20f480a423ea5feca81585aeeed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:01:17.812012 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.policy [None req-2ce63e58-dd84-4c2e-841b-7e27faf054d3 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0948754217fc4ff2ba0241fa35feaf90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1aaf20f480a423ea5feca81585aeeed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:01:17.814333 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [None req-2ce63e58-dd84-4c2e-841b-7e27faf054d3 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] 10.222.0.50 "GET /compute/v2.1/servers/08fb826b-e891-46c4-990d-ca03cf3f4222" status: 200 len: 1338 microversion: 2.20 time: 0.149371 Sep 24 05:01:17.815600 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 40/76] 10.222.0.50 () {60 vars in 1277 bytes} [Sat Sep 24 05:01:17 2022] GET /compute/v2.1/servers/08fb826b-e891-46c4-990d-ca03cf3f4222 => generated 1338 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 05:01:17.830108 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-24706715-10e0-42bd-9572-ae1a1775d5ee tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74a8cc19ab204424ab23c62915ac2bab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87d5229e39fe4817b5187068d8acecc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:01:17.838926 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-24706715-10e0-42bd-9572-ae1a1775d5ee tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] 10.222.0.50 "GET /compute/v2.1/servers/201433d5-db4e-4e57-a800-42fe5cfc95ca" status: 200 len: 1246 microversion: 2.1 time: 0.142229 Sep 24 05:01:17.839506 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 37/77] 10.222.0.50 () {58 vars in 1236 bytes} [Sat Sep 24 05:01:17 2022] GET /compute/v2.1/servers/201433d5-db4e-4e57-a800-42fe5cfc95ca => generated 1246 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 05:01:17.995697 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-b045ae78-1df4-4bcb-8830-f49bcb1aa132 tempest-DeleteServersTestJSON-1630660203 tempest-DeleteServersTestJSON-1630660203-project] Calling method '>' {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:01:17.996300 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.compute.api [None req-b045ae78-1df4-4bcb-8830-f49bcb1aa132 tempest-DeleteServersTestJSON-1630660203 tempest-DeleteServersTestJSON-1630660203-project] [instance: ec88b440-40a0-459f-b94b-06c332e86094] Fetching instance by UUID {{(pid=120594) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:01:18.021115 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-b045ae78-1df4-4bcb-8830-f49bcb1aa132 tempest-DeleteServersTestJSON-1630660203 tempest-DeleteServersTestJSON-1630660203-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:01:18.022524 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-b045ae78-1df4-4bcb-8830-f49bcb1aa132 tempest-DeleteServersTestJSON-1630660203 tempest-DeleteServersTestJSON-1630660203-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:01:18.023855 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-b045ae78-1df4-4bcb-8830-f49bcb1aa132 tempest-DeleteServersTestJSON-1630660203 tempest-DeleteServersTestJSON-1630660203-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:01:18.025673 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-b045ae78-1df4-4bcb-8830-f49bcb1aa132 tempest-DeleteServersTestJSON-1630660203 tempest-DeleteServersTestJSON-1630660203-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:01:18.027148 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-b045ae78-1df4-4bcb-8830-f49bcb1aa132 tempest-DeleteServersTestJSON-1630660203 tempest-DeleteServersTestJSON-1630660203-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:01:18.029663 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-b045ae78-1df4-4bcb-8830-f49bcb1aa132 tempest-DeleteServersTestJSON-1630660203 tempest-DeleteServersTestJSON-1630660203-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:01:18.103336 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG dbcounter [-] [120594] Writing DB stats nova_cell1:SELECT=100 {{(pid=120594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 05:01:18.224410 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.policy [None req-b045ae78-1df4-4bcb-8830-f49bcb1aa132 tempest-DeleteServersTestJSON-1630660203 tempest-DeleteServersTestJSON-1630660203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27d1a24c9e15493195744bcbf598ac4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa84dfa1cc764dc99b6e804e778c3479', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:01:18.228054 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-17c60fdc-1b3a-4375-82f2-e46239fe0519 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Calling method '>' {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:01:18.228661 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.compute.api [None req-17c60fdc-1b3a-4375-82f2-e46239fe0519 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] [instance: b2daebb8-dfea-4ab9-8253-008a21f906e1] Fetching instance by UUID {{(pid=120593) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:01:18.231992 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [None req-b045ae78-1df4-4bcb-8830-f49bcb1aa132 tempest-DeleteServersTestJSON-1630660203 tempest-DeleteServersTestJSON-1630660203-project] 10.222.0.50 "GET /compute/v2.1/servers/ec88b440-40a0-459f-b94b-06c332e86094" status: 200 len: 1315 microversion: 2.1 time: 0.242422 Sep 24 05:01:18.232553 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 41/78] 10.222.0.50 () {58 vars in 1236 bytes} [Sat Sep 24 05:01:17 2022] GET /compute/v2.1/servers/ec88b440-40a0-459f-b94b-06c332e86094 => generated 1315 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 05:01:18.235027 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-17c60fdc-1b3a-4375-82f2-e46239fe0519 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:01:18.235520 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-17c60fdc-1b3a-4375-82f2-e46239fe0519 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:01:18.235937 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-17c60fdc-1b3a-4375-82f2-e46239fe0519 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:01:18.236622 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-17c60fdc-1b3a-4375-82f2-e46239fe0519 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:01:18.237077 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-17c60fdc-1b3a-4375-82f2-e46239fe0519 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:01:18.237497 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-17c60fdc-1b3a-4375-82f2-e46239fe0519 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:01:18.397033 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-17c60fdc-1b3a-4375-82f2-e46239fe0519 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b1b0448e7f54e3aaae49e411699269e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66ec8bde739145dda504995dbea0914a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:01:18.405342 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-17c60fdc-1b3a-4375-82f2-e46239fe0519 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] 10.222.0.50 "GET /compute/v2.1/servers/b2daebb8-dfea-4ab9-8253-008a21f906e1" status: 200 len: 1363 microversion: 2.1 time: 0.181005 Sep 24 05:01:18.406442 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 38/79] 10.222.0.50 () {58 vars in 1236 bytes} [Sat Sep 24 05:01:18 2022] GET /compute/v2.1/servers/b2daebb8-dfea-4ab9-8253-008a21f906e1 => generated 1363 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 24 05:01:18.629069 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-d0eb6397-b8f2-4f37-bfc7-b8637f383ff2 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Calling method '>' {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:01:18.630098 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.compute.api [None req-d0eb6397-b8f2-4f37-bfc7-b8637f383ff2 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] [instance: 50eed27b-6da2-4dda-94cc-02fc5cfec071] Fetching instance by UUID {{(pid=120594) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:01:18.637012 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-d0eb6397-b8f2-4f37-bfc7-b8637f383ff2 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:01:18.637505 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-d0eb6397-b8f2-4f37-bfc7-b8637f383ff2 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:01:18.637977 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-d0eb6397-b8f2-4f37-bfc7-b8637f383ff2 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:01:18.638711 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-d0eb6397-b8f2-4f37-bfc7-b8637f383ff2 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:01:18.639470 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-d0eb6397-b8f2-4f37-bfc7-b8637f383ff2 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:01:18.639898 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-d0eb6397-b8f2-4f37-bfc7-b8637f383ff2 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:01:18.778456 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.policy [None req-d0eb6397-b8f2-4f37-bfc7-b8637f383ff2 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cdd0da2c7bc4139bcd48ef36a2ee183', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a18a3756ba2b460d977f738a115ebfe0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:01:18.787013 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [None req-d0eb6397-b8f2-4f37-bfc7-b8637f383ff2 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] 10.222.0.50 "GET /compute/v2.1/servers/50eed27b-6da2-4dda-94cc-02fc5cfec071" status: 200 len: 1322 microversion: 2.1 time: 0.162272 Sep 24 05:01:18.787586 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 42/80] 10.222.0.50 () {58 vars in 1236 bytes} [Sat Sep 24 05:01:18 2022] GET /compute/v2.1/servers/50eed27b-6da2-4dda-94cc-02fc5cfec071 => generated 1322 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 05:01:18.839473 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-d3296bd4-4fba-4911-b3c5-d9479c363547 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Calling method '>' {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:01:18.840736 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.compute.api [None req-d3296bd4-4fba-4911-b3c5-d9479c363547 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] [instance: 08fb826b-e891-46c4-990d-ca03cf3f4222] Fetching instance by UUID {{(pid=120593) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:01:18.847461 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-d3296bd4-4fba-4911-b3c5-d9479c363547 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:01:18.847945 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-d3296bd4-4fba-4911-b3c5-d9479c363547 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:01:18.848377 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-d3296bd4-4fba-4911-b3c5-d9479c363547 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:01:18.849078 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-d3296bd4-4fba-4911-b3c5-d9479c363547 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:01:18.849525 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-d3296bd4-4fba-4911-b3c5-d9479c363547 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:01:18.849948 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-d3296bd4-4fba-4911-b3c5-d9479c363547 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:01:18.863467 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-e8815a77-38c1-4c83-bbcf-c11704c00fc4 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Calling method '>' {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:01:18.864067 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.compute.api [None req-e8815a77-38c1-4c83-bbcf-c11704c00fc4 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] [instance: 201433d5-db4e-4e57-a800-42fe5cfc95ca] Fetching instance by UUID {{(pid=120594) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:01:18.867090 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG dbcounter [-] [120594] Writing DB stats nova_api:SELECT=91,nova_api:INSERT=9 {{(pid=120594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 05:01:18.871188 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-e8815a77-38c1-4c83-bbcf-c11704c00fc4 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:01:18.871672 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-e8815a77-38c1-4c83-bbcf-c11704c00fc4 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:01:18.872101 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-e8815a77-38c1-4c83-bbcf-c11704c00fc4 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:01:18.874095 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-e8815a77-38c1-4c83-bbcf-c11704c00fc4 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:01:18.874095 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-e8815a77-38c1-4c83-bbcf-c11704c00fc4 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:01:18.874095 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-e8815a77-38c1-4c83-bbcf-c11704c00fc4 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:01:18.916404 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-d3296bd4-4fba-4911-b3c5-d9479c363547 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0948754217fc4ff2ba0241fa35feaf90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1aaf20f480a423ea5feca81585aeeed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:01:18.929379 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-d3296bd4-4fba-4911-b3c5-d9479c363547 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0948754217fc4ff2ba0241fa35feaf90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1aaf20f480a423ea5feca81585aeeed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:01:18.930854 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-d3296bd4-4fba-4911-b3c5-d9479c363547 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0948754217fc4ff2ba0241fa35feaf90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1aaf20f480a423ea5feca81585aeeed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:01:18.931975 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-d3296bd4-4fba-4911-b3c5-d9479c363547 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] 10.222.0.50 "GET /compute/v2.1/servers/08fb826b-e891-46c4-990d-ca03cf3f4222" status: 200 len: 1338 microversion: 2.20 time: 0.096423 Sep 24 05:01:18.932537 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 39/81] 10.222.0.50 () {60 vars in 1277 bytes} [Sat Sep 24 05:01:18 2022] GET /compute/v2.1/servers/08fb826b-e891-46c4-990d-ca03cf3f4222 => generated 1338 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 05:01:18.949715 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.policy [None req-e8815a77-38c1-4c83-bbcf-c11704c00fc4 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74a8cc19ab204424ab23c62915ac2bab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87d5229e39fe4817b5187068d8acecc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:01:18.962504 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [None req-e8815a77-38c1-4c83-bbcf-c11704c00fc4 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] 10.222.0.50 "GET /compute/v2.1/servers/201433d5-db4e-4e57-a800-42fe5cfc95ca" status: 200 len: 1246 microversion: 2.1 time: 0.102671 Sep 24 05:01:18.963405 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 43/82] 10.222.0.50 () {58 vars in 1236 bytes} [Sat Sep 24 05:01:18 2022] GET /compute/v2.1/servers/201433d5-db4e-4e57-a800-42fe5cfc95ca => generated 1246 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 24 05:01:19.254656 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-3e01291e-5d00-43e5-a993-2c15b7628253 tempest-DeleteServersTestJSON-1630660203 tempest-DeleteServersTestJSON-1630660203-project] Calling method '>' {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:01:19.255180 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.compute.api [None req-3e01291e-5d00-43e5-a993-2c15b7628253 tempest-DeleteServersTestJSON-1630660203 tempest-DeleteServersTestJSON-1630660203-project] [instance: ec88b440-40a0-459f-b94b-06c332e86094] Fetching instance by UUID {{(pid=120593) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:01:19.261391 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-3e01291e-5d00-43e5-a993-2c15b7628253 tempest-DeleteServersTestJSON-1630660203 tempest-DeleteServersTestJSON-1630660203-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:01:19.261858 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-3e01291e-5d00-43e5-a993-2c15b7628253 tempest-DeleteServersTestJSON-1630660203 tempest-DeleteServersTestJSON-1630660203-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:01:19.262316 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-3e01291e-5d00-43e5-a993-2c15b7628253 tempest-DeleteServersTestJSON-1630660203 tempest-DeleteServersTestJSON-1630660203-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:01:19.262988 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-3e01291e-5d00-43e5-a993-2c15b7628253 tempest-DeleteServersTestJSON-1630660203 tempest-DeleteServersTestJSON-1630660203-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:01:19.263435 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-3e01291e-5d00-43e5-a993-2c15b7628253 tempest-DeleteServersTestJSON-1630660203 tempest-DeleteServersTestJSON-1630660203-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:01:19.263844 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-3e01291e-5d00-43e5-a993-2c15b7628253 tempest-DeleteServersTestJSON-1630660203 tempest-DeleteServersTestJSON-1630660203-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:01:19.388579 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-3e01291e-5d00-43e5-a993-2c15b7628253 tempest-DeleteServersTestJSON-1630660203 tempest-DeleteServersTestJSON-1630660203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27d1a24c9e15493195744bcbf598ac4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa84dfa1cc764dc99b6e804e778c3479', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:01:19.396906 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-3e01291e-5d00-43e5-a993-2c15b7628253 tempest-DeleteServersTestJSON-1630660203 tempest-DeleteServersTestJSON-1630660203-project] 10.222.0.50 "GET /compute/v2.1/servers/ec88b440-40a0-459f-b94b-06c332e86094" status: 200 len: 1315 microversion: 2.1 time: 0.145948 Sep 24 05:01:19.397477 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 40/83] 10.222.0.50 () {58 vars in 1236 bytes} [Sat Sep 24 05:01:19 2022] GET /compute/v2.1/servers/ec88b440-40a0-459f-b94b-06c332e86094 => generated 1315 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 05:01:19.428528 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-8b0cb22d-a868-483d-8286-611fe32cdfd3 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Calling method '>' {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:01:19.429132 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.compute.api [None req-8b0cb22d-a868-483d-8286-611fe32cdfd3 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] [instance: b2daebb8-dfea-4ab9-8253-008a21f906e1] Fetching instance by UUID {{(pid=120594) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:01:19.430946 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG dbcounter [-] [120594] Writing DB stats nova_cell0:SELECT=8 {{(pid=120594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 05:01:19.436051 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-8b0cb22d-a868-483d-8286-611fe32cdfd3 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:01:19.436522 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-8b0cb22d-a868-483d-8286-611fe32cdfd3 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:01:19.436950 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-8b0cb22d-a868-483d-8286-611fe32cdfd3 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:01:19.437631 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-8b0cb22d-a868-483d-8286-611fe32cdfd3 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:01:19.438103 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-8b0cb22d-a868-483d-8286-611fe32cdfd3 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:01:19.438521 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-8b0cb22d-a868-483d-8286-611fe32cdfd3 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:01:19.563490 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.policy [None req-8b0cb22d-a868-483d-8286-611fe32cdfd3 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b1b0448e7f54e3aaae49e411699269e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66ec8bde739145dda504995dbea0914a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:01:19.570978 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [None req-8b0cb22d-a868-483d-8286-611fe32cdfd3 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] 10.222.0.50 "GET /compute/v2.1/servers/b2daebb8-dfea-4ab9-8253-008a21f906e1" status: 200 len: 1363 microversion: 2.1 time: 0.146206 Sep 24 05:01:19.571539 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 44/84] 10.222.0.50 () {58 vars in 1236 bytes} [Sat Sep 24 05:01:19 2022] GET /compute/v2.1/servers/b2daebb8-dfea-4ab9-8253-008a21f906e1 => generated 1363 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 05:01:19.809785 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-7707f76b-67a0-42c8-b613-a635fa735d64 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Calling method '>' {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:01:19.810349 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.compute.api [None req-7707f76b-67a0-42c8-b613-a635fa735d64 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] [instance: 50eed27b-6da2-4dda-94cc-02fc5cfec071] Fetching instance by UUID {{(pid=120593) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:01:19.817076 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-7707f76b-67a0-42c8-b613-a635fa735d64 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:01:19.817559 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-7707f76b-67a0-42c8-b613-a635fa735d64 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:01:19.818002 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-7707f76b-67a0-42c8-b613-a635fa735d64 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:01:19.818738 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-7707f76b-67a0-42c8-b613-a635fa735d64 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:01:19.819236 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-7707f76b-67a0-42c8-b613-a635fa735d64 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:01:19.819658 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-7707f76b-67a0-42c8-b613-a635fa735d64 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:01:19.948784 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-7707f76b-67a0-42c8-b613-a635fa735d64 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cdd0da2c7bc4139bcd48ef36a2ee183', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a18a3756ba2b460d977f738a115ebfe0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:01:19.956529 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-ae7d30aa-53b7-4f1f-b34d-dd637d4b7d66 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Calling method '>' {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:01:19.957133 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.compute.api [None req-ae7d30aa-53b7-4f1f-b34d-dd637d4b7d66 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] [instance: 08fb826b-e891-46c4-990d-ca03cf3f4222] Fetching instance by UUID {{(pid=120594) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:01:19.957260 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-7707f76b-67a0-42c8-b613-a635fa735d64 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] 10.222.0.50 "GET /compute/v2.1/servers/50eed27b-6da2-4dda-94cc-02fc5cfec071" status: 200 len: 1322 microversion: 2.1 time: 0.151337 Sep 24 05:01:19.957834 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 41/85] 10.222.0.50 () {58 vars in 1236 bytes} [Sat Sep 24 05:01:19 2022] GET /compute/v2.1/servers/50eed27b-6da2-4dda-94cc-02fc5cfec071 => generated 1322 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 05:01:19.963055 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-ae7d30aa-53b7-4f1f-b34d-dd637d4b7d66 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:01:19.963527 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-ae7d30aa-53b7-4f1f-b34d-dd637d4b7d66 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:01:19.963958 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-ae7d30aa-53b7-4f1f-b34d-dd637d4b7d66 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:01:19.964631 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-ae7d30aa-53b7-4f1f-b34d-dd637d4b7d66 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:01:19.965072 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-ae7d30aa-53b7-4f1f-b34d-dd637d4b7d66 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:01:19.965484 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-ae7d30aa-53b7-4f1f-b34d-dd637d4b7d66 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:01:19.985466 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-fb8fed2a-bd55-44d4-929c-b852afdccec8 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Calling method '>' {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:01:19.986095 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.compute.api [None req-fb8fed2a-bd55-44d4-929c-b852afdccec8 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] [instance: 201433d5-db4e-4e57-a800-42fe5cfc95ca] Fetching instance by UUID {{(pid=120593) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:01:19.991913 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-fb8fed2a-bd55-44d4-929c-b852afdccec8 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:01:19.992391 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-fb8fed2a-bd55-44d4-929c-b852afdccec8 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:01:19.992825 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-fb8fed2a-bd55-44d4-929c-b852afdccec8 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:01:19.993507 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-fb8fed2a-bd55-44d4-929c-b852afdccec8 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:01:19.993948 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-fb8fed2a-bd55-44d4-929c-b852afdccec8 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:01:19.994405 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-fb8fed2a-bd55-44d4-929c-b852afdccec8 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:01:20.027020 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.policy [None req-ae7d30aa-53b7-4f1f-b34d-dd637d4b7d66 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0948754217fc4ff2ba0241fa35feaf90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1aaf20f480a423ea5feca81585aeeed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:01:20.035327 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.policy [None req-ae7d30aa-53b7-4f1f-b34d-dd637d4b7d66 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0948754217fc4ff2ba0241fa35feaf90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1aaf20f480a423ea5feca81585aeeed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:01:20.036932 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.policy [None req-ae7d30aa-53b7-4f1f-b34d-dd637d4b7d66 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0948754217fc4ff2ba0241fa35feaf90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1aaf20f480a423ea5feca81585aeeed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:01:20.038042 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [None req-ae7d30aa-53b7-4f1f-b34d-dd637d4b7d66 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] 10.222.0.50 "GET /compute/v2.1/servers/08fb826b-e891-46c4-990d-ca03cf3f4222" status: 200 len: 1338 microversion: 2.20 time: 0.085874 Sep 24 05:01:20.038792 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 45/86] 10.222.0.50 () {60 vars in 1277 bytes} [Sat Sep 24 05:01:19 2022] GET /compute/v2.1/servers/08fb826b-e891-46c4-990d-ca03cf3f4222 => generated 1338 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 24 05:01:20.055062 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-fb8fed2a-bd55-44d4-929c-b852afdccec8 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74a8cc19ab204424ab23c62915ac2bab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87d5229e39fe4817b5187068d8acecc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:01:20.064739 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-fb8fed2a-bd55-44d4-929c-b852afdccec8 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] 10.222.0.50 "GET /compute/v2.1/servers/201433d5-db4e-4e57-a800-42fe5cfc95ca" status: 200 len: 1246 microversion: 2.1 time: 0.082866 Sep 24 05:01:20.065240 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 42/87] 10.222.0.50 () {58 vars in 1236 bytes} [Sat Sep 24 05:01:19 2022] GET /compute/v2.1/servers/201433d5-db4e-4e57-a800-42fe5cfc95ca => generated 1246 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 24 05:01:20.421523 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-0920064c-b025-4feb-9657-f933b777fe4c tempest-DeleteServersTestJSON-1630660203 tempest-DeleteServersTestJSON-1630660203-project] Calling method '>' {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:01:20.422159 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.compute.api [None req-0920064c-b025-4feb-9657-f933b777fe4c tempest-DeleteServersTestJSON-1630660203 tempest-DeleteServersTestJSON-1630660203-project] [instance: ec88b440-40a0-459f-b94b-06c332e86094] Fetching instance by UUID {{(pid=120594) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:01:20.428269 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-0920064c-b025-4feb-9657-f933b777fe4c tempest-DeleteServersTestJSON-1630660203 tempest-DeleteServersTestJSON-1630660203-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:01:20.428818 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-0920064c-b025-4feb-9657-f933b777fe4c tempest-DeleteServersTestJSON-1630660203 tempest-DeleteServersTestJSON-1630660203-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:01:20.429256 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-0920064c-b025-4feb-9657-f933b777fe4c tempest-DeleteServersTestJSON-1630660203 tempest-DeleteServersTestJSON-1630660203-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:01:20.429936 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-0920064c-b025-4feb-9657-f933b777fe4c tempest-DeleteServersTestJSON-1630660203 tempest-DeleteServersTestJSON-1630660203-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:01:20.430417 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-0920064c-b025-4feb-9657-f933b777fe4c tempest-DeleteServersTestJSON-1630660203 tempest-DeleteServersTestJSON-1630660203-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:01:20.430834 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-0920064c-b025-4feb-9657-f933b777fe4c tempest-DeleteServersTestJSON-1630660203 tempest-DeleteServersTestJSON-1630660203-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:01:20.558099 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.policy [None req-0920064c-b025-4feb-9657-f933b777fe4c tempest-DeleteServersTestJSON-1630660203 tempest-DeleteServersTestJSON-1630660203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27d1a24c9e15493195744bcbf598ac4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa84dfa1cc764dc99b6e804e778c3479', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:01:20.566124 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [None req-0920064c-b025-4feb-9657-f933b777fe4c tempest-DeleteServersTestJSON-1630660203 tempest-DeleteServersTestJSON-1630660203-project] 10.222.0.50 "GET /compute/v2.1/servers/ec88b440-40a0-459f-b94b-06c332e86094" status: 200 len: 1315 microversion: 2.1 time: 0.148401 Sep 24 05:01:20.566687 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 46/88] 10.222.0.50 () {58 vars in 1236 bytes} [Sat Sep 24 05:01:20 2022] GET /compute/v2.1/servers/ec88b440-40a0-459f-b94b-06c332e86094 => generated 1315 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 05:01:20.592933 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-ee3aedfb-f066-43de-8d11-24dd86be960c tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Calling method '>' {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:01:20.593586 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.compute.api [None req-ee3aedfb-f066-43de-8d11-24dd86be960c tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] [instance: b2daebb8-dfea-4ab9-8253-008a21f906e1] Fetching instance by UUID {{(pid=120593) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:01:20.599897 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-ee3aedfb-f066-43de-8d11-24dd86be960c tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:01:20.600388 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-ee3aedfb-f066-43de-8d11-24dd86be960c tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:01:20.600825 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-ee3aedfb-f066-43de-8d11-24dd86be960c tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:01:20.601560 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-ee3aedfb-f066-43de-8d11-24dd86be960c tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:01:20.602196 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-ee3aedfb-f066-43de-8d11-24dd86be960c tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:01:20.602621 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-ee3aedfb-f066-43de-8d11-24dd86be960c tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:01:20.734101 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-ee3aedfb-f066-43de-8d11-24dd86be960c tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b1b0448e7f54e3aaae49e411699269e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66ec8bde739145dda504995dbea0914a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:01:20.741750 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-ee3aedfb-f066-43de-8d11-24dd86be960c tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] 10.222.0.50 "GET /compute/v2.1/servers/b2daebb8-dfea-4ab9-8253-008a21f906e1" status: 200 len: 1363 microversion: 2.1 time: 0.152833 Sep 24 05:01:20.742354 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 43/89] 10.222.0.50 () {58 vars in 1236 bytes} [Sat Sep 24 05:01:20 2022] GET /compute/v2.1/servers/b2daebb8-dfea-4ab9-8253-008a21f906e1 => generated 1363 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 05:01:20.979648 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-8e89866e-6d2f-41e2-9d70-f774cca5e9af tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Calling method '>' {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:01:20.980258 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.compute.api [None req-8e89866e-6d2f-41e2-9d70-f774cca5e9af tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] [instance: 50eed27b-6da2-4dda-94cc-02fc5cfec071] Fetching instance by UUID {{(pid=120594) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:01:20.986911 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-8e89866e-6d2f-41e2-9d70-f774cca5e9af tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:01:20.987390 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-8e89866e-6d2f-41e2-9d70-f774cca5e9af tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:01:20.987825 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-8e89866e-6d2f-41e2-9d70-f774cca5e9af tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:01:20.988505 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-8e89866e-6d2f-41e2-9d70-f774cca5e9af tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:01:20.988953 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-8e89866e-6d2f-41e2-9d70-f774cca5e9af tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:01:20.989370 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-8e89866e-6d2f-41e2-9d70-f774cca5e9af tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:01:21.062109 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-16f1f1fe-bffc-463a-899c-b2165e1abfda tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Calling method '>' {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:01:21.062735 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.compute.api [None req-16f1f1fe-bffc-463a-899c-b2165e1abfda tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] [instance: 08fb826b-e891-46c4-990d-ca03cf3f4222] Fetching instance by UUID {{(pid=120593) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:01:21.068593 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-16f1f1fe-bffc-463a-899c-b2165e1abfda tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:01:21.069066 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-16f1f1fe-bffc-463a-899c-b2165e1abfda tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:01:21.069488 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-16f1f1fe-bffc-463a-899c-b2165e1abfda tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:01:21.070192 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-16f1f1fe-bffc-463a-899c-b2165e1abfda tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:01:21.070637 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-16f1f1fe-bffc-463a-899c-b2165e1abfda tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:01:21.071050 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-16f1f1fe-bffc-463a-899c-b2165e1abfda tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:01:21.126897 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.policy [None req-8e89866e-6d2f-41e2-9d70-f774cca5e9af tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cdd0da2c7bc4139bcd48ef36a2ee183', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a18a3756ba2b460d977f738a115ebfe0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:01:21.134431 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [None req-8e89866e-6d2f-41e2-9d70-f774cca5e9af tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] 10.222.0.50 "GET /compute/v2.1/servers/50eed27b-6da2-4dda-94cc-02fc5cfec071" status: 200 len: 1322 microversion: 2.1 time: 0.158622 Sep 24 05:01:21.135209 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 47/90] 10.222.0.50 () {58 vars in 1236 bytes} [Sat Sep 24 05:01:20 2022] GET /compute/v2.1/servers/50eed27b-6da2-4dda-94cc-02fc5cfec071 => generated 1322 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 05:01:21.139619 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-5e7e826b-7798-4f5f-8348-fc29f0c769e4 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Calling method '>' {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:01:21.140722 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.compute.api [None req-5e7e826b-7798-4f5f-8348-fc29f0c769e4 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] [instance: 201433d5-db4e-4e57-a800-42fe5cfc95ca] Fetching instance by UUID {{(pid=120594) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:01:21.143864 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-16f1f1fe-bffc-463a-899c-b2165e1abfda tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0948754217fc4ff2ba0241fa35feaf90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1aaf20f480a423ea5feca81585aeeed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:01:21.146509 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-5e7e826b-7798-4f5f-8348-fc29f0c769e4 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:01:21.146981 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-5e7e826b-7798-4f5f-8348-fc29f0c769e4 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:01:21.147401 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-5e7e826b-7798-4f5f-8348-fc29f0c769e4 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:01:21.148082 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-5e7e826b-7798-4f5f-8348-fc29f0c769e4 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:01:21.148523 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-5e7e826b-7798-4f5f-8348-fc29f0c769e4 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:01:21.148940 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-5e7e826b-7798-4f5f-8348-fc29f0c769e4 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:01:21.152762 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-16f1f1fe-bffc-463a-899c-b2165e1abfda tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0948754217fc4ff2ba0241fa35feaf90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1aaf20f480a423ea5feca81585aeeed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:01:21.154202 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-16f1f1fe-bffc-463a-899c-b2165e1abfda tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0948754217fc4ff2ba0241fa35feaf90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1aaf20f480a423ea5feca81585aeeed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:01:21.155464 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-16f1f1fe-bffc-463a-899c-b2165e1abfda tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] 10.222.0.50 "GET /compute/v2.1/servers/08fb826b-e891-46c4-990d-ca03cf3f4222" status: 200 len: 1338 microversion: 2.20 time: 0.097281 Sep 24 05:01:21.156756 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 44/91] 10.222.0.50 () {60 vars in 1277 bytes} [Sat Sep 24 05:01:21 2022] GET /compute/v2.1/servers/08fb826b-e891-46c4-990d-ca03cf3f4222 => generated 1338 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 24 05:01:21.210570 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.policy [None req-5e7e826b-7798-4f5f-8348-fc29f0c769e4 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74a8cc19ab204424ab23c62915ac2bab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87d5229e39fe4817b5187068d8acecc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:01:21.217963 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [None req-5e7e826b-7798-4f5f-8348-fc29f0c769e4 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] 10.222.0.50 "GET /compute/v2.1/servers/201433d5-db4e-4e57-a800-42fe5cfc95ca" status: 200 len: 1246 microversion: 2.1 time: 0.082041 Sep 24 05:01:21.219218 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 48/92] 10.222.0.50 () {58 vars in 1236 bytes} [Sat Sep 24 05:01:21 2022] GET /compute/v2.1/servers/201433d5-db4e-4e57-a800-42fe5cfc95ca => generated 1246 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 05:01:21.588421 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-8209f781-a691-4241-877d-27c516254d8f tempest-DeleteServersTestJSON-1630660203 tempest-DeleteServersTestJSON-1630660203-project] Calling method '>' {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:01:21.588957 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.compute.api [None req-8209f781-a691-4241-877d-27c516254d8f tempest-DeleteServersTestJSON-1630660203 tempest-DeleteServersTestJSON-1630660203-project] [instance: ec88b440-40a0-459f-b94b-06c332e86094] Fetching instance by UUID {{(pid=120593) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:01:21.595588 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-8209f781-a691-4241-877d-27c516254d8f tempest-DeleteServersTestJSON-1630660203 tempest-DeleteServersTestJSON-1630660203-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:01:21.596184 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-8209f781-a691-4241-877d-27c516254d8f tempest-DeleteServersTestJSON-1630660203 tempest-DeleteServersTestJSON-1630660203-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:01:21.596621 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-8209f781-a691-4241-877d-27c516254d8f tempest-DeleteServersTestJSON-1630660203 tempest-DeleteServersTestJSON-1630660203-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:01:21.597526 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-8209f781-a691-4241-877d-27c516254d8f tempest-DeleteServersTestJSON-1630660203 tempest-DeleteServersTestJSON-1630660203-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:01:21.598088 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-8209f781-a691-4241-877d-27c516254d8f tempest-DeleteServersTestJSON-1630660203 tempest-DeleteServersTestJSON-1630660203-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:01:21.598512 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-8209f781-a691-4241-877d-27c516254d8f tempest-DeleteServersTestJSON-1630660203 tempest-DeleteServersTestJSON-1630660203-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:01:21.728541 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-8209f781-a691-4241-877d-27c516254d8f tempest-DeleteServersTestJSON-1630660203 tempest-DeleteServersTestJSON-1630660203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27d1a24c9e15493195744bcbf598ac4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa84dfa1cc764dc99b6e804e778c3479', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:01:21.736803 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-8209f781-a691-4241-877d-27c516254d8f tempest-DeleteServersTestJSON-1630660203 tempest-DeleteServersTestJSON-1630660203-project] 10.222.0.50 "GET /compute/v2.1/servers/ec88b440-40a0-459f-b94b-06c332e86094" status: 200 len: 1315 microversion: 2.1 time: 0.152153 Sep 24 05:01:21.737383 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 45/93] 10.222.0.50 () {58 vars in 1236 bytes} [Sat Sep 24 05:01:21 2022] GET /compute/v2.1/servers/ec88b440-40a0-459f-b94b-06c332e86094 => generated 1315 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 05:01:21.764927 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-9de07945-e272-4543-a8df-7cfa49af055f tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Calling method '>' {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:01:21.766081 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.compute.api [None req-9de07945-e272-4543-a8df-7cfa49af055f tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] [instance: b2daebb8-dfea-4ab9-8253-008a21f906e1] Fetching instance by UUID {{(pid=120594) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:01:21.772024 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-9de07945-e272-4543-a8df-7cfa49af055f tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:01:21.772500 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-9de07945-e272-4543-a8df-7cfa49af055f tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:01:21.772935 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-9de07945-e272-4543-a8df-7cfa49af055f tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:01:21.773611 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-9de07945-e272-4543-a8df-7cfa49af055f tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:01:21.774084 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-9de07945-e272-4543-a8df-7cfa49af055f tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:01:21.774504 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-9de07945-e272-4543-a8df-7cfa49af055f tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:01:21.899681 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.policy [None req-9de07945-e272-4543-a8df-7cfa49af055f tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b1b0448e7f54e3aaae49e411699269e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66ec8bde739145dda504995dbea0914a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:01:21.907789 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [None req-9de07945-e272-4543-a8df-7cfa49af055f tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] 10.222.0.50 "GET /compute/v2.1/servers/b2daebb8-dfea-4ab9-8253-008a21f906e1" status: 200 len: 1363 microversion: 2.1 time: 0.147075 Sep 24 05:01:21.908328 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 49/94] 10.222.0.50 () {58 vars in 1236 bytes} [Sat Sep 24 05:01:21 2022] GET /compute/v2.1/servers/b2daebb8-dfea-4ab9-8253-008a21f906e1 => generated 1363 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 05:01:22.163348 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-18060462-6488-41d8-9522-774d7ab4aee4 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Calling method '>' {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:01:22.163862 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.compute.api [None req-18060462-6488-41d8-9522-774d7ab4aee4 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] [instance: 50eed27b-6da2-4dda-94cc-02fc5cfec071] Fetching instance by UUID {{(pid=120593) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:01:22.169797 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-18060462-6488-41d8-9522-774d7ab4aee4 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:01:22.170313 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-18060462-6488-41d8-9522-774d7ab4aee4 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:01:22.170748 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-18060462-6488-41d8-9522-774d7ab4aee4 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:01:22.171429 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-18060462-6488-41d8-9522-774d7ab4aee4 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:01:22.171878 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-18060462-6488-41d8-9522-774d7ab4aee4 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:01:22.172298 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-18060462-6488-41d8-9522-774d7ab4aee4 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:01:22.180441 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-bd9ecc91-fe6d-4be2-89a5-222dcf625670 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Calling method '>' {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:01:22.181040 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.compute.api [None req-bd9ecc91-fe6d-4be2-89a5-222dcf625670 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] [instance: 08fb826b-e891-46c4-990d-ca03cf3f4222] Fetching instance by UUID {{(pid=120594) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:01:22.186881 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-bd9ecc91-fe6d-4be2-89a5-222dcf625670 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:01:22.187857 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-bd9ecc91-fe6d-4be2-89a5-222dcf625670 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:01:22.188282 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-bd9ecc91-fe6d-4be2-89a5-222dcf625670 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:01:22.188958 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-bd9ecc91-fe6d-4be2-89a5-222dcf625670 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:01:22.189399 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-bd9ecc91-fe6d-4be2-89a5-222dcf625670 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:01:22.189810 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-bd9ecc91-fe6d-4be2-89a5-222dcf625670 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:01:22.265857 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.policy [None req-bd9ecc91-fe6d-4be2-89a5-222dcf625670 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0948754217fc4ff2ba0241fa35feaf90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1aaf20f480a423ea5feca81585aeeed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:01:22.273951 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.policy [None req-bd9ecc91-fe6d-4be2-89a5-222dcf625670 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0948754217fc4ff2ba0241fa35feaf90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1aaf20f480a423ea5feca81585aeeed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:01:22.275411 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.policy [None req-bd9ecc91-fe6d-4be2-89a5-222dcf625670 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0948754217fc4ff2ba0241fa35feaf90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1aaf20f480a423ea5feca81585aeeed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:01:22.276500 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [None req-bd9ecc91-fe6d-4be2-89a5-222dcf625670 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] 10.222.0.50 "GET /compute/v2.1/servers/08fb826b-e891-46c4-990d-ca03cf3f4222" status: 200 len: 1338 microversion: 2.20 time: 0.099873 Sep 24 05:01:22.277047 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 50/95] 10.222.0.50 () {60 vars in 1277 bytes} [Sat Sep 24 05:01:22 2022] GET /compute/v2.1/servers/08fb826b-e891-46c4-990d-ca03cf3f4222 => generated 1338 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 24 05:01:22.281602 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-a529a0b5-a556-4b41-8539-24e921848a4c tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Calling method '>' {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:01:22.282268 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.compute.api [None req-a529a0b5-a556-4b41-8539-24e921848a4c tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] [instance: 201433d5-db4e-4e57-a800-42fe5cfc95ca] Fetching instance by UUID {{(pid=120594) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:01:22.292951 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-a529a0b5-a556-4b41-8539-24e921848a4c tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:01:22.293410 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-a529a0b5-a556-4b41-8539-24e921848a4c tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:01:22.293838 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-a529a0b5-a556-4b41-8539-24e921848a4c tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:01:22.294569 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-a529a0b5-a556-4b41-8539-24e921848a4c tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:01:22.295011 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-a529a0b5-a556-4b41-8539-24e921848a4c tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:01:22.295425 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-a529a0b5-a556-4b41-8539-24e921848a4c tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:01:22.325121 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-18060462-6488-41d8-9522-774d7ab4aee4 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cdd0da2c7bc4139bcd48ef36a2ee183', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a18a3756ba2b460d977f738a115ebfe0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:01:22.333440 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-18060462-6488-41d8-9522-774d7ab4aee4 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] 10.222.0.50 "GET /compute/v2.1/servers/50eed27b-6da2-4dda-94cc-02fc5cfec071" status: 200 len: 1322 microversion: 2.1 time: 0.174013 Sep 24 05:01:22.334042 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 46/96] 10.222.0.50 () {58 vars in 1236 bytes} [Sat Sep 24 05:01:22 2022] GET /compute/v2.1/servers/50eed27b-6da2-4dda-94cc-02fc5cfec071 => generated 1322 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 05:01:22.355394 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.policy [None req-a529a0b5-a556-4b41-8539-24e921848a4c tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74a8cc19ab204424ab23c62915ac2bab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87d5229e39fe4817b5187068d8acecc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:01:22.363237 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [None req-a529a0b5-a556-4b41-8539-24e921848a4c tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] 10.222.0.50 "GET /compute/v2.1/servers/201433d5-db4e-4e57-a800-42fe5cfc95ca" status: 200 len: 1246 microversion: 2.1 time: 0.085207 Sep 24 05:01:22.363812 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 51/97] 10.222.0.50 () {58 vars in 1236 bytes} [Sat Sep 24 05:01:22 2022] GET /compute/v2.1/servers/201433d5-db4e-4e57-a800-42fe5cfc95ca => generated 1246 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 05:01:22.760326 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-8f324153-74a9-4033-81b9-8446044c9b9d tempest-DeleteServersTestJSON-1630660203 tempest-DeleteServersTestJSON-1630660203-project] Calling method '>' {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:01:22.760926 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.compute.api [None req-8f324153-74a9-4033-81b9-8446044c9b9d tempest-DeleteServersTestJSON-1630660203 tempest-DeleteServersTestJSON-1630660203-project] [instance: ec88b440-40a0-459f-b94b-06c332e86094] Fetching instance by UUID {{(pid=120593) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:01:22.768134 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-8f324153-74a9-4033-81b9-8446044c9b9d tempest-DeleteServersTestJSON-1630660203 tempest-DeleteServersTestJSON-1630660203-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:01:22.768792 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-8f324153-74a9-4033-81b9-8446044c9b9d tempest-DeleteServersTestJSON-1630660203 tempest-DeleteServersTestJSON-1630660203-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:01:22.769378 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-8f324153-74a9-4033-81b9-8446044c9b9d tempest-DeleteServersTestJSON-1630660203 tempest-DeleteServersTestJSON-1630660203-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:01:22.770088 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-8f324153-74a9-4033-81b9-8446044c9b9d tempest-DeleteServersTestJSON-1630660203 tempest-DeleteServersTestJSON-1630660203-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:01:22.770537 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-8f324153-74a9-4033-81b9-8446044c9b9d tempest-DeleteServersTestJSON-1630660203 tempest-DeleteServersTestJSON-1630660203-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:01:22.770957 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-8f324153-74a9-4033-81b9-8446044c9b9d tempest-DeleteServersTestJSON-1630660203 tempest-DeleteServersTestJSON-1630660203-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:01:22.930146 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-fde76d09-9f74-455a-b4a3-76c8f1ab9756 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Calling method '>' {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:01:22.930999 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.compute.api [None req-fde76d09-9f74-455a-b4a3-76c8f1ab9756 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] [instance: b2daebb8-dfea-4ab9-8253-008a21f906e1] Fetching instance by UUID {{(pid=120594) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:01:22.936859 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-fde76d09-9f74-455a-b4a3-76c8f1ab9756 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:01:22.937873 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-fde76d09-9f74-455a-b4a3-76c8f1ab9756 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:01:22.938368 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-fde76d09-9f74-455a-b4a3-76c8f1ab9756 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:01:22.939063 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-fde76d09-9f74-455a-b4a3-76c8f1ab9756 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:01:22.939513 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-fde76d09-9f74-455a-b4a3-76c8f1ab9756 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:01:22.939936 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-fde76d09-9f74-455a-b4a3-76c8f1ab9756 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:01:23.042540 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-8f324153-74a9-4033-81b9-8446044c9b9d tempest-DeleteServersTestJSON-1630660203 tempest-DeleteServersTestJSON-1630660203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27d1a24c9e15493195744bcbf598ac4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa84dfa1cc764dc99b6e804e778c3479', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:01:23.052108 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-8f324153-74a9-4033-81b9-8446044c9b9d tempest-DeleteServersTestJSON-1630660203 tempest-DeleteServersTestJSON-1630660203-project] 10.222.0.50 "GET /compute/v2.1/servers/ec88b440-40a0-459f-b94b-06c332e86094" status: 200 len: 1315 microversion: 2.1 time: 0.295604 Sep 24 05:01:23.052778 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 47/98] 10.222.0.50 () {58 vars in 1236 bytes} [Sat Sep 24 05:01:22 2022] GET /compute/v2.1/servers/ec88b440-40a0-459f-b94b-06c332e86094 => generated 1315 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 05:01:23.147522 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.policy [None req-fde76d09-9f74-455a-b4a3-76c8f1ab9756 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b1b0448e7f54e3aaae49e411699269e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66ec8bde739145dda504995dbea0914a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:01:23.155714 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [None req-fde76d09-9f74-455a-b4a3-76c8f1ab9756 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] 10.222.0.50 "GET /compute/v2.1/servers/b2daebb8-dfea-4ab9-8253-008a21f906e1" status: 200 len: 1363 microversion: 2.1 time: 0.229348 Sep 24 05:01:23.156916 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 52/99] 10.222.0.50 () {58 vars in 1236 bytes} [Sat Sep 24 05:01:22 2022] GET /compute/v2.1/servers/b2daebb8-dfea-4ab9-8253-008a21f906e1 => generated 1363 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 24 05:01:23.302148 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-105265be-62fd-4519-9604-4976754c9bde tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Calling method '>' {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:01:23.302983 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.compute.api [None req-105265be-62fd-4519-9604-4976754c9bde tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] [instance: 08fb826b-e891-46c4-990d-ca03cf3f4222] Fetching instance by UUID {{(pid=120593) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:01:23.318742 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-105265be-62fd-4519-9604-4976754c9bde tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:01:23.319378 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-105265be-62fd-4519-9604-4976754c9bde tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:01:23.319913 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-105265be-62fd-4519-9604-4976754c9bde tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:01:23.320858 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-105265be-62fd-4519-9604-4976754c9bde tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:01:23.321489 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-105265be-62fd-4519-9604-4976754c9bde tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:01:23.322134 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-105265be-62fd-4519-9604-4976754c9bde tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:01:23.356624 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-6e8992b6-92dc-4a2a-92cd-576befd7e830 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Calling method '>' {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:01:23.357853 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.compute.api [None req-6e8992b6-92dc-4a2a-92cd-576befd7e830 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] [instance: 50eed27b-6da2-4dda-94cc-02fc5cfec071] Fetching instance by UUID {{(pid=120594) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:01:23.369881 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-6e8992b6-92dc-4a2a-92cd-576befd7e830 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:01:23.370662 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-6e8992b6-92dc-4a2a-92cd-576befd7e830 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:01:23.370954 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-6e8992b6-92dc-4a2a-92cd-576befd7e830 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:01:23.371683 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-6e8992b6-92dc-4a2a-92cd-576befd7e830 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:01:23.373579 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-6e8992b6-92dc-4a2a-92cd-576befd7e830 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:01:23.375457 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-6e8992b6-92dc-4a2a-92cd-576befd7e830 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:01:23.416659 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-105265be-62fd-4519-9604-4976754c9bde tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0948754217fc4ff2ba0241fa35feaf90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1aaf20f480a423ea5feca81585aeeed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:01:23.426269 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-105265be-62fd-4519-9604-4976754c9bde tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0948754217fc4ff2ba0241fa35feaf90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1aaf20f480a423ea5feca81585aeeed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:01:23.428196 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-105265be-62fd-4519-9604-4976754c9bde tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0948754217fc4ff2ba0241fa35feaf90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1aaf20f480a423ea5feca81585aeeed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:01:23.429701 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-105265be-62fd-4519-9604-4976754c9bde tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] 10.222.0.50 "GET /compute/v2.1/servers/08fb826b-e891-46c4-990d-ca03cf3f4222" status: 200 len: 1338 microversion: 2.20 time: 0.132169 Sep 24 05:01:23.430389 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 48/100] 10.222.0.50 () {60 vars in 1277 bytes} [Sat Sep 24 05:01:23 2022] GET /compute/v2.1/servers/08fb826b-e891-46c4-990d-ca03cf3f4222 => generated 1338 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 05:01:23.435915 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-2a1c60d1-9abd-4dce-9dab-d8ae9ded10a9 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Calling method '>' {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:01:23.449503 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.compute.api [None req-2a1c60d1-9abd-4dce-9dab-d8ae9ded10a9 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] [instance: 201433d5-db4e-4e57-a800-42fe5cfc95ca] Fetching instance by UUID {{(pid=120593) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:01:23.461471 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-2a1c60d1-9abd-4dce-9dab-d8ae9ded10a9 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:01:23.462362 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-2a1c60d1-9abd-4dce-9dab-d8ae9ded10a9 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:01:23.463029 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-2a1c60d1-9abd-4dce-9dab-d8ae9ded10a9 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:01:23.464095 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-2a1c60d1-9abd-4dce-9dab-d8ae9ded10a9 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:01:23.466152 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-2a1c60d1-9abd-4dce-9dab-d8ae9ded10a9 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:01:23.466897 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-2a1c60d1-9abd-4dce-9dab-d8ae9ded10a9 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:01:23.581095 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-2a1c60d1-9abd-4dce-9dab-d8ae9ded10a9 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74a8cc19ab204424ab23c62915ac2bab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87d5229e39fe4817b5187068d8acecc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:01:23.591367 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-2a1c60d1-9abd-4dce-9dab-d8ae9ded10a9 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] 10.222.0.50 "GET /compute/v2.1/servers/201433d5-db4e-4e57-a800-42fe5cfc95ca" status: 200 len: 1246 microversion: 2.1 time: 0.159480 Sep 24 05:01:23.592800 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 49/101] 10.222.0.50 () {58 vars in 1236 bytes} [Sat Sep 24 05:01:23 2022] GET /compute/v2.1/servers/201433d5-db4e-4e57-a800-42fe5cfc95ca => generated 1246 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 05:01:23.673095 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.policy [None req-6e8992b6-92dc-4a2a-92cd-576befd7e830 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cdd0da2c7bc4139bcd48ef36a2ee183', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a18a3756ba2b460d977f738a115ebfe0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:01:23.683299 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [None req-6e8992b6-92dc-4a2a-92cd-576befd7e830 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] 10.222.0.50 "GET /compute/v2.1/servers/50eed27b-6da2-4dda-94cc-02fc5cfec071" status: 200 len: 1322 microversion: 2.1 time: 0.331254 Sep 24 05:01:23.684943 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 53/102] 10.222.0.50 () {58 vars in 1236 bytes} [Sat Sep 24 05:01:23 2022] GET /compute/v2.1/servers/50eed27b-6da2-4dda-94cc-02fc5cfec071 => generated 1322 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 05:01:24.075690 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-727479ef-eb75-4653-b33e-1f758543b622 tempest-DeleteServersTestJSON-1630660203 tempest-DeleteServersTestJSON-1630660203-project] Calling method '>' {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:01:24.076637 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.compute.api [None req-727479ef-eb75-4653-b33e-1f758543b622 tempest-DeleteServersTestJSON-1630660203 tempest-DeleteServersTestJSON-1630660203-project] [instance: ec88b440-40a0-459f-b94b-06c332e86094] Fetching instance by UUID {{(pid=120593) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:01:24.086814 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-727479ef-eb75-4653-b33e-1f758543b622 tempest-DeleteServersTestJSON-1630660203 tempest-DeleteServersTestJSON-1630660203-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:01:24.088099 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-727479ef-eb75-4653-b33e-1f758543b622 tempest-DeleteServersTestJSON-1630660203 tempest-DeleteServersTestJSON-1630660203-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:01:24.088742 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-727479ef-eb75-4653-b33e-1f758543b622 tempest-DeleteServersTestJSON-1630660203 tempest-DeleteServersTestJSON-1630660203-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:01:24.089885 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-727479ef-eb75-4653-b33e-1f758543b622 tempest-DeleteServersTestJSON-1630660203 tempest-DeleteServersTestJSON-1630660203-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:01:24.090563 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-727479ef-eb75-4653-b33e-1f758543b622 tempest-DeleteServersTestJSON-1630660203 tempest-DeleteServersTestJSON-1630660203-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:01:24.091494 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-727479ef-eb75-4653-b33e-1f758543b622 tempest-DeleteServersTestJSON-1630660203 tempest-DeleteServersTestJSON-1630660203-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:01:24.135953 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG dbcounter [-] [120593] Writing DB stats nova_cell0:SELECT=2 {{(pid=120593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 05:01:24.161256 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG dbcounter [-] [120593] Writing DB stats nova_cell0:SELECT=6 {{(pid=120593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 05:01:24.180894 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-7b25849d-9cf7-42e8-8621-df1d1861d576 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Calling method '>' {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:01:24.181506 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.compute.api [None req-7b25849d-9cf7-42e8-8621-df1d1861d576 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] [instance: b2daebb8-dfea-4ab9-8253-008a21f906e1] Fetching instance by UUID {{(pid=120594) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:01:24.189328 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-7b25849d-9cf7-42e8-8621-df1d1861d576 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:01:24.189956 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-7b25849d-9cf7-42e8-8621-df1d1861d576 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:01:24.190584 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-7b25849d-9cf7-42e8-8621-df1d1861d576 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:01:24.191287 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-7b25849d-9cf7-42e8-8621-df1d1861d576 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:01:24.191734 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-7b25849d-9cf7-42e8-8621-df1d1861d576 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:01:24.192335 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-7b25849d-9cf7-42e8-8621-df1d1861d576 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:01:24.446422 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG dbcounter [-] [120594] Writing DB stats nova_cell0:SELECT=24 {{(pid=120594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 05:01:24.498974 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-727479ef-eb75-4653-b33e-1f758543b622 tempest-DeleteServersTestJSON-1630660203 tempest-DeleteServersTestJSON-1630660203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27d1a24c9e15493195744bcbf598ac4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa84dfa1cc764dc99b6e804e778c3479', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:01:24.509887 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-727479ef-eb75-4653-b33e-1f758543b622 tempest-DeleteServersTestJSON-1630660203 tempest-DeleteServersTestJSON-1630660203-project] 10.222.0.50 "GET /compute/v2.1/servers/ec88b440-40a0-459f-b94b-06c332e86094" status: 200 len: 1315 microversion: 2.1 time: 0.437047 Sep 24 05:01:24.511018 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 50/103] 10.222.0.50 () {58 vars in 1236 bytes} [Sat Sep 24 05:01:24 2022] GET /compute/v2.1/servers/ec88b440-40a0-459f-b94b-06c332e86094 => generated 1315 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 05:01:24.516817 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [req-fe7dd50d-97db-419d-9e98-4a8865826de3 req-d5695814-a588-4d69-8f4a-6f36128bffdf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b2daebb8-dfea-4ab9-8253-008a21f906e1", "tag": "27e14393-9cd2-49fc-924d-ab63297b8de7"}]} {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 05:01:24.545482 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [req-fe7dd50d-97db-419d-9e98-4a8865826de3 req-d5695814-a588-4d69-8f4a-6f36128bffdf service nova] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:01:24.545990 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [req-fe7dd50d-97db-419d-9e98-4a8865826de3 req-d5695814-a588-4d69-8f4a-6f36128bffdf service nova] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:01:24.546505 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [req-fe7dd50d-97db-419d-9e98-4a8865826de3 req-d5695814-a588-4d69-8f4a-6f36128bffdf service nova] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:01:24.575417 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.policy [None req-7b25849d-9cf7-42e8-8621-df1d1861d576 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b1b0448e7f54e3aaae49e411699269e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66ec8bde739145dda504995dbea0914a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:01:24.581984 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.compute.server_external_events [req-fe7dd50d-97db-419d-9e98-4a8865826de3 req-d5695814-a588-4d69-8f4a-6f36128bffdf service nova] Creating event network-changed:27e14393-9cd2-49fc-924d-ab63297b8de7 for instance b2daebb8-dfea-4ab9-8253-008a21f906e1 on hv-cinder-85918 Sep 24 05:01:24.582582 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [req-fe7dd50d-97db-419d-9e98-4a8865826de3 req-d5695814-a588-4d69-8f4a-6f36128bffdf service nova] Acquiring lock "compute-rpcapi-router" {{(pid=120593) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Sep 24 05:01:24.583301 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [req-fe7dd50d-97db-419d-9e98-4a8865826de3 req-d5695814-a588-4d69-8f4a-6f36128bffdf service nova] Acquired lock "compute-rpcapi-router" {{(pid=120593) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Sep 24 05:01:24.585219 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-94928561-e0c9-4de0-9b78-0dc9595db7a8 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:01:24.585688 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-94928561-e0c9-4de0-9b78-0dc9595db7a8 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:01:24.586222 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-94928561-e0c9-4de0-9b78-0dc9595db7a8 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:01:24.587037 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-94928561-e0c9-4de0-9b78-0dc9595db7a8 None None] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:01:24.588329 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-94928561-e0c9-4de0-9b78-0dc9595db7a8 None None] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:01:24.588779 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-94928561-e0c9-4de0-9b78-0dc9595db7a8 None None] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:01:24.591891 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [None req-7b25849d-9cf7-42e8-8621-df1d1861d576 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] 10.222.0.50 "GET /compute/v2.1/servers/b2daebb8-dfea-4ab9-8253-008a21f906e1" status: 200 len: 1363 microversion: 2.1 time: 0.413347 Sep 24 05:01:24.593830 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 54/104] 10.222.0.50 () {58 vars in 1236 bytes} [Sat Sep 24 05:01:24 2022] GET /compute/v2.1/servers/b2daebb8-dfea-4ab9-8253-008a21f906e1 => generated 1363 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 24 05:01:24.601122 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: INFO nova.compute.rpcapi [None req-94928561-e0c9-4de0-9b78-0dc9595db7a8 None None] Automatically selected compute RPC version 6.1 from minimum service version 64 Sep 24 05:01:24.602830 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-94928561-e0c9-4de0-9b78-0dc9595db7a8 None None] Releasing lock "compute-rpcapi-router" {{(pid=120593) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Sep 24 05:01:24.612093 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-fabc7e44-11d6-4667-8e91-9054f11d812e tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Calling method '>' {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:01:24.613872 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.compute.api [None req-fabc7e44-11d6-4667-8e91-9054f11d812e tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] [instance: 08fb826b-e891-46c4-990d-ca03cf3f4222] Fetching instance by UUID {{(pid=120594) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:01:24.622555 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-fabc7e44-11d6-4667-8e91-9054f11d812e tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:01:24.623538 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-fabc7e44-11d6-4667-8e91-9054f11d812e tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:01:24.633464 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-94928561-e0c9-4de0-9b78-0dc9595db7a8 None None] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.121058 Sep 24 05:01:24.633616 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-fabc7e44-11d6-4667-8e91-9054f11d812e tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:01:24.634399 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 51/105] 10.222.0.50 () {64 vars in 1317 bytes} [Sat Sep 24 05:01:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 05:01:24.634505 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-fabc7e44-11d6-4667-8e91-9054f11d812e tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:01:24.638317 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-fabc7e44-11d6-4667-8e91-9054f11d812e tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:01:24.638882 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-fabc7e44-11d6-4667-8e91-9054f11d812e tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:01:24.642459 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-8bf64b69-96cd-45f9-a2fe-7badb83788d9 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Calling method '>' {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:01:24.643373 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.compute.api [None req-8bf64b69-96cd-45f9-a2fe-7badb83788d9 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] [instance: 201433d5-db4e-4e57-a800-42fe5cfc95ca] Fetching instance by UUID {{(pid=120593) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:01:24.699878 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-8bf64b69-96cd-45f9-a2fe-7badb83788d9 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:01:24.700692 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-8bf64b69-96cd-45f9-a2fe-7badb83788d9 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:01:24.701729 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-8bf64b69-96cd-45f9-a2fe-7badb83788d9 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:01:24.706135 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-8bf64b69-96cd-45f9-a2fe-7badb83788d9 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:01:24.706637 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-8bf64b69-96cd-45f9-a2fe-7badb83788d9 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:01:24.707121 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-8bf64b69-96cd-45f9-a2fe-7badb83788d9 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:01:24.744569 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG dbcounter [-] [120593] Writing DB stats nova_cell1:SELECT=100 {{(pid=120593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 05:01:24.862649 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-8bf64b69-96cd-45f9-a2fe-7badb83788d9 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74a8cc19ab204424ab23c62915ac2bab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87d5229e39fe4817b5187068d8acecc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:01:24.875154 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-8bf64b69-96cd-45f9-a2fe-7badb83788d9 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] 10.222.0.50 "GET /compute/v2.1/servers/201433d5-db4e-4e57-a800-42fe5cfc95ca" status: 200 len: 1294 microversion: 2.1 time: 0.238624 Sep 24 05:01:24.876089 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 52/106] 10.222.0.50 () {58 vars in 1236 bytes} [Sat Sep 24 05:01:24 2022] GET /compute/v2.1/servers/201433d5-db4e-4e57-a800-42fe5cfc95ca => generated 1294 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 05:01:24.881414 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-3afd84bb-53e5-49f5-a284-6f5ecb85ca2a tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Calling method '>' {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:01:24.882511 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.compute.api [None req-3afd84bb-53e5-49f5-a284-6f5ecb85ca2a tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] [instance: 50eed27b-6da2-4dda-94cc-02fc5cfec071] Fetching instance by UUID {{(pid=120593) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:01:24.894384 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-3afd84bb-53e5-49f5-a284-6f5ecb85ca2a tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:01:24.895163 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-3afd84bb-53e5-49f5-a284-6f5ecb85ca2a tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:01:24.895726 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-3afd84bb-53e5-49f5-a284-6f5ecb85ca2a tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:01:24.896468 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-3afd84bb-53e5-49f5-a284-6f5ecb85ca2a tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:01:24.897005 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-3afd84bb-53e5-49f5-a284-6f5ecb85ca2a tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:01:24.897491 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-3afd84bb-53e5-49f5-a284-6f5ecb85ca2a tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:01:25.051771 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.policy [None req-fabc7e44-11d6-4667-8e91-9054f11d812e tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0948754217fc4ff2ba0241fa35feaf90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1aaf20f480a423ea5feca81585aeeed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:01:25.061516 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.policy [None req-fabc7e44-11d6-4667-8e91-9054f11d812e tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0948754217fc4ff2ba0241fa35feaf90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1aaf20f480a423ea5feca81585aeeed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:01:25.064180 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.policy [None req-fabc7e44-11d6-4667-8e91-9054f11d812e tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0948754217fc4ff2ba0241fa35feaf90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1aaf20f480a423ea5feca81585aeeed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:01:25.066444 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [None req-fabc7e44-11d6-4667-8e91-9054f11d812e tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] 10.222.0.50 "GET /compute/v2.1/servers/08fb826b-e891-46c4-990d-ca03cf3f4222" status: 200 len: 1404 microversion: 2.20 time: 0.471165 Sep 24 05:01:25.078545 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 55/107] 10.222.0.50 () {60 vars in 1277 bytes} [Sat Sep 24 05:01:24 2022] GET /compute/v2.1/servers/08fb826b-e891-46c4-990d-ca03cf3f4222 => generated 1404 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 05:01:25.165245 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-3afd84bb-53e5-49f5-a284-6f5ecb85ca2a tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cdd0da2c7bc4139bcd48ef36a2ee183', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a18a3756ba2b460d977f738a115ebfe0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:01:25.178252 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-3afd84bb-53e5-49f5-a284-6f5ecb85ca2a tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] 10.222.0.50 "GET /compute/v2.1/servers/50eed27b-6da2-4dda-94cc-02fc5cfec071" status: 200 len: 1322 microversion: 2.1 time: 0.300730 Sep 24 05:01:25.180027 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 53/108] 10.222.0.50 () {58 vars in 1236 bytes} [Sat Sep 24 05:01:24 2022] GET /compute/v2.1/servers/50eed27b-6da2-4dda-94cc-02fc5cfec071 => generated 1322 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 05:01:25.337410 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [req-b03c8d4b-2439-43ef-afe8-6dd20423c7b3 req-cc9feb19-d214-482f-b7da-89be03381698 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "08fb826b-e891-46c4-990d-ca03cf3f4222", "tag": "4de1eabe-932e-4cda-804d-49eeff37c34c"}]} {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 05:01:25.347341 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [req-b03c8d4b-2439-43ef-afe8-6dd20423c7b3 req-cc9feb19-d214-482f-b7da-89be03381698 service nova] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:01:25.347800 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [req-b03c8d4b-2439-43ef-afe8-6dd20423c7b3 req-cc9feb19-d214-482f-b7da-89be03381698 service nova] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:01:25.348387 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [req-b03c8d4b-2439-43ef-afe8-6dd20423c7b3 req-cc9feb19-d214-482f-b7da-89be03381698 service nova] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:01:25.360428 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: INFO nova.api.openstack.compute.server_external_events [req-b03c8d4b-2439-43ef-afe8-6dd20423c7b3 req-cc9feb19-d214-482f-b7da-89be03381698 service nova] Creating event network-changed:4de1eabe-932e-4cda-804d-49eeff37c34c for instance 08fb826b-e891-46c4-990d-ca03cf3f4222 on hv-cinder-85918 Sep 24 05:01:25.365504 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [req-b03c8d4b-2439-43ef-afe8-6dd20423c7b3 req-cc9feb19-d214-482f-b7da-89be03381698 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034199 Sep 24 05:01:25.366352 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 56/109] 10.222.0.50 () {64 vars in 1317 bytes} [Sat Sep 24 05:01:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 05:01:25.534142 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-76de3916-70af-4e37-b4e1-b4014f6b9894 tempest-DeleteServersTestJSON-1630660203 tempest-DeleteServersTestJSON-1630660203-project] Calling method '>' {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:01:25.534768 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.compute.api [None req-76de3916-70af-4e37-b4e1-b4014f6b9894 tempest-DeleteServersTestJSON-1630660203 tempest-DeleteServersTestJSON-1630660203-project] [instance: ec88b440-40a0-459f-b94b-06c332e86094] Fetching instance by UUID {{(pid=120593) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:01:25.540515 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-76de3916-70af-4e37-b4e1-b4014f6b9894 tempest-DeleteServersTestJSON-1630660203 tempest-DeleteServersTestJSON-1630660203-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:01:25.540985 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-76de3916-70af-4e37-b4e1-b4014f6b9894 tempest-DeleteServersTestJSON-1630660203 tempest-DeleteServersTestJSON-1630660203-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:01:25.541413 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-76de3916-70af-4e37-b4e1-b4014f6b9894 tempest-DeleteServersTestJSON-1630660203 tempest-DeleteServersTestJSON-1630660203-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:01:25.542107 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-76de3916-70af-4e37-b4e1-b4014f6b9894 tempest-DeleteServersTestJSON-1630660203 tempest-DeleteServersTestJSON-1630660203-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:01:25.542552 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-76de3916-70af-4e37-b4e1-b4014f6b9894 tempest-DeleteServersTestJSON-1630660203 tempest-DeleteServersTestJSON-1630660203-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:01:25.542965 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-76de3916-70af-4e37-b4e1-b4014f6b9894 tempest-DeleteServersTestJSON-1630660203 tempest-DeleteServersTestJSON-1630660203-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:01:25.615382 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-9494cd68-74e4-4a09-98eb-3d121816622d tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Calling method '>' {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:01:25.616118 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.compute.api [None req-9494cd68-74e4-4a09-98eb-3d121816622d tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] [instance: b2daebb8-dfea-4ab9-8253-008a21f906e1] Fetching instance by UUID {{(pid=120594) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:01:25.622407 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-9494cd68-74e4-4a09-98eb-3d121816622d tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:01:25.622965 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-9494cd68-74e4-4a09-98eb-3d121816622d tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:01:25.623474 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-9494cd68-74e4-4a09-98eb-3d121816622d tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:01:25.624240 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-9494cd68-74e4-4a09-98eb-3d121816622d tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:01:25.624696 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-9494cd68-74e4-4a09-98eb-3d121816622d tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:01:25.625118 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-9494cd68-74e4-4a09-98eb-3d121816622d tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:01:25.711425 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-76de3916-70af-4e37-b4e1-b4014f6b9894 tempest-DeleteServersTestJSON-1630660203 tempest-DeleteServersTestJSON-1630660203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27d1a24c9e15493195744bcbf598ac4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa84dfa1cc764dc99b6e804e778c3479', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:01:25.719871 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-76de3916-70af-4e37-b4e1-b4014f6b9894 tempest-DeleteServersTestJSON-1630660203 tempest-DeleteServersTestJSON-1630660203-project] 10.222.0.50 "GET /compute/v2.1/servers/ec88b440-40a0-459f-b94b-06c332e86094" status: 200 len: 1315 microversion: 2.1 time: 0.189980 Sep 24 05:01:25.720452 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 54/110] 10.222.0.50 () {58 vars in 1236 bytes} [Sat Sep 24 05:01:25 2022] GET /compute/v2.1/servers/ec88b440-40a0-459f-b94b-06c332e86094 => generated 1315 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 05:01:25.788360 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.policy [None req-9494cd68-74e4-4a09-98eb-3d121816622d tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b1b0448e7f54e3aaae49e411699269e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66ec8bde739145dda504995dbea0914a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:01:25.796252 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [None req-9494cd68-74e4-4a09-98eb-3d121816622d tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] 10.222.0.50 "GET /compute/v2.1/servers/b2daebb8-dfea-4ab9-8253-008a21f906e1" status: 200 len: 1363 microversion: 2.1 time: 0.185144 Sep 24 05:01:25.797419 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 57/111] 10.222.0.50 () {58 vars in 1236 bytes} [Sat Sep 24 05:01:25 2022] GET /compute/v2.1/servers/b2daebb8-dfea-4ab9-8253-008a21f906e1 => generated 1363 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 24 05:01:25.899311 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-92a42901-2b5c-4cbb-88cc-3b78198152cb tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Calling method '>' {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:01:25.899850 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.compute.api [None req-92a42901-2b5c-4cbb-88cc-3b78198152cb tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] [instance: 201433d5-db4e-4e57-a800-42fe5cfc95ca] Fetching instance by UUID {{(pid=120593) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:01:25.906464 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-92a42901-2b5c-4cbb-88cc-3b78198152cb tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:01:25.906972 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-92a42901-2b5c-4cbb-88cc-3b78198152cb tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:01:25.907397 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-92a42901-2b5c-4cbb-88cc-3b78198152cb tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:01:25.908069 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-92a42901-2b5c-4cbb-88cc-3b78198152cb tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:01:25.908536 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-92a42901-2b5c-4cbb-88cc-3b78198152cb tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:01:25.909006 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-92a42901-2b5c-4cbb-88cc-3b78198152cb tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:01:25.973121 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-92a42901-2b5c-4cbb-88cc-3b78198152cb tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74a8cc19ab204424ab23c62915ac2bab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87d5229e39fe4817b5187068d8acecc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:01:25.980593 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-92a42901-2b5c-4cbb-88cc-3b78198152cb tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] 10.222.0.50 "GET /compute/v2.1/servers/201433d5-db4e-4e57-a800-42fe5cfc95ca" status: 200 len: 1294 microversion: 2.1 time: 0.085168 Sep 24 05:01:25.981146 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 55/112] 10.222.0.50 () {58 vars in 1236 bytes} [Sat Sep 24 05:01:25 2022] GET /compute/v2.1/servers/201433d5-db4e-4e57-a800-42fe5cfc95ca => generated 1294 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 05:01:26.095821 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-f2af4de7-ef6a-464b-9b0e-10c2436d6a67 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Calling method '>' {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:01:26.096458 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.compute.api [None req-f2af4de7-ef6a-464b-9b0e-10c2436d6a67 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] [instance: 08fb826b-e891-46c4-990d-ca03cf3f4222] Fetching instance by UUID {{(pid=120594) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:01:26.102491 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-f2af4de7-ef6a-464b-9b0e-10c2436d6a67 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:01:26.102973 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-f2af4de7-ef6a-464b-9b0e-10c2436d6a67 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:01:26.103408 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-f2af4de7-ef6a-464b-9b0e-10c2436d6a67 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:01:26.104093 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-f2af4de7-ef6a-464b-9b0e-10c2436d6a67 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:01:26.104542 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-f2af4de7-ef6a-464b-9b0e-10c2436d6a67 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:01:26.104962 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-f2af4de7-ef6a-464b-9b0e-10c2436d6a67 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:01:26.209397 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-07f3df62-0b55-4f8d-a570-9e5e427550eb tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Calling method '>' {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:01:26.210175 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.compute.api [None req-07f3df62-0b55-4f8d-a570-9e5e427550eb tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] [instance: 50eed27b-6da2-4dda-94cc-02fc5cfec071] Fetching instance by UUID {{(pid=120593) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:01:26.216170 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-07f3df62-0b55-4f8d-a570-9e5e427550eb tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:01:26.216941 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-07f3df62-0b55-4f8d-a570-9e5e427550eb tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:01:26.217540 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-07f3df62-0b55-4f8d-a570-9e5e427550eb tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:01:26.222206 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-07f3df62-0b55-4f8d-a570-9e5e427550eb tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:01:26.222817 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-07f3df62-0b55-4f8d-a570-9e5e427550eb tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:01:26.223549 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-07f3df62-0b55-4f8d-a570-9e5e427550eb tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:01:26.234378 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.policy [None req-f2af4de7-ef6a-464b-9b0e-10c2436d6a67 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0948754217fc4ff2ba0241fa35feaf90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1aaf20f480a423ea5feca81585aeeed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:01:26.238338 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG dbcounter [-] [120594] Writing DB stats nova_cell1:SELECT=100 {{(pid=120594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 05:01:26.245108 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.policy [None req-f2af4de7-ef6a-464b-9b0e-10c2436d6a67 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0948754217fc4ff2ba0241fa35feaf90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1aaf20f480a423ea5feca81585aeeed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:01:26.246926 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.policy [None req-f2af4de7-ef6a-464b-9b0e-10c2436d6a67 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0948754217fc4ff2ba0241fa35feaf90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1aaf20f480a423ea5feca81585aeeed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:01:26.248180 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [None req-f2af4de7-ef6a-464b-9b0e-10c2436d6a67 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] 10.222.0.50 "GET /compute/v2.1/servers/08fb826b-e891-46c4-990d-ca03cf3f4222" status: 200 len: 1404 microversion: 2.20 time: 0.156813 Sep 24 05:01:26.253483 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 58/113] 10.222.0.50 () {60 vars in 1277 bytes} [Sat Sep 24 05:01:26 2022] GET /compute/v2.1/servers/08fb826b-e891-46c4-990d-ca03cf3f4222 => generated 1404 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 05:01:26.363429 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-07f3df62-0b55-4f8d-a570-9e5e427550eb tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cdd0da2c7bc4139bcd48ef36a2ee183', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a18a3756ba2b460d977f738a115ebfe0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:01:26.371306 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-07f3df62-0b55-4f8d-a570-9e5e427550eb tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] 10.222.0.50 "GET /compute/v2.1/servers/50eed27b-6da2-4dda-94cc-02fc5cfec071" status: 200 len: 1322 microversion: 2.1 time: 0.165738 Sep 24 05:01:26.371895 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 56/114] 10.222.0.50 () {58 vars in 1236 bytes} [Sat Sep 24 05:01:26 2022] GET /compute/v2.1/servers/50eed27b-6da2-4dda-94cc-02fc5cfec071 => generated 1322 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 24 05:01:26.648999 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [req-fae1e0b2-7e7c-45d5-8c88-178bb7f09a44 req-4a57616c-a97c-4226-a335-de06558746ee service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "50eed27b-6da2-4dda-94cc-02fc5cfec071", "tag": "990ceab0-dcdb-43e0-ab13-ed36ddfbeabf"}]} {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 05:01:26.659428 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [req-fae1e0b2-7e7c-45d5-8c88-178bb7f09a44 req-4a57616c-a97c-4226-a335-de06558746ee service nova] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:01:26.659900 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [req-fae1e0b2-7e7c-45d5-8c88-178bb7f09a44 req-4a57616c-a97c-4226-a335-de06558746ee service nova] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:01:26.660333 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [req-fae1e0b2-7e7c-45d5-8c88-178bb7f09a44 req-4a57616c-a97c-4226-a335-de06558746ee service nova] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:01:26.670996 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: INFO nova.api.openstack.compute.server_external_events [req-fae1e0b2-7e7c-45d5-8c88-178bb7f09a44 req-4a57616c-a97c-4226-a335-de06558746ee service nova] Creating event network-changed:990ceab0-dcdb-43e0-ab13-ed36ddfbeabf for instance 50eed27b-6da2-4dda-94cc-02fc5cfec071 on hv-cinder-85918 Sep 24 05:01:26.676117 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [req-fae1e0b2-7e7c-45d5-8c88-178bb7f09a44 req-4a57616c-a97c-4226-a335-de06558746ee service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031117 Sep 24 05:01:26.676692 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 59/115] 10.222.0.50 () {64 vars in 1317 bytes} [Sat Sep 24 05:01:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 05:01:26.742597 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-bbd7f74d-6e8a-48e8-9bc8-8147b7259263 tempest-DeleteServersTestJSON-1630660203 tempest-DeleteServersTestJSON-1630660203-project] Calling method '>' {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:01:26.743196 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.compute.api [None req-bbd7f74d-6e8a-48e8-9bc8-8147b7259263 tempest-DeleteServersTestJSON-1630660203 tempest-DeleteServersTestJSON-1630660203-project] [instance: ec88b440-40a0-459f-b94b-06c332e86094] Fetching instance by UUID {{(pid=120593) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:01:26.749001 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-bbd7f74d-6e8a-48e8-9bc8-8147b7259263 tempest-DeleteServersTestJSON-1630660203 tempest-DeleteServersTestJSON-1630660203-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:01:26.749475 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-bbd7f74d-6e8a-48e8-9bc8-8147b7259263 tempest-DeleteServersTestJSON-1630660203 tempest-DeleteServersTestJSON-1630660203-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:01:26.749902 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-bbd7f74d-6e8a-48e8-9bc8-8147b7259263 tempest-DeleteServersTestJSON-1630660203 tempest-DeleteServersTestJSON-1630660203-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:01:26.750595 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-bbd7f74d-6e8a-48e8-9bc8-8147b7259263 tempest-DeleteServersTestJSON-1630660203 tempest-DeleteServersTestJSON-1630660203-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:01:26.751039 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-bbd7f74d-6e8a-48e8-9bc8-8147b7259263 tempest-DeleteServersTestJSON-1630660203 tempest-DeleteServersTestJSON-1630660203-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:01:26.751458 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-bbd7f74d-6e8a-48e8-9bc8-8147b7259263 tempest-DeleteServersTestJSON-1630660203 tempest-DeleteServersTestJSON-1630660203-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:01:26.820020 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-f278f8ec-2803-4379-a63f-c3be99b4900e tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Calling method '>' {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:01:26.820860 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.compute.api [None req-f278f8ec-2803-4379-a63f-c3be99b4900e tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] [instance: b2daebb8-dfea-4ab9-8253-008a21f906e1] Fetching instance by UUID {{(pid=120594) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:01:26.826872 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-f278f8ec-2803-4379-a63f-c3be99b4900e tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:01:26.827343 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-f278f8ec-2803-4379-a63f-c3be99b4900e tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:01:26.827786 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-f278f8ec-2803-4379-a63f-c3be99b4900e tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:01:26.828463 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-f278f8ec-2803-4379-a63f-c3be99b4900e tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:01:26.828903 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-f278f8ec-2803-4379-a63f-c3be99b4900e tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:01:26.829317 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-f278f8ec-2803-4379-a63f-c3be99b4900e tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:01:26.912467 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-bbd7f74d-6e8a-48e8-9bc8-8147b7259263 tempest-DeleteServersTestJSON-1630660203 tempest-DeleteServersTestJSON-1630660203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27d1a24c9e15493195744bcbf598ac4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa84dfa1cc764dc99b6e804e778c3479', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:01:26.920160 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-bbd7f74d-6e8a-48e8-9bc8-8147b7259263 tempest-DeleteServersTestJSON-1630660203 tempest-DeleteServersTestJSON-1630660203-project] 10.222.0.50 "GET /compute/v2.1/servers/ec88b440-40a0-459f-b94b-06c332e86094" status: 200 len: 1315 microversion: 2.1 time: 0.181369 Sep 24 05:01:26.920739 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 57/116] 10.222.0.50 () {58 vars in 1236 bytes} [Sat Sep 24 05:01:26 2022] GET /compute/v2.1/servers/ec88b440-40a0-459f-b94b-06c332e86094 => generated 1315 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 05:01:26.971980 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.policy [None req-f278f8ec-2803-4379-a63f-c3be99b4900e tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b1b0448e7f54e3aaae49e411699269e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66ec8bde739145dda504995dbea0914a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:01:26.979567 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [None req-f278f8ec-2803-4379-a63f-c3be99b4900e tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] 10.222.0.50 "GET /compute/v2.1/servers/b2daebb8-dfea-4ab9-8253-008a21f906e1" status: 200 len: 1363 microversion: 2.1 time: 0.163767 Sep 24 05:01:26.980130 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 60/117] 10.222.0.50 () {58 vars in 1236 bytes} [Sat Sep 24 05:01:26 2022] GET /compute/v2.1/servers/b2daebb8-dfea-4ab9-8253-008a21f906e1 => generated 1363 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 24 05:01:27.003413 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-8aa7998f-cca7-4876-b1bd-2a95683696f3 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Calling method '>' {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:01:27.003957 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.compute.api [None req-8aa7998f-cca7-4876-b1bd-2a95683696f3 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] [instance: 201433d5-db4e-4e57-a800-42fe5cfc95ca] Fetching instance by UUID {{(pid=120593) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:01:27.009781 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-8aa7998f-cca7-4876-b1bd-2a95683696f3 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:01:27.010320 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-8aa7998f-cca7-4876-b1bd-2a95683696f3 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:01:27.010749 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-8aa7998f-cca7-4876-b1bd-2a95683696f3 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:01:27.011429 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-8aa7998f-cca7-4876-b1bd-2a95683696f3 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:01:27.011875 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-8aa7998f-cca7-4876-b1bd-2a95683696f3 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:01:27.012292 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-8aa7998f-cca7-4876-b1bd-2a95683696f3 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:01:27.073729 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-8aa7998f-cca7-4876-b1bd-2a95683696f3 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74a8cc19ab204424ab23c62915ac2bab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87d5229e39fe4817b5187068d8acecc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:01:27.081745 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-8aa7998f-cca7-4876-b1bd-2a95683696f3 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] 10.222.0.50 "GET /compute/v2.1/servers/201433d5-db4e-4e57-a800-42fe5cfc95ca" status: 200 len: 1294 microversion: 2.1 time: 0.082134 Sep 24 05:01:27.082326 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 58/118] 10.222.0.50 () {58 vars in 1236 bytes} [Sat Sep 24 05:01:26 2022] GET /compute/v2.1/servers/201433d5-db4e-4e57-a800-42fe5cfc95ca => generated 1294 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 05:01:27.272940 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-abbd482f-3ae4-4f68-b315-d5bbfde90c69 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Calling method '>' {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:01:27.273528 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.compute.api [None req-abbd482f-3ae4-4f68-b315-d5bbfde90c69 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] [instance: 08fb826b-e891-46c4-990d-ca03cf3f4222] Fetching instance by UUID {{(pid=120594) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:01:27.279437 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-abbd482f-3ae4-4f68-b315-d5bbfde90c69 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:01:27.279911 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-abbd482f-3ae4-4f68-b315-d5bbfde90c69 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:01:27.280342 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-abbd482f-3ae4-4f68-b315-d5bbfde90c69 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:01:27.281628 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-abbd482f-3ae4-4f68-b315-d5bbfde90c69 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:01:27.282104 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-abbd482f-3ae4-4f68-b315-d5bbfde90c69 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:01:27.282526 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-abbd482f-3ae4-4f68-b315-d5bbfde90c69 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:01:27.394318 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-06b4876e-314e-44d8-9ce3-55aef2de724b tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Calling method '>' {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:01:27.394953 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.compute.api [None req-06b4876e-314e-44d8-9ce3-55aef2de724b tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] [instance: 50eed27b-6da2-4dda-94cc-02fc5cfec071] Fetching instance by UUID {{(pid=120593) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:01:27.400669 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-06b4876e-314e-44d8-9ce3-55aef2de724b tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:01:27.401146 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-06b4876e-314e-44d8-9ce3-55aef2de724b tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:01:27.401607 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-06b4876e-314e-44d8-9ce3-55aef2de724b tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:01:27.402327 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-06b4876e-314e-44d8-9ce3-55aef2de724b tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:01:27.402783 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-06b4876e-314e-44d8-9ce3-55aef2de724b tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:01:27.403186 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-06b4876e-314e-44d8-9ce3-55aef2de724b tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:01:27.410287 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.policy [None req-abbd482f-3ae4-4f68-b315-d5bbfde90c69 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0948754217fc4ff2ba0241fa35feaf90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1aaf20f480a423ea5feca81585aeeed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:01:27.418356 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.policy [None req-abbd482f-3ae4-4f68-b315-d5bbfde90c69 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0948754217fc4ff2ba0241fa35feaf90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1aaf20f480a423ea5feca81585aeeed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:01:27.419844 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.policy [None req-abbd482f-3ae4-4f68-b315-d5bbfde90c69 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0948754217fc4ff2ba0241fa35feaf90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1aaf20f480a423ea5feca81585aeeed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:01:27.420928 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [None req-abbd482f-3ae4-4f68-b315-d5bbfde90c69 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] 10.222.0.50 "GET /compute/v2.1/servers/08fb826b-e891-46c4-990d-ca03cf3f4222" status: 200 len: 1404 microversion: 2.20 time: 0.152000 Sep 24 05:01:27.422067 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 61/119] 10.222.0.50 () {60 vars in 1277 bytes} [Sat Sep 24 05:01:27 2022] GET /compute/v2.1/servers/08fb826b-e891-46c4-990d-ca03cf3f4222 => generated 1404 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 05:01:27.528155 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-06b4876e-314e-44d8-9ce3-55aef2de724b tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cdd0da2c7bc4139bcd48ef36a2ee183', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a18a3756ba2b460d977f738a115ebfe0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:01:27.536305 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-06b4876e-314e-44d8-9ce3-55aef2de724b tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] 10.222.0.50 "GET /compute/v2.1/servers/50eed27b-6da2-4dda-94cc-02fc5cfec071" status: 200 len: 1322 microversion: 2.1 time: 0.145866 Sep 24 05:01:27.536864 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 59/120] 10.222.0.50 () {58 vars in 1236 bytes} [Sat Sep 24 05:01:27 2022] GET /compute/v2.1/servers/50eed27b-6da2-4dda-94cc-02fc5cfec071 => generated 1322 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 24 05:01:27.943574 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-98491ce5-a72a-4e68-823d-3da4af341f4e tempest-DeleteServersTestJSON-1630660203 tempest-DeleteServersTestJSON-1630660203-project] Calling method '>' {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:01:27.944098 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.compute.api [None req-98491ce5-a72a-4e68-823d-3da4af341f4e tempest-DeleteServersTestJSON-1630660203 tempest-DeleteServersTestJSON-1630660203-project] [instance: ec88b440-40a0-459f-b94b-06c332e86094] Fetching instance by UUID {{(pid=120594) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:01:27.949942 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-98491ce5-a72a-4e68-823d-3da4af341f4e tempest-DeleteServersTestJSON-1630660203 tempest-DeleteServersTestJSON-1630660203-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:01:27.950445 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-98491ce5-a72a-4e68-823d-3da4af341f4e tempest-DeleteServersTestJSON-1630660203 tempest-DeleteServersTestJSON-1630660203-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:01:27.950871 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-98491ce5-a72a-4e68-823d-3da4af341f4e tempest-DeleteServersTestJSON-1630660203 tempest-DeleteServersTestJSON-1630660203-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:01:27.951569 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-98491ce5-a72a-4e68-823d-3da4af341f4e tempest-DeleteServersTestJSON-1630660203 tempest-DeleteServersTestJSON-1630660203-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:01:27.952013 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-98491ce5-a72a-4e68-823d-3da4af341f4e tempest-DeleteServersTestJSON-1630660203 tempest-DeleteServersTestJSON-1630660203-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:01:27.952424 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-98491ce5-a72a-4e68-823d-3da4af341f4e tempest-DeleteServersTestJSON-1630660203 tempest-DeleteServersTestJSON-1630660203-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:01:28.002427 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-7ba24218-f9c5-4e68-a6bc-05b8ab3906d6 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Calling method '>' {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:01:28.003082 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.compute.api [None req-7ba24218-f9c5-4e68-a6bc-05b8ab3906d6 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] [instance: b2daebb8-dfea-4ab9-8253-008a21f906e1] Fetching instance by UUID {{(pid=120593) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:01:28.008923 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-7ba24218-f9c5-4e68-a6bc-05b8ab3906d6 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:01:28.009407 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-7ba24218-f9c5-4e68-a6bc-05b8ab3906d6 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:01:28.009837 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-7ba24218-f9c5-4e68-a6bc-05b8ab3906d6 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:01:28.010543 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-7ba24218-f9c5-4e68-a6bc-05b8ab3906d6 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:01:28.010992 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-7ba24218-f9c5-4e68-a6bc-05b8ab3906d6 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:01:28.011443 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-7ba24218-f9c5-4e68-a6bc-05b8ab3906d6 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:01:28.118921 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.policy [None req-98491ce5-a72a-4e68-823d-3da4af341f4e tempest-DeleteServersTestJSON-1630660203 tempest-DeleteServersTestJSON-1630660203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27d1a24c9e15493195744bcbf598ac4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa84dfa1cc764dc99b6e804e778c3479', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:01:28.126612 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [None req-98491ce5-a72a-4e68-823d-3da4af341f4e tempest-DeleteServersTestJSON-1630660203 tempest-DeleteServersTestJSON-1630660203-project] 10.222.0.50 "GET /compute/v2.1/servers/ec88b440-40a0-459f-b94b-06c332e86094" status: 200 len: 1315 microversion: 2.1 time: 0.186903 Sep 24 05:01:28.127300 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 62/121] 10.222.0.50 () {58 vars in 1236 bytes} [Sat Sep 24 05:01:27 2022] GET /compute/v2.1/servers/ec88b440-40a0-459f-b94b-06c332e86094 => generated 1315 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 05:01:28.131807 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-c85fa5e3-33e3-4fa6-99a1-b803b32c1775 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Calling method '>' {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:01:28.132475 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.compute.api [None req-c85fa5e3-33e3-4fa6-99a1-b803b32c1775 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] [instance: 201433d5-db4e-4e57-a800-42fe5cfc95ca] Fetching instance by UUID {{(pid=120594) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:01:28.138269 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-c85fa5e3-33e3-4fa6-99a1-b803b32c1775 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:01:28.138904 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-c85fa5e3-33e3-4fa6-99a1-b803b32c1775 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:01:28.139772 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-c85fa5e3-33e3-4fa6-99a1-b803b32c1775 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:01:28.140500 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-c85fa5e3-33e3-4fa6-99a1-b803b32c1775 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:01:28.140949 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-c85fa5e3-33e3-4fa6-99a1-b803b32c1775 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:01:28.141367 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-c85fa5e3-33e3-4fa6-99a1-b803b32c1775 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:01:28.164088 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-7ba24218-f9c5-4e68-a6bc-05b8ab3906d6 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b1b0448e7f54e3aaae49e411699269e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66ec8bde739145dda504995dbea0914a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:01:28.172364 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-7ba24218-f9c5-4e68-a6bc-05b8ab3906d6 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] 10.222.0.50 "GET /compute/v2.1/servers/b2daebb8-dfea-4ab9-8253-008a21f906e1" status: 200 len: 1363 microversion: 2.1 time: 0.173876 Sep 24 05:01:28.172931 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 60/122] 10.222.0.50 () {58 vars in 1236 bytes} [Sat Sep 24 05:01:27 2022] GET /compute/v2.1/servers/b2daebb8-dfea-4ab9-8253-008a21f906e1 => generated 1363 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 24 05:01:28.201268 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.policy [None req-c85fa5e3-33e3-4fa6-99a1-b803b32c1775 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74a8cc19ab204424ab23c62915ac2bab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87d5229e39fe4817b5187068d8acecc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:01:28.208777 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [None req-c85fa5e3-33e3-4fa6-99a1-b803b32c1775 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] 10.222.0.50 "GET /compute/v2.1/servers/201433d5-db4e-4e57-a800-42fe5cfc95ca" status: 200 len: 1294 microversion: 2.1 time: 0.080484 Sep 24 05:01:28.209334 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 63/123] 10.222.0.50 () {58 vars in 1236 bytes} [Sat Sep 24 05:01:28 2022] GET /compute/v2.1/servers/201433d5-db4e-4e57-a800-42fe5cfc95ca => generated 1294 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 05:01:28.446413 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-a59da5c1-159c-48f2-ab4d-5fd50e9a7914 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Calling method '>' {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:01:28.447003 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.compute.api [None req-a59da5c1-159c-48f2-ab4d-5fd50e9a7914 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] [instance: 08fb826b-e891-46c4-990d-ca03cf3f4222] Fetching instance by UUID {{(pid=120593) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:01:28.453537 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-a59da5c1-159c-48f2-ab4d-5fd50e9a7914 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:01:28.453948 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-a59da5c1-159c-48f2-ab4d-5fd50e9a7914 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:01:28.454404 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-a59da5c1-159c-48f2-ab4d-5fd50e9a7914 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:01:28.455075 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-a59da5c1-159c-48f2-ab4d-5fd50e9a7914 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:01:28.455515 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-a59da5c1-159c-48f2-ab4d-5fd50e9a7914 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:01:28.455929 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-a59da5c1-159c-48f2-ab4d-5fd50e9a7914 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:01:28.558548 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-0e8ec576-4a92-4679-ad87-eca9fe203cb7 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Calling method '>' {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:01:28.559154 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.compute.api [None req-0e8ec576-4a92-4679-ad87-eca9fe203cb7 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] [instance: 50eed27b-6da2-4dda-94cc-02fc5cfec071] Fetching instance by UUID {{(pid=120594) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:01:28.565001 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-0e8ec576-4a92-4679-ad87-eca9fe203cb7 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:01:28.565472 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-0e8ec576-4a92-4679-ad87-eca9fe203cb7 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:01:28.565902 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-0e8ec576-4a92-4679-ad87-eca9fe203cb7 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:01:28.566605 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-0e8ec576-4a92-4679-ad87-eca9fe203cb7 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:01:28.567050 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-0e8ec576-4a92-4679-ad87-eca9fe203cb7 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:01:28.567464 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-0e8ec576-4a92-4679-ad87-eca9fe203cb7 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:01:28.587646 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-a59da5c1-159c-48f2-ab4d-5fd50e9a7914 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0948754217fc4ff2ba0241fa35feaf90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1aaf20f480a423ea5feca81585aeeed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:01:28.596641 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-a59da5c1-159c-48f2-ab4d-5fd50e9a7914 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0948754217fc4ff2ba0241fa35feaf90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1aaf20f480a423ea5feca81585aeeed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:01:28.598091 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-a59da5c1-159c-48f2-ab4d-5fd50e9a7914 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0948754217fc4ff2ba0241fa35feaf90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1aaf20f480a423ea5feca81585aeeed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:01:28.599167 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-a59da5c1-159c-48f2-ab4d-5fd50e9a7914 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] 10.222.0.50 "GET /compute/v2.1/servers/08fb826b-e891-46c4-990d-ca03cf3f4222" status: 200 len: 1404 microversion: 2.20 time: 0.156865 Sep 24 05:01:28.599930 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 61/124] 10.222.0.50 () {60 vars in 1277 bytes} [Sat Sep 24 05:01:28 2022] GET /compute/v2.1/servers/08fb826b-e891-46c4-990d-ca03cf3f4222 => generated 1404 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 05:01:28.719025 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.policy [None req-0e8ec576-4a92-4679-ad87-eca9fe203cb7 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cdd0da2c7bc4139bcd48ef36a2ee183', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a18a3756ba2b460d977f738a115ebfe0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:01:28.726577 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [None req-0e8ec576-4a92-4679-ad87-eca9fe203cb7 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] 10.222.0.50 "GET /compute/v2.1/servers/50eed27b-6da2-4dda-94cc-02fc5cfec071" status: 200 len: 1322 microversion: 2.1 time: 0.171846 Sep 24 05:01:28.727142 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 64/125] 10.222.0.50 () {58 vars in 1236 bytes} [Sat Sep 24 05:01:28 2022] GET /compute/v2.1/servers/50eed27b-6da2-4dda-94cc-02fc5cfec071 => generated 1322 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 05:01:29.148608 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-753bd94b-5123-4be5-851e-bd8885361bf7 tempest-DeleteServersTestJSON-1630660203 tempest-DeleteServersTestJSON-1630660203-project] Calling method '>' {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:01:29.149236 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.compute.api [None req-753bd94b-5123-4be5-851e-bd8885361bf7 tempest-DeleteServersTestJSON-1630660203 tempest-DeleteServersTestJSON-1630660203-project] [instance: ec88b440-40a0-459f-b94b-06c332e86094] Fetching instance by UUID {{(pid=120593) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:01:29.155119 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-753bd94b-5123-4be5-851e-bd8885361bf7 tempest-DeleteServersTestJSON-1630660203 tempest-DeleteServersTestJSON-1630660203-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:01:29.155591 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-753bd94b-5123-4be5-851e-bd8885361bf7 tempest-DeleteServersTestJSON-1630660203 tempest-DeleteServersTestJSON-1630660203-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:01:29.156044 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-753bd94b-5123-4be5-851e-bd8885361bf7 tempest-DeleteServersTestJSON-1630660203 tempest-DeleteServersTestJSON-1630660203-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:01:29.156718 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-753bd94b-5123-4be5-851e-bd8885361bf7 tempest-DeleteServersTestJSON-1630660203 tempest-DeleteServersTestJSON-1630660203-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:01:29.157161 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-753bd94b-5123-4be5-851e-bd8885361bf7 tempest-DeleteServersTestJSON-1630660203 tempest-DeleteServersTestJSON-1630660203-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:01:29.157578 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-753bd94b-5123-4be5-851e-bd8885361bf7 tempest-DeleteServersTestJSON-1630660203 tempest-DeleteServersTestJSON-1630660203-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:01:29.194549 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-f4838e05-4803-4688-9b17-87482c69a8b1 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Calling method '>' {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:01:29.195154 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.compute.api [None req-f4838e05-4803-4688-9b17-87482c69a8b1 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] [instance: b2daebb8-dfea-4ab9-8253-008a21f906e1] Fetching instance by UUID {{(pid=120594) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:01:29.201121 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-f4838e05-4803-4688-9b17-87482c69a8b1 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:01:29.201598 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-f4838e05-4803-4688-9b17-87482c69a8b1 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:01:29.202045 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-f4838e05-4803-4688-9b17-87482c69a8b1 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:01:29.203312 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-f4838e05-4803-4688-9b17-87482c69a8b1 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:01:29.203760 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-f4838e05-4803-4688-9b17-87482c69a8b1 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:01:29.204177 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-f4838e05-4803-4688-9b17-87482c69a8b1 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:01:29.338655 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-753bd94b-5123-4be5-851e-bd8885361bf7 tempest-DeleteServersTestJSON-1630660203 tempest-DeleteServersTestJSON-1630660203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27d1a24c9e15493195744bcbf598ac4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa84dfa1cc764dc99b6e804e778c3479', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:01:29.346492 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-753bd94b-5123-4be5-851e-bd8885361bf7 tempest-DeleteServersTestJSON-1630660203 tempest-DeleteServersTestJSON-1630660203-project] 10.222.0.50 "GET /compute/v2.1/servers/ec88b440-40a0-459f-b94b-06c332e86094" status: 200 len: 1315 microversion: 2.1 time: 0.201620 Sep 24 05:01:29.354853 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 62/126] 10.222.0.50 () {58 vars in 1236 bytes} [Sat Sep 24 05:01:29 2022] GET /compute/v2.1/servers/ec88b440-40a0-459f-b94b-06c332e86094 => generated 1315 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 05:01:29.354853 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-0bcc5e77-aae4-447d-a885-1fb10c486573 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Calling method '>' {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:01:29.354853 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.compute.api [None req-0bcc5e77-aae4-447d-a885-1fb10c486573 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] [instance: 201433d5-db4e-4e57-a800-42fe5cfc95ca] Fetching instance by UUID {{(pid=120593) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:01:29.358571 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-0bcc5e77-aae4-447d-a885-1fb10c486573 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:01:29.359877 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-0bcc5e77-aae4-447d-a885-1fb10c486573 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:01:29.360351 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-0bcc5e77-aae4-447d-a885-1fb10c486573 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:01:29.361039 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-0bcc5e77-aae4-447d-a885-1fb10c486573 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:01:29.361519 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-0bcc5e77-aae4-447d-a885-1fb10c486573 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:01:29.361927 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-0bcc5e77-aae4-447d-a885-1fb10c486573 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:01:29.362254 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.policy [None req-f4838e05-4803-4688-9b17-87482c69a8b1 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b1b0448e7f54e3aaae49e411699269e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66ec8bde739145dda504995dbea0914a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:01:29.370816 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [None req-f4838e05-4803-4688-9b17-87482c69a8b1 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] 10.222.0.50 "GET /compute/v2.1/servers/b2daebb8-dfea-4ab9-8253-008a21f906e1" status: 200 len: 1363 microversion: 2.1 time: 0.179967 Sep 24 05:01:29.371474 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 65/127] 10.222.0.50 () {58 vars in 1236 bytes} [Sat Sep 24 05:01:29 2022] GET /compute/v2.1/servers/b2daebb8-dfea-4ab9-8253-008a21f906e1 => generated 1363 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 24 05:01:29.425487 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-0bcc5e77-aae4-447d-a885-1fb10c486573 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74a8cc19ab204424ab23c62915ac2bab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87d5229e39fe4817b5187068d8acecc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:01:29.433003 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-0bcc5e77-aae4-447d-a885-1fb10c486573 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] 10.222.0.50 "GET /compute/v2.1/servers/201433d5-db4e-4e57-a800-42fe5cfc95ca" status: 200 len: 1294 microversion: 2.1 time: 0.084911 Sep 24 05:01:29.433566 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 63/128] 10.222.0.50 () {58 vars in 1236 bytes} [Sat Sep 24 05:01:29 2022] GET /compute/v2.1/servers/201433d5-db4e-4e57-a800-42fe5cfc95ca => generated 1294 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 05:01:29.626332 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-668c84d9-f461-42ca-a079-0dc1acaf266a tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Calling method '>' {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:01:29.626868 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.compute.api [None req-668c84d9-f461-42ca-a079-0dc1acaf266a tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] [instance: 08fb826b-e891-46c4-990d-ca03cf3f4222] Fetching instance by UUID {{(pid=120594) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:01:29.632828 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-668c84d9-f461-42ca-a079-0dc1acaf266a tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:01:29.633299 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-668c84d9-f461-42ca-a079-0dc1acaf266a tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:01:29.633726 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-668c84d9-f461-42ca-a079-0dc1acaf266a tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:01:29.634426 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-668c84d9-f461-42ca-a079-0dc1acaf266a tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:01:29.634869 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-668c84d9-f461-42ca-a079-0dc1acaf266a tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:01:29.635282 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-668c84d9-f461-42ca-a079-0dc1acaf266a tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:01:29.751011 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-51042e83-bb9c-4f2e-b3e6-4c5ac1b29b95 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Calling method '>' {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:01:29.752312 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.compute.api [None req-51042e83-bb9c-4f2e-b3e6-4c5ac1b29b95 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] [instance: 50eed27b-6da2-4dda-94cc-02fc5cfec071] Fetching instance by UUID {{(pid=120593) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:01:29.759952 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-51042e83-bb9c-4f2e-b3e6-4c5ac1b29b95 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:01:29.760681 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-51042e83-bb9c-4f2e-b3e6-4c5ac1b29b95 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:01:29.761210 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-51042e83-bb9c-4f2e-b3e6-4c5ac1b29b95 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:01:29.762054 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-51042e83-bb9c-4f2e-b3e6-4c5ac1b29b95 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:01:29.762594 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-51042e83-bb9c-4f2e-b3e6-4c5ac1b29b95 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:01:29.763110 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-51042e83-bb9c-4f2e-b3e6-4c5ac1b29b95 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:01:29.779065 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.policy [None req-668c84d9-f461-42ca-a079-0dc1acaf266a tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0948754217fc4ff2ba0241fa35feaf90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1aaf20f480a423ea5feca81585aeeed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:01:29.793192 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.policy [None req-668c84d9-f461-42ca-a079-0dc1acaf266a tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0948754217fc4ff2ba0241fa35feaf90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1aaf20f480a423ea5feca81585aeeed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:01:29.795467 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.policy [None req-668c84d9-f461-42ca-a079-0dc1acaf266a tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0948754217fc4ff2ba0241fa35feaf90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1aaf20f480a423ea5feca81585aeeed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:01:29.797260 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [None req-668c84d9-f461-42ca-a079-0dc1acaf266a tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] 10.222.0.50 "GET /compute/v2.1/servers/08fb826b-e891-46c4-990d-ca03cf3f4222" status: 200 len: 1404 microversion: 2.20 time: 0.174257 Sep 24 05:01:29.797875 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 66/129] 10.222.0.50 () {60 vars in 1277 bytes} [Sat Sep 24 05:01:29 2022] GET /compute/v2.1/servers/08fb826b-e891-46c4-990d-ca03cf3f4222 => generated 1404 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 05:01:29.894929 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-51042e83-bb9c-4f2e-b3e6-4c5ac1b29b95 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cdd0da2c7bc4139bcd48ef36a2ee183', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a18a3756ba2b460d977f738a115ebfe0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:01:29.902564 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-51042e83-bb9c-4f2e-b3e6-4c5ac1b29b95 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] 10.222.0.50 "GET /compute/v2.1/servers/50eed27b-6da2-4dda-94cc-02fc5cfec071" status: 200 len: 1322 microversion: 2.1 time: 0.156406 Sep 24 05:01:29.903120 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 64/130] 10.222.0.50 () {58 vars in 1236 bytes} [Sat Sep 24 05:01:29 2022] GET /compute/v2.1/servers/50eed27b-6da2-4dda-94cc-02fc5cfec071 => generated 1322 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 05:01:30.371415 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-2d64f8f6-c250-4792-8a84-aa4b07a5af21 tempest-DeleteServersTestJSON-1630660203 tempest-DeleteServersTestJSON-1630660203-project] Calling method '>' {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:01:30.372012 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.compute.api [None req-2d64f8f6-c250-4792-8a84-aa4b07a5af21 tempest-DeleteServersTestJSON-1630660203 tempest-DeleteServersTestJSON-1630660203-project] [instance: ec88b440-40a0-459f-b94b-06c332e86094] Fetching instance by UUID {{(pid=120594) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:01:30.378225 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-2d64f8f6-c250-4792-8a84-aa4b07a5af21 tempest-DeleteServersTestJSON-1630660203 tempest-DeleteServersTestJSON-1630660203-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:01:30.378697 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-2d64f8f6-c250-4792-8a84-aa4b07a5af21 tempest-DeleteServersTestJSON-1630660203 tempest-DeleteServersTestJSON-1630660203-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:01:30.379127 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-2d64f8f6-c250-4792-8a84-aa4b07a5af21 tempest-DeleteServersTestJSON-1630660203 tempest-DeleteServersTestJSON-1630660203-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:01:30.379798 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-2d64f8f6-c250-4792-8a84-aa4b07a5af21 tempest-DeleteServersTestJSON-1630660203 tempest-DeleteServersTestJSON-1630660203-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:01:30.380239 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-2d64f8f6-c250-4792-8a84-aa4b07a5af21 tempest-DeleteServersTestJSON-1630660203 tempest-DeleteServersTestJSON-1630660203-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:01:30.380650 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-2d64f8f6-c250-4792-8a84-aa4b07a5af21 tempest-DeleteServersTestJSON-1630660203 tempest-DeleteServersTestJSON-1630660203-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:01:30.395377 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-eb03b5d7-aabf-4086-8c15-146023384b3b tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Calling method '>' {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:01:30.395979 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.compute.api [None req-eb03b5d7-aabf-4086-8c15-146023384b3b tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] [instance: b2daebb8-dfea-4ab9-8253-008a21f906e1] Fetching instance by UUID {{(pid=120593) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:01:30.403546 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-eb03b5d7-aabf-4086-8c15-146023384b3b tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:01:30.404043 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-eb03b5d7-aabf-4086-8c15-146023384b3b tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:01:30.404476 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-eb03b5d7-aabf-4086-8c15-146023384b3b tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:01:30.405162 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-eb03b5d7-aabf-4086-8c15-146023384b3b tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:01:30.406200 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-eb03b5d7-aabf-4086-8c15-146023384b3b tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:01:30.406579 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-eb03b5d7-aabf-4086-8c15-146023384b3b tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:01:30.719680 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.policy [None req-2d64f8f6-c250-4792-8a84-aa4b07a5af21 tempest-DeleteServersTestJSON-1630660203 tempest-DeleteServersTestJSON-1630660203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27d1a24c9e15493195744bcbf598ac4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa84dfa1cc764dc99b6e804e778c3479', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:01:30.723274 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-eb03b5d7-aabf-4086-8c15-146023384b3b tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b1b0448e7f54e3aaae49e411699269e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66ec8bde739145dda504995dbea0914a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:01:30.728124 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [None req-2d64f8f6-c250-4792-8a84-aa4b07a5af21 tempest-DeleteServersTestJSON-1630660203 tempest-DeleteServersTestJSON-1630660203-project] 10.222.0.50 "GET /compute/v2.1/servers/ec88b440-40a0-459f-b94b-06c332e86094" status: 200 len: 1315 microversion: 2.1 time: 0.360574 Sep 24 05:01:30.728871 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 67/131] 10.222.0.50 () {58 vars in 1236 bytes} [Sat Sep 24 05:01:30 2022] GET /compute/v2.1/servers/ec88b440-40a0-459f-b94b-06c332e86094 => generated 1315 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 05:01:30.733384 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-d49bdb71-9466-4eff-b263-02ed5a96f5c0 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Calling method '>' {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:01:30.734325 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-eb03b5d7-aabf-4086-8c15-146023384b3b tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] 10.222.0.50 "GET /compute/v2.1/servers/b2daebb8-dfea-4ab9-8253-008a21f906e1" status: 200 len: 1363 microversion: 2.1 time: 0.341871 Sep 24 05:01:30.734518 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.compute.api [None req-d49bdb71-9466-4eff-b263-02ed5a96f5c0 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] [instance: 201433d5-db4e-4e57-a800-42fe5cfc95ca] Fetching instance by UUID {{(pid=120594) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:01:30.735256 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 65/132] 10.222.0.50 () {58 vars in 1236 bytes} [Sat Sep 24 05:01:30 2022] GET /compute/v2.1/servers/b2daebb8-dfea-4ab9-8253-008a21f906e1 => generated 1363 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 24 05:01:30.742727 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-d49bdb71-9466-4eff-b263-02ed5a96f5c0 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:01:30.743207 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-d49bdb71-9466-4eff-b263-02ed5a96f5c0 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:01:30.743667 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-d49bdb71-9466-4eff-b263-02ed5a96f5c0 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:01:30.744393 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-d49bdb71-9466-4eff-b263-02ed5a96f5c0 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:01:30.744894 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-d49bdb71-9466-4eff-b263-02ed5a96f5c0 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:01:30.745314 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-d49bdb71-9466-4eff-b263-02ed5a96f5c0 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:01:30.814624 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.policy [None req-d49bdb71-9466-4eff-b263-02ed5a96f5c0 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74a8cc19ab204424ab23c62915ac2bab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87d5229e39fe4817b5187068d8acecc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:01:30.824453 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-acc8977f-1f69-47c5-89a2-1226798f7e5c tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Calling method '>' {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:01:30.825276 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.compute.api [None req-acc8977f-1f69-47c5-89a2-1226798f7e5c tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] [instance: 08fb826b-e891-46c4-990d-ca03cf3f4222] Fetching instance by UUID {{(pid=120593) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:01:30.829294 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [None req-d49bdb71-9466-4eff-b263-02ed5a96f5c0 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] 10.222.0.50 "GET /compute/v2.1/servers/201433d5-db4e-4e57-a800-42fe5cfc95ca" status: 200 len: 1294 microversion: 2.1 time: 0.099387 Sep 24 05:01:30.830163 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 68/133] 10.222.0.50 () {58 vars in 1236 bytes} [Sat Sep 24 05:01:30 2022] GET /compute/v2.1/servers/201433d5-db4e-4e57-a800-42fe5cfc95ca => generated 1294 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 05:01:30.836189 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-acc8977f-1f69-47c5-89a2-1226798f7e5c tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:01:30.838065 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-acc8977f-1f69-47c5-89a2-1226798f7e5c tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:01:30.838727 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-acc8977f-1f69-47c5-89a2-1226798f7e5c tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:01:30.839608 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-acc8977f-1f69-47c5-89a2-1226798f7e5c tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:01:30.841000 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-acc8977f-1f69-47c5-89a2-1226798f7e5c tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:01:30.841629 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-acc8977f-1f69-47c5-89a2-1226798f7e5c tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:01:30.927735 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-cd84965b-b010-49b9-bd9a-460b013e01f4 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Calling method '>' {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:01:30.928452 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.compute.api [None req-cd84965b-b010-49b9-bd9a-460b013e01f4 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] [instance: 50eed27b-6da2-4dda-94cc-02fc5cfec071] Fetching instance by UUID {{(pid=120594) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:01:30.935697 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-cd84965b-b010-49b9-bd9a-460b013e01f4 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:01:30.937136 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-cd84965b-b010-49b9-bd9a-460b013e01f4 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:01:30.938370 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-cd84965b-b010-49b9-bd9a-460b013e01f4 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:01:30.939620 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-cd84965b-b010-49b9-bd9a-460b013e01f4 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:01:30.940109 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-cd84965b-b010-49b9-bd9a-460b013e01f4 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:01:30.940565 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-cd84965b-b010-49b9-bd9a-460b013e01f4 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:01:31.137367 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-acc8977f-1f69-47c5-89a2-1226798f7e5c tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0948754217fc4ff2ba0241fa35feaf90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1aaf20f480a423ea5feca81585aeeed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:01:31.160631 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-acc8977f-1f69-47c5-89a2-1226798f7e5c tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0948754217fc4ff2ba0241fa35feaf90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1aaf20f480a423ea5feca81585aeeed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:01:31.162479 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-acc8977f-1f69-47c5-89a2-1226798f7e5c tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0948754217fc4ff2ba0241fa35feaf90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1aaf20f480a423ea5feca81585aeeed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:01:31.163598 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-acc8977f-1f69-47c5-89a2-1226798f7e5c tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] 10.222.0.50 "GET /compute/v2.1/servers/08fb826b-e891-46c4-990d-ca03cf3f4222" status: 200 len: 1404 microversion: 2.20 time: 0.344290 Sep 24 05:01:31.164277 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 66/134] 10.222.0.50 () {60 vars in 1277 bytes} [Sat Sep 24 05:01:30 2022] GET /compute/v2.1/servers/08fb826b-e891-46c4-990d-ca03cf3f4222 => generated 1404 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 24 05:01:31.244056 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.policy [None req-cd84965b-b010-49b9-bd9a-460b013e01f4 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cdd0da2c7bc4139bcd48ef36a2ee183', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a18a3756ba2b460d977f738a115ebfe0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:01:31.255978 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [None req-cd84965b-b010-49b9-bd9a-460b013e01f4 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] 10.222.0.50 "GET /compute/v2.1/servers/50eed27b-6da2-4dda-94cc-02fc5cfec071" status: 200 len: 1322 microversion: 2.1 time: 0.332961 Sep 24 05:01:31.258415 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 69/135] 10.222.0.50 () {58 vars in 1236 bytes} [Sat Sep 24 05:01:30 2022] GET /compute/v2.1/servers/50eed27b-6da2-4dda-94cc-02fc5cfec071 => generated 1322 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 05:01:31.755464 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-5e9c4ff5-a42a-4fd3-8d86-b15b74c7faee tempest-DeleteServersTestJSON-1630660203 tempest-DeleteServersTestJSON-1630660203-project] Calling method '>' {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:01:31.755998 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.compute.api [None req-5e9c4ff5-a42a-4fd3-8d86-b15b74c7faee tempest-DeleteServersTestJSON-1630660203 tempest-DeleteServersTestJSON-1630660203-project] [instance: ec88b440-40a0-459f-b94b-06c332e86094] Fetching instance by UUID {{(pid=120593) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:01:31.757134 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-db4ff8fb-0244-426f-b4e5-69e470191e78 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Calling method '>' {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:01:31.757744 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.compute.api [None req-db4ff8fb-0244-426f-b4e5-69e470191e78 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] [instance: b2daebb8-dfea-4ab9-8253-008a21f906e1] Fetching instance by UUID {{(pid=120594) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:01:31.762023 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-5e9c4ff5-a42a-4fd3-8d86-b15b74c7faee tempest-DeleteServersTestJSON-1630660203 tempest-DeleteServersTestJSON-1630660203-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:01:31.762509 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-5e9c4ff5-a42a-4fd3-8d86-b15b74c7faee tempest-DeleteServersTestJSON-1630660203 tempest-DeleteServersTestJSON-1630660203-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:01:31.762937 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-5e9c4ff5-a42a-4fd3-8d86-b15b74c7faee tempest-DeleteServersTestJSON-1630660203 tempest-DeleteServersTestJSON-1630660203-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:01:31.763524 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-db4ff8fb-0244-426f-b4e5-69e470191e78 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:01:31.763638 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-5e9c4ff5-a42a-4fd3-8d86-b15b74c7faee tempest-DeleteServersTestJSON-1630660203 tempest-DeleteServersTestJSON-1630660203-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:01:31.763996 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-db4ff8fb-0244-426f-b4e5-69e470191e78 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:01:31.764110 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-5e9c4ff5-a42a-4fd3-8d86-b15b74c7faee tempest-DeleteServersTestJSON-1630660203 tempest-DeleteServersTestJSON-1630660203-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:01:31.764686 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-db4ff8fb-0244-426f-b4e5-69e470191e78 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:01:31.764785 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-5e9c4ff5-a42a-4fd3-8d86-b15b74c7faee tempest-DeleteServersTestJSON-1630660203 tempest-DeleteServersTestJSON-1630660203-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:01:31.765859 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-db4ff8fb-0244-426f-b4e5-69e470191e78 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:01:31.766343 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-db4ff8fb-0244-426f-b4e5-69e470191e78 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:01:31.766761 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-db4ff8fb-0244-426f-b4e5-69e470191e78 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:01:31.958282 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-5e9c4ff5-a42a-4fd3-8d86-b15b74c7faee tempest-DeleteServersTestJSON-1630660203 tempest-DeleteServersTestJSON-1630660203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27d1a24c9e15493195744bcbf598ac4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa84dfa1cc764dc99b6e804e778c3479', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:01:31.960886 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.policy [None req-db4ff8fb-0244-426f-b4e5-69e470191e78 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b1b0448e7f54e3aaae49e411699269e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66ec8bde739145dda504995dbea0914a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:01:31.967434 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-5e9c4ff5-a42a-4fd3-8d86-b15b74c7faee tempest-DeleteServersTestJSON-1630660203 tempest-DeleteServersTestJSON-1630660203-project] 10.222.0.50 "GET /compute/v2.1/servers/ec88b440-40a0-459f-b94b-06c332e86094" status: 200 len: 1315 microversion: 2.1 time: 0.215775 Sep 24 05:01:31.968707 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 67/136] 10.222.0.50 () {58 vars in 1236 bytes} [Sat Sep 24 05:01:31 2022] GET /compute/v2.1/servers/ec88b440-40a0-459f-b94b-06c332e86094 => generated 1315 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 05:01:31.974144 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-ed096b9b-9cfa-458a-9e1a-97147d8f5390 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Calling method '>' {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:01:31.975143 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.compute.api [None req-ed096b9b-9cfa-458a-9e1a-97147d8f5390 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] [instance: 201433d5-db4e-4e57-a800-42fe5cfc95ca] Fetching instance by UUID {{(pid=120593) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:01:31.980265 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [None req-db4ff8fb-0244-426f-b4e5-69e470191e78 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] 10.222.0.50 "GET /compute/v2.1/servers/b2daebb8-dfea-4ab9-8253-008a21f906e1" status: 200 len: 1363 microversion: 2.1 time: 0.225647 Sep 24 05:01:31.980265 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 70/137] 10.222.0.50 () {58 vars in 1236 bytes} [Sat Sep 24 05:01:31 2022] GET /compute/v2.1/servers/b2daebb8-dfea-4ab9-8253-008a21f906e1 => generated 1363 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 24 05:01:31.991177 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-ed096b9b-9cfa-458a-9e1a-97147d8f5390 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:01:31.991755 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-ed096b9b-9cfa-458a-9e1a-97147d8f5390 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:01:31.992196 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-ed096b9b-9cfa-458a-9e1a-97147d8f5390 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:01:31.992900 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-ed096b9b-9cfa-458a-9e1a-97147d8f5390 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:01:31.993350 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-ed096b9b-9cfa-458a-9e1a-97147d8f5390 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:01:31.993767 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-ed096b9b-9cfa-458a-9e1a-97147d8f5390 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:01:32.062161 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-ed096b9b-9cfa-458a-9e1a-97147d8f5390 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74a8cc19ab204424ab23c62915ac2bab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87d5229e39fe4817b5187068d8acecc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:01:32.069897 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-ed096b9b-9cfa-458a-9e1a-97147d8f5390 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] 10.222.0.50 "GET /compute/v2.1/servers/201433d5-db4e-4e57-a800-42fe5cfc95ca" status: 200 len: 1294 microversion: 2.1 time: 0.100101 Sep 24 05:01:32.070502 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 68/138] 10.222.0.50 () {58 vars in 1236 bytes} [Sat Sep 24 05:01:31 2022] GET /compute/v2.1/servers/201433d5-db4e-4e57-a800-42fe5cfc95ca => generated 1294 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 05:01:32.190614 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-6799d429-14a8-4204-ad47-ba14ce488dbf tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Calling method '>' {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:01:32.191358 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.compute.api [None req-6799d429-14a8-4204-ad47-ba14ce488dbf tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] [instance: 08fb826b-e891-46c4-990d-ca03cf3f4222] Fetching instance by UUID {{(pid=120594) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:01:32.209456 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-6799d429-14a8-4204-ad47-ba14ce488dbf tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:01:32.209456 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-6799d429-14a8-4204-ad47-ba14ce488dbf tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:01:32.209456 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-6799d429-14a8-4204-ad47-ba14ce488dbf tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:01:32.209456 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-6799d429-14a8-4204-ad47-ba14ce488dbf tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:01:32.210461 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-6799d429-14a8-4204-ad47-ba14ce488dbf tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:01:32.210461 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-6799d429-14a8-4204-ad47-ba14ce488dbf tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:01:32.280207 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-45b1f26f-03e3-468c-bfea-e884395be700 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Calling method '>' {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:01:32.280596 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.compute.api [None req-45b1f26f-03e3-468c-bfea-e884395be700 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] [instance: 50eed27b-6da2-4dda-94cc-02fc5cfec071] Fetching instance by UUID {{(pid=120593) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:01:32.287882 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-45b1f26f-03e3-468c-bfea-e884395be700 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:01:32.288506 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-45b1f26f-03e3-468c-bfea-e884395be700 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:01:32.289082 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-45b1f26f-03e3-468c-bfea-e884395be700 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:01:32.289929 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-45b1f26f-03e3-468c-bfea-e884395be700 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:01:32.290545 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-45b1f26f-03e3-468c-bfea-e884395be700 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:01:32.291104 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-45b1f26f-03e3-468c-bfea-e884395be700 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:01:32.295454 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG dbcounter [-] [120593] Writing DB stats nova_cell1:SELECT=100 {{(pid=120593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 05:01:32.542107 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.policy [None req-6799d429-14a8-4204-ad47-ba14ce488dbf tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0948754217fc4ff2ba0241fa35feaf90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1aaf20f480a423ea5feca81585aeeed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:01:32.556470 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.policy [None req-6799d429-14a8-4204-ad47-ba14ce488dbf tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0948754217fc4ff2ba0241fa35feaf90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1aaf20f480a423ea5feca81585aeeed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:01:32.558061 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.policy [None req-6799d429-14a8-4204-ad47-ba14ce488dbf tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0948754217fc4ff2ba0241fa35feaf90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1aaf20f480a423ea5feca81585aeeed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:01:32.559272 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [None req-6799d429-14a8-4204-ad47-ba14ce488dbf tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] 10.222.0.50 "GET /compute/v2.1/servers/08fb826b-e891-46c4-990d-ca03cf3f4222" status: 200 len: 1404 microversion: 2.20 time: 0.372967 Sep 24 05:01:32.559905 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 71/139] 10.222.0.50 () {60 vars in 1277 bytes} [Sat Sep 24 05:01:32 2022] GET /compute/v2.1/servers/08fb826b-e891-46c4-990d-ca03cf3f4222 => generated 1404 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 05:01:32.594400 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-45b1f26f-03e3-468c-bfea-e884395be700 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cdd0da2c7bc4139bcd48ef36a2ee183', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a18a3756ba2b460d977f738a115ebfe0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:01:32.613079 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-45b1f26f-03e3-468c-bfea-e884395be700 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] 10.222.0.50 "GET /compute/v2.1/servers/50eed27b-6da2-4dda-94cc-02fc5cfec071" status: 200 len: 1322 microversion: 2.1 time: 0.327040 Sep 24 05:01:32.613079 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 69/140] 10.222.0.50 () {58 vars in 1236 bytes} [Sat Sep 24 05:01:32 2022] GET /compute/v2.1/servers/50eed27b-6da2-4dda-94cc-02fc5cfec071 => generated 1322 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 24 05:01:32.995030 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-b7443693-9bfb-41cb-a324-d002a92739b1 tempest-DeleteServersTestJSON-1630660203 tempest-DeleteServersTestJSON-1630660203-project] Calling method '>' {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:01:32.995734 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.compute.api [None req-b7443693-9bfb-41cb-a324-d002a92739b1 tempest-DeleteServersTestJSON-1630660203 tempest-DeleteServersTestJSON-1630660203-project] [instance: ec88b440-40a0-459f-b94b-06c332e86094] Fetching instance by UUID {{(pid=120594) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:01:33.002597 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-b7443693-9bfb-41cb-a324-d002a92739b1 tempest-DeleteServersTestJSON-1630660203 tempest-DeleteServersTestJSON-1630660203-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:01:33.003152 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-b7443693-9bfb-41cb-a324-d002a92739b1 tempest-DeleteServersTestJSON-1630660203 tempest-DeleteServersTestJSON-1630660203-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:01:33.003895 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-b7443693-9bfb-41cb-a324-d002a92739b1 tempest-DeleteServersTestJSON-1630660203 tempest-DeleteServersTestJSON-1630660203-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:01:33.004763 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-966e5084-3746-4f41-ba13-b34d1691198e tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Calling method '>' {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:01:33.005240 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-b7443693-9bfb-41cb-a324-d002a92739b1 tempest-DeleteServersTestJSON-1630660203 tempest-DeleteServersTestJSON-1630660203-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:01:33.005342 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-b7443693-9bfb-41cb-a324-d002a92739b1 tempest-DeleteServersTestJSON-1630660203 tempest-DeleteServersTestJSON-1630660203-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:01:33.005720 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-b7443693-9bfb-41cb-a324-d002a92739b1 tempest-DeleteServersTestJSON-1630660203 tempest-DeleteServersTestJSON-1630660203-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:01:33.006295 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.compute.api [None req-966e5084-3746-4f41-ba13-b34d1691198e tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] [instance: b2daebb8-dfea-4ab9-8253-008a21f906e1] Fetching instance by UUID {{(pid=120593) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:01:33.013565 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-966e5084-3746-4f41-ba13-b34d1691198e tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:01:33.014578 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-966e5084-3746-4f41-ba13-b34d1691198e tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:01:33.015746 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-966e5084-3746-4f41-ba13-b34d1691198e tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:01:33.016645 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-966e5084-3746-4f41-ba13-b34d1691198e tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:01:33.017092 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-966e5084-3746-4f41-ba13-b34d1691198e tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:01:33.017674 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-966e5084-3746-4f41-ba13-b34d1691198e tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:01:33.210064 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-966e5084-3746-4f41-ba13-b34d1691198e tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b1b0448e7f54e3aaae49e411699269e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66ec8bde739145dda504995dbea0914a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:01:33.213484 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.policy [None req-b7443693-9bfb-41cb-a324-d002a92739b1 tempest-DeleteServersTestJSON-1630660203 tempest-DeleteServersTestJSON-1630660203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27d1a24c9e15493195744bcbf598ac4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa84dfa1cc764dc99b6e804e778c3479', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:01:33.221667 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-966e5084-3746-4f41-ba13-b34d1691198e tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] 10.222.0.50 "GET /compute/v2.1/servers/b2daebb8-dfea-4ab9-8253-008a21f906e1" status: 200 len: 1363 microversion: 2.1 time: 0.221500 Sep 24 05:01:33.222283 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 70/141] 10.222.0.50 () {58 vars in 1236 bytes} [Sat Sep 24 05:01:32 2022] GET /compute/v2.1/servers/b2daebb8-dfea-4ab9-8253-008a21f906e1 => generated 1363 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 24 05:01:33.230612 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [None req-b7443693-9bfb-41cb-a324-d002a92739b1 tempest-DeleteServersTestJSON-1630660203 tempest-DeleteServersTestJSON-1630660203-project] 10.222.0.50 "GET /compute/v2.1/servers/ec88b440-40a0-459f-b94b-06c332e86094" status: 200 len: 1315 microversion: 2.1 time: 0.239664 Sep 24 05:01:33.231153 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 72/142] 10.222.0.50 () {58 vars in 1236 bytes} [Sat Sep 24 05:01:32 2022] GET /compute/v2.1/servers/ec88b440-40a0-459f-b94b-06c332e86094 => generated 1315 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 05:01:33.232057 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-cdce3d9e-6f2a-4d5c-9d8e-8b630656a197 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Calling method '>' {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:01:33.232817 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.compute.api [None req-cdce3d9e-6f2a-4d5c-9d8e-8b630656a197 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] [instance: 201433d5-db4e-4e57-a800-42fe5cfc95ca] Fetching instance by UUID {{(pid=120593) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:01:33.238971 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG dbcounter [-] [120593] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=120593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 05:01:33.241297 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-cdce3d9e-6f2a-4d5c-9d8e-8b630656a197 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:01:33.241937 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-cdce3d9e-6f2a-4d5c-9d8e-8b630656a197 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:01:33.242548 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-cdce3d9e-6f2a-4d5c-9d8e-8b630656a197 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:01:33.243378 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-cdce3d9e-6f2a-4d5c-9d8e-8b630656a197 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:01:33.244011 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-cdce3d9e-6f2a-4d5c-9d8e-8b630656a197 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:01:33.245045 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-cdce3d9e-6f2a-4d5c-9d8e-8b630656a197 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:01:33.325422 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-cdce3d9e-6f2a-4d5c-9d8e-8b630656a197 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74a8cc19ab204424ab23c62915ac2bab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87d5229e39fe4817b5187068d8acecc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:01:33.333681 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-cdce3d9e-6f2a-4d5c-9d8e-8b630656a197 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] 10.222.0.50 "GET /compute/v2.1/servers/201433d5-db4e-4e57-a800-42fe5cfc95ca" status: 200 len: 1294 microversion: 2.1 time: 0.110363 Sep 24 05:01:33.334911 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 71/143] 10.222.0.50 () {58 vars in 1236 bytes} [Sat Sep 24 05:01:33 2022] GET /compute/v2.1/servers/201433d5-db4e-4e57-a800-42fe5cfc95ca => generated 1294 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 05:01:33.384091 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [req-f985cd56-8536-44f3-9253-f0f5a6c7e5b0 req-7b789960-786b-4747-a8d0-88c8a3e0c0fd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ec88b440-40a0-459f-b94b-06c332e86094", "name": "network-vif-plugged", "status": "completed", "tag": "290d6de0-525c-40c7-8eec-34ce73fcc7b9"}]} {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 05:01:33.394355 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [req-f985cd56-8536-44f3-9253-f0f5a6c7e5b0 req-7b789960-786b-4747-a8d0-88c8a3e0c0fd service nova] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:01:33.394827 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [req-f985cd56-8536-44f3-9253-f0f5a6c7e5b0 req-7b789960-786b-4747-a8d0-88c8a3e0c0fd service nova] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:01:33.395372 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [req-f985cd56-8536-44f3-9253-f0f5a6c7e5b0 req-7b789960-786b-4747-a8d0-88c8a3e0c0fd service nova] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:01:33.407003 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: INFO nova.api.openstack.compute.server_external_events [req-f985cd56-8536-44f3-9253-f0f5a6c7e5b0 req-7b789960-786b-4747-a8d0-88c8a3e0c0fd service nova] Creating event network-vif-plugged:290d6de0-525c-40c7-8eec-34ce73fcc7b9 for instance ec88b440-40a0-459f-b94b-06c332e86094 on hv-cinder-85918 Sep 24 05:01:33.412118 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [req-f985cd56-8536-44f3-9253-f0f5a6c7e5b0 req-7b789960-786b-4747-a8d0-88c8a3e0c0fd service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.089776 Sep 24 05:01:33.412701 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 73/144] 10.222.0.50 () {64 vars in 1317 bytes} [Sat Sep 24 05:01:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 05:01:33.584750 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-ce58084b-f647-4e92-9834-0fae9527528e tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Calling method '>' {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:01:33.585353 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.compute.api [None req-ce58084b-f647-4e92-9834-0fae9527528e tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] [instance: 08fb826b-e891-46c4-990d-ca03cf3f4222] Fetching instance by UUID {{(pid=120593) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:01:33.591282 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-ce58084b-f647-4e92-9834-0fae9527528e tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:01:33.591761 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-ce58084b-f647-4e92-9834-0fae9527528e tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:01:33.592268 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-ce58084b-f647-4e92-9834-0fae9527528e tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:01:33.592833 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-ce58084b-f647-4e92-9834-0fae9527528e tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:01:33.593278 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-ce58084b-f647-4e92-9834-0fae9527528e tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:01:33.593695 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-ce58084b-f647-4e92-9834-0fae9527528e tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:01:33.629546 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-67797180-27b2-4416-bb9d-0b24e213bfb9 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Calling method '>' {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:01:33.630557 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.compute.api [None req-67797180-27b2-4416-bb9d-0b24e213bfb9 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] [instance: 50eed27b-6da2-4dda-94cc-02fc5cfec071] Fetching instance by UUID {{(pid=120594) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:01:33.653761 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-67797180-27b2-4416-bb9d-0b24e213bfb9 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:01:33.657403 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-67797180-27b2-4416-bb9d-0b24e213bfb9 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:01:33.659074 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-67797180-27b2-4416-bb9d-0b24e213bfb9 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:01:33.660047 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-67797180-27b2-4416-bb9d-0b24e213bfb9 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:01:33.663356 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-67797180-27b2-4416-bb9d-0b24e213bfb9 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:01:33.664041 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-67797180-27b2-4416-bb9d-0b24e213bfb9 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:01:34.251876 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-ce58084b-f647-4e92-9834-0fae9527528e tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0948754217fc4ff2ba0241fa35feaf90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1aaf20f480a423ea5feca81585aeeed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:01:34.265306 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-ce58084b-f647-4e92-9834-0fae9527528e tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0948754217fc4ff2ba0241fa35feaf90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1aaf20f480a423ea5feca81585aeeed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:01:34.270368 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-ce58084b-f647-4e92-9834-0fae9527528e tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0948754217fc4ff2ba0241fa35feaf90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1aaf20f480a423ea5feca81585aeeed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:01:34.273862 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-ce58084b-f647-4e92-9834-0fae9527528e tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] 10.222.0.50 "GET /compute/v2.1/servers/08fb826b-e891-46c4-990d-ca03cf3f4222" status: 200 len: 1404 microversion: 2.20 time: 0.692951 Sep 24 05:01:34.286164 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 72/145] 10.222.0.50 () {60 vars in 1277 bytes} [Sat Sep 24 05:01:33 2022] GET /compute/v2.1/servers/08fb826b-e891-46c4-990d-ca03cf3f4222 => generated 1404 bytes in 706 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 05:01:34.299266 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-e5812730-322b-42bd-be84-02502055dc60 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Calling method '>' {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:01:34.300105 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.compute.api [None req-e5812730-322b-42bd-be84-02502055dc60 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] [instance: b2daebb8-dfea-4ab9-8253-008a21f906e1] Fetching instance by UUID {{(pid=120593) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:01:34.306742 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-e5812730-322b-42bd-be84-02502055dc60 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:01:34.307226 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-e5812730-322b-42bd-be84-02502055dc60 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:01:34.307816 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-e5812730-322b-42bd-be84-02502055dc60 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:01:34.308683 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-e5812730-322b-42bd-be84-02502055dc60 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:01:34.309315 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-e5812730-322b-42bd-be84-02502055dc60 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:01:34.309914 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-e5812730-322b-42bd-be84-02502055dc60 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:01:34.599884 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG dbcounter [-] [120593] Writing DB stats nova_cell0:SELECT=2 {{(pid=120593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 05:01:34.761914 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.policy [None req-67797180-27b2-4416-bb9d-0b24e213bfb9 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cdd0da2c7bc4139bcd48ef36a2ee183', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a18a3756ba2b460d977f738a115ebfe0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:01:34.774337 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [None req-67797180-27b2-4416-bb9d-0b24e213bfb9 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] 10.222.0.50 "GET /compute/v2.1/servers/50eed27b-6da2-4dda-94cc-02fc5cfec071" status: 200 len: 1322 microversion: 2.1 time: 1.150214 Sep 24 05:01:34.775397 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 74/146] 10.222.0.50 () {58 vars in 1236 bytes} [Sat Sep 24 05:01:33 2022] GET /compute/v2.1/servers/50eed27b-6da2-4dda-94cc-02fc5cfec071 => generated 1322 bytes in 1152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 24 05:01:34.782613 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-7d806222-584a-4298-a634-dbef9115a09a tempest-DeleteServersTestJSON-1630660203 tempest-DeleteServersTestJSON-1630660203-project] Calling method '>' {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:01:34.784133 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.compute.api [None req-7d806222-584a-4298-a634-dbef9115a09a tempest-DeleteServersTestJSON-1630660203 tempest-DeleteServersTestJSON-1630660203-project] [instance: ec88b440-40a0-459f-b94b-06c332e86094] Fetching instance by UUID {{(pid=120594) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:01:34.792684 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-7d806222-584a-4298-a634-dbef9115a09a tempest-DeleteServersTestJSON-1630660203 tempest-DeleteServersTestJSON-1630660203-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:01:34.793200 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-7d806222-584a-4298-a634-dbef9115a09a tempest-DeleteServersTestJSON-1630660203 tempest-DeleteServersTestJSON-1630660203-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:01:34.794633 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-7d806222-584a-4298-a634-dbef9115a09a tempest-DeleteServersTestJSON-1630660203 tempest-DeleteServersTestJSON-1630660203-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:01:34.795402 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-7d806222-584a-4298-a634-dbef9115a09a tempest-DeleteServersTestJSON-1630660203 tempest-DeleteServersTestJSON-1630660203-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:01:34.796085 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-7d806222-584a-4298-a634-dbef9115a09a tempest-DeleteServersTestJSON-1630660203 tempest-DeleteServersTestJSON-1630660203-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:01:34.797240 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-7d806222-584a-4298-a634-dbef9115a09a tempest-DeleteServersTestJSON-1630660203 tempest-DeleteServersTestJSON-1630660203-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:01:35.228213 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-e5812730-322b-42bd-be84-02502055dc60 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b1b0448e7f54e3aaae49e411699269e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66ec8bde739145dda504995dbea0914a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:01:35.238044 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-e5812730-322b-42bd-be84-02502055dc60 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] 10.222.0.50 "GET /compute/v2.1/servers/b2daebb8-dfea-4ab9-8253-008a21f906e1" status: 200 len: 1363 microversion: 2.1 time: 0.950007 Sep 24 05:01:35.254519 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 73/147] 10.222.0.50 () {58 vars in 1236 bytes} [Sat Sep 24 05:01:34 2022] GET /compute/v2.1/servers/b2daebb8-dfea-4ab9-8253-008a21f906e1 => generated 1363 bytes in 967 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 05:01:35.260351 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-438da96d-e2b7-4c43-83c4-6d0120aea185 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Calling method '>' {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:01:35.261241 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.compute.api [None req-438da96d-e2b7-4c43-83c4-6d0120aea185 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] [instance: 201433d5-db4e-4e57-a800-42fe5cfc95ca] Fetching instance by UUID {{(pid=120593) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:01:35.268027 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-438da96d-e2b7-4c43-83c4-6d0120aea185 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:01:35.268901 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-438da96d-e2b7-4c43-83c4-6d0120aea185 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:01:35.269561 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-438da96d-e2b7-4c43-83c4-6d0120aea185 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:01:35.270538 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-438da96d-e2b7-4c43-83c4-6d0120aea185 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:01:35.271215 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-438da96d-e2b7-4c43-83c4-6d0120aea185 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:01:35.271837 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-438da96d-e2b7-4c43-83c4-6d0120aea185 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:01:35.408623 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-438da96d-e2b7-4c43-83c4-6d0120aea185 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74a8cc19ab204424ab23c62915ac2bab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87d5229e39fe4817b5187068d8acecc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:01:35.418189 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-438da96d-e2b7-4c43-83c4-6d0120aea185 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] 10.222.0.50 "GET /compute/v2.1/servers/201433d5-db4e-4e57-a800-42fe5cfc95ca" status: 200 len: 1300 microversion: 2.1 time: 0.161737 Sep 24 05:01:35.419055 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 74/148] 10.222.0.50 () {58 vars in 1236 bytes} [Sat Sep 24 05:01:35 2022] GET /compute/v2.1/servers/201433d5-db4e-4e57-a800-42fe5cfc95ca => generated 1300 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 05:01:35.426075 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-33484d65-2b6d-44ca-a7b9-b34aac8d4fbc tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Calling method '>' {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:01:35.426975 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.compute.api [None req-33484d65-2b6d-44ca-a7b9-b34aac8d4fbc tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] [instance: 08fb826b-e891-46c4-990d-ca03cf3f4222] Fetching instance by UUID {{(pid=120593) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:01:35.433787 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-33484d65-2b6d-44ca-a7b9-b34aac8d4fbc tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:01:35.434402 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-33484d65-2b6d-44ca-a7b9-b34aac8d4fbc tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:01:35.435003 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-33484d65-2b6d-44ca-a7b9-b34aac8d4fbc tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:01:35.435869 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-33484d65-2b6d-44ca-a7b9-b34aac8d4fbc tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:01:35.436409 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-33484d65-2b6d-44ca-a7b9-b34aac8d4fbc tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:01:35.437053 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-33484d65-2b6d-44ca-a7b9-b34aac8d4fbc tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:01:35.550162 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.policy [None req-7d806222-584a-4298-a634-dbef9115a09a tempest-DeleteServersTestJSON-1630660203 tempest-DeleteServersTestJSON-1630660203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27d1a24c9e15493195744bcbf598ac4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa84dfa1cc764dc99b6e804e778c3479', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:01:35.559986 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [None req-7d806222-584a-4298-a634-dbef9115a09a tempest-DeleteServersTestJSON-1630660203 tempest-DeleteServersTestJSON-1630660203-project] 10.222.0.50 "GET /compute/v2.1/servers/ec88b440-40a0-459f-b94b-06c332e86094" status: 200 len: 1315 microversion: 2.1 time: 0.783085 Sep 24 05:01:35.576722 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 75/149] 10.222.0.50 () {58 vars in 1236 bytes} [Sat Sep 24 05:01:34 2022] GET /compute/v2.1/servers/ec88b440-40a0-459f-b94b-06c332e86094 => generated 1315 bytes in 801 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 05:01:35.707085 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-33484d65-2b6d-44ca-a7b9-b34aac8d4fbc tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0948754217fc4ff2ba0241fa35feaf90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1aaf20f480a423ea5feca81585aeeed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:01:35.721811 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-33484d65-2b6d-44ca-a7b9-b34aac8d4fbc tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0948754217fc4ff2ba0241fa35feaf90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1aaf20f480a423ea5feca81585aeeed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:01:35.724454 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-33484d65-2b6d-44ca-a7b9-b34aac8d4fbc tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0948754217fc4ff2ba0241fa35feaf90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1aaf20f480a423ea5feca81585aeeed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:01:35.726808 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-33484d65-2b6d-44ca-a7b9-b34aac8d4fbc tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] 10.222.0.50 "GET /compute/v2.1/servers/08fb826b-e891-46c4-990d-ca03cf3f4222" status: 200 len: 1404 microversion: 2.20 time: 0.306625 Sep 24 05:01:35.727781 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 75/150] 10.222.0.50 () {60 vars in 1277 bytes} [Sat Sep 24 05:01:35 2022] GET /compute/v2.1/servers/08fb826b-e891-46c4-990d-ca03cf3f4222 => generated 1404 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 05:01:35.800556 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-27b32c1f-a5ce-4663-8410-de6f09edfc75 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Calling method '>' {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:01:35.801387 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.compute.api [None req-27b32c1f-a5ce-4663-8410-de6f09edfc75 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] [instance: 50eed27b-6da2-4dda-94cc-02fc5cfec071] Fetching instance by UUID {{(pid=120594) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:01:35.808726 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-27b32c1f-a5ce-4663-8410-de6f09edfc75 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:01:35.809492 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-27b32c1f-a5ce-4663-8410-de6f09edfc75 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:01:35.810307 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-27b32c1f-a5ce-4663-8410-de6f09edfc75 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:01:35.811171 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-27b32c1f-a5ce-4663-8410-de6f09edfc75 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:01:35.811772 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-27b32c1f-a5ce-4663-8410-de6f09edfc75 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:01:35.812877 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-27b32c1f-a5ce-4663-8410-de6f09edfc75 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:01:36.031448 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.policy [None req-27b32c1f-a5ce-4663-8410-de6f09edfc75 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cdd0da2c7bc4139bcd48ef36a2ee183', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a18a3756ba2b460d977f738a115ebfe0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:01:36.037319 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG dbcounter [-] [120594] Writing DB stats nova_cell1:SELECT=100 {{(pid=120594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 05:01:36.048665 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [None req-27b32c1f-a5ce-4663-8410-de6f09edfc75 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] 10.222.0.50 "GET /compute/v2.1/servers/50eed27b-6da2-4dda-94cc-02fc5cfec071" status: 200 len: 1322 microversion: 2.1 time: 0.251734 Sep 24 05:01:36.055558 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 76/151] 10.222.0.50 () {58 vars in 1236 bytes} [Sat Sep 24 05:01:35 2022] GET /compute/v2.1/servers/50eed27b-6da2-4dda-94cc-02fc5cfec071 => generated 1322 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 05:01:36.261311 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-c7359b63-e9be-4b68-909a-badad3debceb tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Calling method '>' {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:01:36.261913 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.compute.api [None req-c7359b63-e9be-4b68-909a-badad3debceb tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] [instance: b2daebb8-dfea-4ab9-8253-008a21f906e1] Fetching instance by UUID {{(pid=120593) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:01:36.268032 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-c7359b63-e9be-4b68-909a-badad3debceb tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:01:36.268519 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-c7359b63-e9be-4b68-909a-badad3debceb tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:01:36.268952 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-c7359b63-e9be-4b68-909a-badad3debceb tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:01:36.269633 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-c7359b63-e9be-4b68-909a-badad3debceb tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:01:36.270119 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-c7359b63-e9be-4b68-909a-badad3debceb tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:01:36.270541 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-c7359b63-e9be-4b68-909a-badad3debceb tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:01:36.445959 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-8b8796b9-efce-4999-b5cf-0fe426a36300 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Calling method '>' {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:01:36.446588 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.compute.api [None req-8b8796b9-efce-4999-b5cf-0fe426a36300 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] [instance: 201433d5-db4e-4e57-a800-42fe5cfc95ca] Fetching instance by UUID {{(pid=120594) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:01:36.454303 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-8b8796b9-efce-4999-b5cf-0fe426a36300 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:01:36.454799 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-8b8796b9-efce-4999-b5cf-0fe426a36300 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:01:36.455371 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-8b8796b9-efce-4999-b5cf-0fe426a36300 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:01:36.455979 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-8b8796b9-efce-4999-b5cf-0fe426a36300 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:01:36.456467 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-8b8796b9-efce-4999-b5cf-0fe426a36300 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:01:36.456912 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-8b8796b9-efce-4999-b5cf-0fe426a36300 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:01:36.696040 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.policy [None req-8b8796b9-efce-4999-b5cf-0fe426a36300 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74a8cc19ab204424ab23c62915ac2bab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87d5229e39fe4817b5187068d8acecc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:01:36.704223 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [None req-8b8796b9-efce-4999-b5cf-0fe426a36300 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] 10.222.0.50 "GET /compute/v2.1/servers/201433d5-db4e-4e57-a800-42fe5cfc95ca" status: 200 len: 1300 microversion: 2.1 time: 0.262095 Sep 24 05:01:36.704787 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 77/152] 10.222.0.50 () {58 vars in 1236 bytes} [Sat Sep 24 05:01:36 2022] GET /compute/v2.1/servers/201433d5-db4e-4e57-a800-42fe5cfc95ca => generated 1300 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 24 05:01:36.709174 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-a2434451-ad1f-4b81-8c5b-3c35217258a3 tempest-DeleteServersTestJSON-1630660203 tempest-DeleteServersTestJSON-1630660203-project] Calling method '>' {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:01:36.709774 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.compute.api [None req-a2434451-ad1f-4b81-8c5b-3c35217258a3 tempest-DeleteServersTestJSON-1630660203 tempest-DeleteServersTestJSON-1630660203-project] [instance: ec88b440-40a0-459f-b94b-06c332e86094] Fetching instance by UUID {{(pid=120594) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:01:36.715358 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-a2434451-ad1f-4b81-8c5b-3c35217258a3 tempest-DeleteServersTestJSON-1630660203 tempest-DeleteServersTestJSON-1630660203-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:01:36.715838 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-a2434451-ad1f-4b81-8c5b-3c35217258a3 tempest-DeleteServersTestJSON-1630660203 tempest-DeleteServersTestJSON-1630660203-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:01:36.716266 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-a2434451-ad1f-4b81-8c5b-3c35217258a3 tempest-DeleteServersTestJSON-1630660203 tempest-DeleteServersTestJSON-1630660203-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:01:36.717104 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-a2434451-ad1f-4b81-8c5b-3c35217258a3 tempest-DeleteServersTestJSON-1630660203 tempest-DeleteServersTestJSON-1630660203-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:01:36.717686 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-a2434451-ad1f-4b81-8c5b-3c35217258a3 tempest-DeleteServersTestJSON-1630660203 tempest-DeleteServersTestJSON-1630660203-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:01:36.718295 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-a2434451-ad1f-4b81-8c5b-3c35217258a3 tempest-DeleteServersTestJSON-1630660203 tempest-DeleteServersTestJSON-1630660203-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:01:36.903606 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-c7359b63-e9be-4b68-909a-badad3debceb tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b1b0448e7f54e3aaae49e411699269e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66ec8bde739145dda504995dbea0914a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:01:36.917840 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-c7359b63-e9be-4b68-909a-badad3debceb tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] 10.222.0.50 "GET /compute/v2.1/servers/b2daebb8-dfea-4ab9-8253-008a21f906e1" status: 200 len: 1363 microversion: 2.1 time: 0.660121 Sep 24 05:01:36.918713 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 76/153] 10.222.0.50 () {58 vars in 1236 bytes} [Sat Sep 24 05:01:36 2022] GET /compute/v2.1/servers/b2daebb8-dfea-4ab9-8253-008a21f906e1 => generated 1363 bytes in 662 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 05:01:36.925029 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-6bb3d3b2-2c33-44ea-842e-8e36f0f7f617 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Calling method '>' {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:01:36.925906 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.compute.api [None req-6bb3d3b2-2c33-44ea-842e-8e36f0f7f617 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] [instance: 08fb826b-e891-46c4-990d-ca03cf3f4222] Fetching instance by UUID {{(pid=120593) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:01:36.932477 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-6bb3d3b2-2c33-44ea-842e-8e36f0f7f617 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:01:36.933243 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-6bb3d3b2-2c33-44ea-842e-8e36f0f7f617 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:01:36.933900 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-6bb3d3b2-2c33-44ea-842e-8e36f0f7f617 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:01:36.934976 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-6bb3d3b2-2c33-44ea-842e-8e36f0f7f617 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:01:36.935663 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-6bb3d3b2-2c33-44ea-842e-8e36f0f7f617 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:01:36.936275 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-6bb3d3b2-2c33-44ea-842e-8e36f0f7f617 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:01:37.223662 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.policy [None req-a2434451-ad1f-4b81-8c5b-3c35217258a3 tempest-DeleteServersTestJSON-1630660203 tempest-DeleteServersTestJSON-1630660203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27d1a24c9e15493195744bcbf598ac4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa84dfa1cc764dc99b6e804e778c3479', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:01:37.240538 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [None req-a2434451-ad1f-4b81-8c5b-3c35217258a3 tempest-DeleteServersTestJSON-1630660203 tempest-DeleteServersTestJSON-1630660203-project] 10.222.0.50 "GET /compute/v2.1/servers/ec88b440-40a0-459f-b94b-06c332e86094" status: 200 len: 1315 microversion: 2.1 time: 0.534679 Sep 24 05:01:37.241290 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 78/154] 10.222.0.50 () {58 vars in 1236 bytes} [Sat Sep 24 05:01:36 2022] GET /compute/v2.1/servers/ec88b440-40a0-459f-b94b-06c332e86094 => generated 1315 bytes in 536 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 05:01:37.259932 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-25f0ca90-19a1-4a2a-bc6d-cf07b0eb4265 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Calling method '>' {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:01:37.260562 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.compute.api [None req-25f0ca90-19a1-4a2a-bc6d-cf07b0eb4265 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] [instance: 50eed27b-6da2-4dda-94cc-02fc5cfec071] Fetching instance by UUID {{(pid=120594) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:01:37.273684 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-25f0ca90-19a1-4a2a-bc6d-cf07b0eb4265 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:01:37.274823 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-25f0ca90-19a1-4a2a-bc6d-cf07b0eb4265 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:01:37.280519 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-25f0ca90-19a1-4a2a-bc6d-cf07b0eb4265 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:01:37.281808 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-25f0ca90-19a1-4a2a-bc6d-cf07b0eb4265 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:01:37.282479 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-25f0ca90-19a1-4a2a-bc6d-cf07b0eb4265 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:01:37.283088 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-25f0ca90-19a1-4a2a-bc6d-cf07b0eb4265 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:01:37.349572 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-6bb3d3b2-2c33-44ea-842e-8e36f0f7f617 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0948754217fc4ff2ba0241fa35feaf90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1aaf20f480a423ea5feca81585aeeed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:01:37.359006 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-6bb3d3b2-2c33-44ea-842e-8e36f0f7f617 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0948754217fc4ff2ba0241fa35feaf90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1aaf20f480a423ea5feca81585aeeed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:01:37.365653 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-6bb3d3b2-2c33-44ea-842e-8e36f0f7f617 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0948754217fc4ff2ba0241fa35feaf90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1aaf20f480a423ea5feca81585aeeed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:01:37.368933 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-6bb3d3b2-2c33-44ea-842e-8e36f0f7f617 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] 10.222.0.50 "GET /compute/v2.1/servers/08fb826b-e891-46c4-990d-ca03cf3f4222" status: 200 len: 1404 microversion: 2.20 time: 0.448668 Sep 24 05:01:37.371000 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 77/155] 10.222.0.50 () {60 vars in 1277 bytes} [Sat Sep 24 05:01:36 2022] GET /compute/v2.1/servers/08fb826b-e891-46c4-990d-ca03cf3f4222 => generated 1404 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 05:01:37.687370 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.policy [None req-25f0ca90-19a1-4a2a-bc6d-cf07b0eb4265 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cdd0da2c7bc4139bcd48ef36a2ee183', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a18a3756ba2b460d977f738a115ebfe0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:01:37.695258 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [None req-25f0ca90-19a1-4a2a-bc6d-cf07b0eb4265 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] 10.222.0.50 "GET /compute/v2.1/servers/50eed27b-6da2-4dda-94cc-02fc5cfec071" status: 200 len: 1322 microversion: 2.1 time: 0.452920 Sep 24 05:01:37.695783 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 79/156] 10.222.0.50 () {58 vars in 1236 bytes} [Sat Sep 24 05:01:37 2022] GET /compute/v2.1/servers/50eed27b-6da2-4dda-94cc-02fc5cfec071 => generated 1322 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 05:01:37.727935 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-a24b93d9-498c-4ed5-aa6a-f7334f62b658 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Calling method '>' {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:01:37.729082 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.compute.api [None req-a24b93d9-498c-4ed5-aa6a-f7334f62b658 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] [instance: 201433d5-db4e-4e57-a800-42fe5cfc95ca] Fetching instance by UUID {{(pid=120593) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:01:37.740912 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-a24b93d9-498c-4ed5-aa6a-f7334f62b658 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:01:37.741478 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-a24b93d9-498c-4ed5-aa6a-f7334f62b658 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:01:37.742106 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-a24b93d9-498c-4ed5-aa6a-f7334f62b658 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:01:37.742804 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-a24b93d9-498c-4ed5-aa6a-f7334f62b658 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:01:37.743441 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-a24b93d9-498c-4ed5-aa6a-f7334f62b658 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:01:37.744133 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-a24b93d9-498c-4ed5-aa6a-f7334f62b658 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:01:37.920954 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-a24b93d9-498c-4ed5-aa6a-f7334f62b658 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74a8cc19ab204424ab23c62915ac2bab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87d5229e39fe4817b5187068d8acecc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:01:37.930176 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-a24b93d9-498c-4ed5-aa6a-f7334f62b658 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] 10.222.0.50 "GET /compute/v2.1/servers/201433d5-db4e-4e57-a800-42fe5cfc95ca" status: 200 len: 1367 microversion: 2.1 time: 0.206354 Sep 24 05:01:37.931674 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 78/157] 10.222.0.50 () {58 vars in 1236 bytes} [Sat Sep 24 05:01:37 2022] GET /compute/v2.1/servers/201433d5-db4e-4e57-a800-42fe5cfc95ca => generated 1367 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 05:01:37.941409 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-594c3199-bf13-4018-b822-8df0bee3d9c5 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Calling method '>' {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:01:37.942030 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.compute.api [None req-594c3199-bf13-4018-b822-8df0bee3d9c5 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] [instance: b2daebb8-dfea-4ab9-8253-008a21f906e1] Fetching instance by UUID {{(pid=120594) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:01:37.953337 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-594c3199-bf13-4018-b822-8df0bee3d9c5 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:01:37.953875 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-594c3199-bf13-4018-b822-8df0bee3d9c5 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:01:37.954496 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-594c3199-bf13-4018-b822-8df0bee3d9c5 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:01:37.955370 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-594c3199-bf13-4018-b822-8df0bee3d9c5 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:01:37.955849 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-594c3199-bf13-4018-b822-8df0bee3d9c5 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:01:37.956437 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-594c3199-bf13-4018-b822-8df0bee3d9c5 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:01:38.141528 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.policy [None req-594c3199-bf13-4018-b822-8df0bee3d9c5 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b1b0448e7f54e3aaae49e411699269e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66ec8bde739145dda504995dbea0914a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:01:38.156768 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [None req-594c3199-bf13-4018-b822-8df0bee3d9c5 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] 10.222.0.50 "GET /compute/v2.1/servers/b2daebb8-dfea-4ab9-8253-008a21f906e1" status: 200 len: 1363 microversion: 2.1 time: 0.219919 Sep 24 05:01:38.159939 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 80/158] 10.222.0.50 () {58 vars in 1236 bytes} [Sat Sep 24 05:01:37 2022] GET /compute/v2.1/servers/b2daebb8-dfea-4ab9-8253-008a21f906e1 => generated 1363 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 05:01:38.268645 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-eb7e8a98-7b93-48d0-8b63-46c205619638 tempest-DeleteServersTestJSON-1630660203 tempest-DeleteServersTestJSON-1630660203-project] Calling method '>' {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:01:38.269930 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.compute.api [None req-eb7e8a98-7b93-48d0-8b63-46c205619638 tempest-DeleteServersTestJSON-1630660203 tempest-DeleteServersTestJSON-1630660203-project] [instance: ec88b440-40a0-459f-b94b-06c332e86094] Fetching instance by UUID {{(pid=120593) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:01:38.276708 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-eb7e8a98-7b93-48d0-8b63-46c205619638 tempest-DeleteServersTestJSON-1630660203 tempest-DeleteServersTestJSON-1630660203-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:01:38.277302 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-eb7e8a98-7b93-48d0-8b63-46c205619638 tempest-DeleteServersTestJSON-1630660203 tempest-DeleteServersTestJSON-1630660203-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:01:38.277847 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-eb7e8a98-7b93-48d0-8b63-46c205619638 tempest-DeleteServersTestJSON-1630660203 tempest-DeleteServersTestJSON-1630660203-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:01:38.278632 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-eb7e8a98-7b93-48d0-8b63-46c205619638 tempest-DeleteServersTestJSON-1630660203 tempest-DeleteServersTestJSON-1630660203-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:01:38.279272 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-eb7e8a98-7b93-48d0-8b63-46c205619638 tempest-DeleteServersTestJSON-1630660203 tempest-DeleteServersTestJSON-1630660203-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:01:38.279902 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-eb7e8a98-7b93-48d0-8b63-46c205619638 tempest-DeleteServersTestJSON-1630660203 tempest-DeleteServersTestJSON-1630660203-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:01:38.395805 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-2d14ac54-a199-4a74-b9b4-8c60cd49304a tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Calling method '>' {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:01:38.397123 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.compute.api [None req-2d14ac54-a199-4a74-b9b4-8c60cd49304a tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] [instance: 08fb826b-e891-46c4-990d-ca03cf3f4222] Fetching instance by UUID {{(pid=120594) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:01:38.406032 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-2d14ac54-a199-4a74-b9b4-8c60cd49304a tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:01:38.406952 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-2d14ac54-a199-4a74-b9b4-8c60cd49304a tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:01:38.407660 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-2d14ac54-a199-4a74-b9b4-8c60cd49304a tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:01:38.408729 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-2d14ac54-a199-4a74-b9b4-8c60cd49304a tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:01:38.409223 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-2d14ac54-a199-4a74-b9b4-8c60cd49304a tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:01:38.409756 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-2d14ac54-a199-4a74-b9b4-8c60cd49304a tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:01:38.506071 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-eb7e8a98-7b93-48d0-8b63-46c205619638 tempest-DeleteServersTestJSON-1630660203 tempest-DeleteServersTestJSON-1630660203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27d1a24c9e15493195744bcbf598ac4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa84dfa1cc764dc99b6e804e778c3479', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:01:38.519749 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-eb7e8a98-7b93-48d0-8b63-46c205619638 tempest-DeleteServersTestJSON-1630660203 tempest-DeleteServersTestJSON-1630660203-project] 10.222.0.50 "GET /compute/v2.1/servers/ec88b440-40a0-459f-b94b-06c332e86094" status: 200 len: 1315 microversion: 2.1 time: 0.258356 Sep 24 05:01:38.534667 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 79/159] 10.222.0.50 () {58 vars in 1236 bytes} [Sat Sep 24 05:01:38 2022] GET /compute/v2.1/servers/ec88b440-40a0-459f-b94b-06c332e86094 => generated 1315 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 05:01:38.588403 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.policy [None req-2d14ac54-a199-4a74-b9b4-8c60cd49304a tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0948754217fc4ff2ba0241fa35feaf90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1aaf20f480a423ea5feca81585aeeed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:01:38.598838 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.policy [None req-2d14ac54-a199-4a74-b9b4-8c60cd49304a tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0948754217fc4ff2ba0241fa35feaf90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1aaf20f480a423ea5feca81585aeeed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:01:38.600625 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.policy [None req-2d14ac54-a199-4a74-b9b4-8c60cd49304a tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0948754217fc4ff2ba0241fa35feaf90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1aaf20f480a423ea5feca81585aeeed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:01:38.601895 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [None req-2d14ac54-a199-4a74-b9b4-8c60cd49304a tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] 10.222.0.50 "GET /compute/v2.1/servers/08fb826b-e891-46c4-990d-ca03cf3f4222" status: 200 len: 1404 microversion: 2.20 time: 0.210423 Sep 24 05:01:38.602482 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 81/160] 10.222.0.50 () {60 vars in 1277 bytes} [Sat Sep 24 05:01:38 2022] GET /compute/v2.1/servers/08fb826b-e891-46c4-990d-ca03cf3f4222 => generated 1404 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 05:01:38.718382 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-67bbdcf8-1728-43c4-8d78-368b53566403 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Calling method '>' {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:01:38.719149 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.compute.api [None req-67bbdcf8-1728-43c4-8d78-368b53566403 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] [instance: 50eed27b-6da2-4dda-94cc-02fc5cfec071] Fetching instance by UUID {{(pid=120593) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:01:38.726279 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-67bbdcf8-1728-43c4-8d78-368b53566403 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:01:38.726886 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-67bbdcf8-1728-43c4-8d78-368b53566403 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:01:38.727594 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-67bbdcf8-1728-43c4-8d78-368b53566403 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:01:38.728492 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-67bbdcf8-1728-43c4-8d78-368b53566403 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:01:38.729128 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-67bbdcf8-1728-43c4-8d78-368b53566403 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:01:38.729716 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-67bbdcf8-1728-43c4-8d78-368b53566403 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:01:38.868604 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-67bbdcf8-1728-43c4-8d78-368b53566403 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cdd0da2c7bc4139bcd48ef36a2ee183', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a18a3756ba2b460d977f738a115ebfe0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:01:38.877686 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-67bbdcf8-1728-43c4-8d78-368b53566403 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] 10.222.0.50 "GET /compute/v2.1/servers/50eed27b-6da2-4dda-94cc-02fc5cfec071" status: 200 len: 1322 microversion: 2.1 time: 0.163438 Sep 24 05:01:38.886226 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 80/161] 10.222.0.50 () {58 vars in 1236 bytes} [Sat Sep 24 05:01:38 2022] GET /compute/v2.1/servers/50eed27b-6da2-4dda-94cc-02fc5cfec071 => generated 1322 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 05:01:38.956077 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-3c743a84-4ae3-4a5a-989d-bb096e3d02b6 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Calling method '>' {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:01:38.956688 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.compute.api [None req-3c743a84-4ae3-4a5a-989d-bb096e3d02b6 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] [instance: 201433d5-db4e-4e57-a800-42fe5cfc95ca] Fetching instance by UUID {{(pid=120594) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:01:38.963182 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-3c743a84-4ae3-4a5a-989d-bb096e3d02b6 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:01:38.963783 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-3c743a84-4ae3-4a5a-989d-bb096e3d02b6 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:01:38.964323 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-3c743a84-4ae3-4a5a-989d-bb096e3d02b6 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:01:38.965104 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-3c743a84-4ae3-4a5a-989d-bb096e3d02b6 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:01:38.965558 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-3c743a84-4ae3-4a5a-989d-bb096e3d02b6 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:01:38.966335 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-3c743a84-4ae3-4a5a-989d-bb096e3d02b6 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:01:39.185432 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-70052475-e435-4e9e-9265-bab9f7c2fae5 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Calling method '>' {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:01:39.186736 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.compute.api [None req-70052475-e435-4e9e-9265-bab9f7c2fae5 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] [instance: b2daebb8-dfea-4ab9-8253-008a21f906e1] Fetching instance by UUID {{(pid=120593) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:01:39.213487 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-70052475-e435-4e9e-9265-bab9f7c2fae5 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:01:39.215380 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-70052475-e435-4e9e-9265-bab9f7c2fae5 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:01:39.215841 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-70052475-e435-4e9e-9265-bab9f7c2fae5 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:01:39.216559 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-70052475-e435-4e9e-9265-bab9f7c2fae5 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:01:39.222893 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-70052475-e435-4e9e-9265-bab9f7c2fae5 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:01:39.223343 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-70052475-e435-4e9e-9265-bab9f7c2fae5 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:01:39.472303 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.policy [None req-3c743a84-4ae3-4a5a-989d-bb096e3d02b6 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74a8cc19ab204424ab23c62915ac2bab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87d5229e39fe4817b5187068d8acecc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:01:39.485059 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [None req-3c743a84-4ae3-4a5a-989d-bb096e3d02b6 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] 10.222.0.50 "GET /compute/v2.1/servers/201433d5-db4e-4e57-a800-42fe5cfc95ca" status: 200 len: 1367 microversion: 2.1 time: 0.533748 Sep 24 05:01:39.485705 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 82/162] 10.222.0.50 () {58 vars in 1236 bytes} [Sat Sep 24 05:01:38 2022] GET /compute/v2.1/servers/201433d5-db4e-4e57-a800-42fe5cfc95ca => generated 1367 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 24 05:01:39.544560 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-3fd53136-d518-4ec2-b3a6-af1b1c1614b1 tempest-DeleteServersTestJSON-1630660203 tempest-DeleteServersTestJSON-1630660203-project] Calling method '>' {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:01:39.545812 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.compute.api [None req-3fd53136-d518-4ec2-b3a6-af1b1c1614b1 tempest-DeleteServersTestJSON-1630660203 tempest-DeleteServersTestJSON-1630660203-project] [instance: ec88b440-40a0-459f-b94b-06c332e86094] Fetching instance by UUID {{(pid=120594) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:01:39.553821 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-3fd53136-d518-4ec2-b3a6-af1b1c1614b1 tempest-DeleteServersTestJSON-1630660203 tempest-DeleteServersTestJSON-1630660203-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:01:39.554763 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-3fd53136-d518-4ec2-b3a6-af1b1c1614b1 tempest-DeleteServersTestJSON-1630660203 tempest-DeleteServersTestJSON-1630660203-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:01:39.555417 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-3fd53136-d518-4ec2-b3a6-af1b1c1614b1 tempest-DeleteServersTestJSON-1630660203 tempest-DeleteServersTestJSON-1630660203-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:01:39.556559 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-3fd53136-d518-4ec2-b3a6-af1b1c1614b1 tempest-DeleteServersTestJSON-1630660203 tempest-DeleteServersTestJSON-1630660203-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:01:39.556797 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-3fd53136-d518-4ec2-b3a6-af1b1c1614b1 tempest-DeleteServersTestJSON-1630660203 tempest-DeleteServersTestJSON-1630660203-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:01:39.557375 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-3fd53136-d518-4ec2-b3a6-af1b1c1614b1 tempest-DeleteServersTestJSON-1630660203 tempest-DeleteServersTestJSON-1630660203-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:01:39.604686 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-70052475-e435-4e9e-9265-bab9f7c2fae5 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b1b0448e7f54e3aaae49e411699269e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66ec8bde739145dda504995dbea0914a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:01:39.613394 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-70052475-e435-4e9e-9265-bab9f7c2fae5 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] 10.222.0.50 "GET /compute/v2.1/servers/b2daebb8-dfea-4ab9-8253-008a21f906e1" status: 200 len: 1363 microversion: 2.1 time: 0.432165 Sep 24 05:01:39.614313 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 81/163] 10.222.0.50 () {58 vars in 1236 bytes} [Sat Sep 24 05:01:39 2022] GET /compute/v2.1/servers/b2daebb8-dfea-4ab9-8253-008a21f906e1 => generated 1363 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 05:01:39.632290 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-b7f05a72-7545-46a5-aa92-513f06f17aee tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Calling method '>' {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:01:39.633033 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.compute.api [None req-b7f05a72-7545-46a5-aa92-513f06f17aee tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] [instance: 08fb826b-e891-46c4-990d-ca03cf3f4222] Fetching instance by UUID {{(pid=120593) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:01:39.641394 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-b7f05a72-7545-46a5-aa92-513f06f17aee tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:01:39.642131 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-b7f05a72-7545-46a5-aa92-513f06f17aee tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:01:39.642996 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-b7f05a72-7545-46a5-aa92-513f06f17aee tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:01:39.663140 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-b7f05a72-7545-46a5-aa92-513f06f17aee tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:01:39.663636 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-b7f05a72-7545-46a5-aa92-513f06f17aee tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:01:39.664072 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-b7f05a72-7545-46a5-aa92-513f06f17aee tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:01:39.900618 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.policy [None req-3fd53136-d518-4ec2-b3a6-af1b1c1614b1 tempest-DeleteServersTestJSON-1630660203 tempest-DeleteServersTestJSON-1630660203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27d1a24c9e15493195744bcbf598ac4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa84dfa1cc764dc99b6e804e778c3479', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:01:39.910357 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [None req-3fd53136-d518-4ec2-b3a6-af1b1c1614b1 tempest-DeleteServersTestJSON-1630660203 tempest-DeleteServersTestJSON-1630660203-project] 10.222.0.50 "GET /compute/v2.1/servers/ec88b440-40a0-459f-b94b-06c332e86094" status: 200 len: 1315 microversion: 2.1 time: 0.370831 Sep 24 05:01:39.925986 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 83/164] 10.222.0.50 () {58 vars in 1236 bytes} [Sat Sep 24 05:01:39 2022] GET /compute/v2.1/servers/ec88b440-40a0-459f-b94b-06c332e86094 => generated 1315 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 24 05:01:39.931040 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-5e058715-b259-4330-9f0c-f78cd440580a tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Calling method '>' {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:01:39.931847 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.compute.api [None req-5e058715-b259-4330-9f0c-f78cd440580a tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] [instance: 50eed27b-6da2-4dda-94cc-02fc5cfec071] Fetching instance by UUID {{(pid=120594) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:01:39.938162 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-5e058715-b259-4330-9f0c-f78cd440580a tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:01:39.938764 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-5e058715-b259-4330-9f0c-f78cd440580a tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:01:39.939312 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-5e058715-b259-4330-9f0c-f78cd440580a tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:01:39.940108 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-5e058715-b259-4330-9f0c-f78cd440580a tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:01:39.940658 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-5e058715-b259-4330-9f0c-f78cd440580a tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:01:39.941140 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-5e058715-b259-4330-9f0c-f78cd440580a tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:01:39.959430 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-b7f05a72-7545-46a5-aa92-513f06f17aee tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0948754217fc4ff2ba0241fa35feaf90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1aaf20f480a423ea5feca81585aeeed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:01:39.970346 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-b7f05a72-7545-46a5-aa92-513f06f17aee tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0948754217fc4ff2ba0241fa35feaf90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1aaf20f480a423ea5feca81585aeeed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:01:39.971987 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-b7f05a72-7545-46a5-aa92-513f06f17aee tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0948754217fc4ff2ba0241fa35feaf90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1aaf20f480a423ea5feca81585aeeed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:01:39.973241 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-b7f05a72-7545-46a5-aa92-513f06f17aee tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] 10.222.0.50 "GET /compute/v2.1/servers/08fb826b-e891-46c4-990d-ca03cf3f4222" status: 200 len: 1404 microversion: 2.20 time: 0.345402 Sep 24 05:01:39.974318 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 82/165] 10.222.0.50 () {60 vars in 1277 bytes} [Sat Sep 24 05:01:39 2022] GET /compute/v2.1/servers/08fb826b-e891-46c4-990d-ca03cf3f4222 => generated 1404 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 05:01:40.194095 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.policy [None req-5e058715-b259-4330-9f0c-f78cd440580a tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cdd0da2c7bc4139bcd48ef36a2ee183', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a18a3756ba2b460d977f738a115ebfe0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:01:40.203119 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [None req-5e058715-b259-4330-9f0c-f78cd440580a tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] 10.222.0.50 "GET /compute/v2.1/servers/50eed27b-6da2-4dda-94cc-02fc5cfec071" status: 200 len: 1322 microversion: 2.1 time: 0.275913 Sep 24 05:01:40.203690 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 84/166] 10.222.0.50 () {58 vars in 1236 bytes} [Sat Sep 24 05:01:39 2022] GET /compute/v2.1/servers/50eed27b-6da2-4dda-94cc-02fc5cfec071 => generated 1322 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 05:01:40.383916 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [req-468df1be-c342-4f6b-8910-04a9ba2c6bee req-ef0b27bb-d555-4af0-a7ca-a97dd31dee9d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "201433d5-db4e-4e57-a800-42fe5cfc95ca", "tag": "7efb703e-b766-4972-b442-eaba81c854e8"}]} {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 05:01:40.394572 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [req-468df1be-c342-4f6b-8910-04a9ba2c6bee req-ef0b27bb-d555-4af0-a7ca-a97dd31dee9d service nova] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:01:40.395049 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [req-468df1be-c342-4f6b-8910-04a9ba2c6bee req-ef0b27bb-d555-4af0-a7ca-a97dd31dee9d service nova] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:01:40.395470 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [req-468df1be-c342-4f6b-8910-04a9ba2c6bee req-ef0b27bb-d555-4af0-a7ca-a97dd31dee9d service nova] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:01:40.412826 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.compute.server_external_events [req-468df1be-c342-4f6b-8910-04a9ba2c6bee req-ef0b27bb-d555-4af0-a7ca-a97dd31dee9d service nova] Creating event network-changed:7efb703e-b766-4972-b442-eaba81c854e8 for instance 201433d5-db4e-4e57-a800-42fe5cfc95ca on hv-cinder-85918 Sep 24 05:01:40.418458 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [req-468df1be-c342-4f6b-8910-04a9ba2c6bee req-ef0b27bb-d555-4af0-a7ca-a97dd31dee9d service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039048 Sep 24 05:01:40.419568 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 83/167] 10.222.0.50 () {64 vars in 1317 bytes} [Sat Sep 24 05:01:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 24 05:01:40.508905 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-bf85c044-4912-43ca-bf0b-d4008ad78c22 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Calling method '>' {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:01:40.509560 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.compute.api [None req-bf85c044-4912-43ca-bf0b-d4008ad78c22 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] [instance: 201433d5-db4e-4e57-a800-42fe5cfc95ca] Fetching instance by UUID {{(pid=120594) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:01:40.517400 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-bf85c044-4912-43ca-bf0b-d4008ad78c22 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:01:40.517891 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-bf85c044-4912-43ca-bf0b-d4008ad78c22 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:01:40.518417 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-bf85c044-4912-43ca-bf0b-d4008ad78c22 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:01:40.519147 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-bf85c044-4912-43ca-bf0b-d4008ad78c22 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:01:40.519820 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-bf85c044-4912-43ca-bf0b-d4008ad78c22 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:01:40.520504 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-bf85c044-4912-43ca-bf0b-d4008ad78c22 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:01:40.643139 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-d6e52ed8-c589-4942-8e3c-6978b8a74d1b tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Calling method '>' {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:01:40.644640 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.compute.api [None req-d6e52ed8-c589-4942-8e3c-6978b8a74d1b tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] [instance: b2daebb8-dfea-4ab9-8253-008a21f906e1] Fetching instance by UUID {{(pid=120593) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:01:40.652359 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-d6e52ed8-c589-4942-8e3c-6978b8a74d1b tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:01:40.653128 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-d6e52ed8-c589-4942-8e3c-6978b8a74d1b tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:01:40.654047 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-d6e52ed8-c589-4942-8e3c-6978b8a74d1b tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:01:40.654958 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-d6e52ed8-c589-4942-8e3c-6978b8a74d1b tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:01:40.657243 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-d6e52ed8-c589-4942-8e3c-6978b8a74d1b tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:01:40.657895 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-d6e52ed8-c589-4942-8e3c-6978b8a74d1b tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:01:40.683272 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.policy [None req-bf85c044-4912-43ca-bf0b-d4008ad78c22 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74a8cc19ab204424ab23c62915ac2bab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87d5229e39fe4817b5187068d8acecc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:01:40.695939 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [None req-bf85c044-4912-43ca-bf0b-d4008ad78c22 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] 10.222.0.50 "GET /compute/v2.1/servers/201433d5-db4e-4e57-a800-42fe5cfc95ca" status: 200 len: 1367 microversion: 2.1 time: 0.190817 Sep 24 05:01:40.696866 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 85/168] 10.222.0.50 () {58 vars in 1236 bytes} [Sat Sep 24 05:01:40 2022] GET /compute/v2.1/servers/201433d5-db4e-4e57-a800-42fe5cfc95ca => generated 1367 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 05:01:40.854316 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-d6e52ed8-c589-4942-8e3c-6978b8a74d1b tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b1b0448e7f54e3aaae49e411699269e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66ec8bde739145dda504995dbea0914a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:01:40.866499 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-d6e52ed8-c589-4942-8e3c-6978b8a74d1b tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] 10.222.0.50 "GET /compute/v2.1/servers/b2daebb8-dfea-4ab9-8253-008a21f906e1" status: 200 len: 1363 microversion: 2.1 time: 0.228938 Sep 24 05:01:40.867457 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 84/169] 10.222.0.50 () {58 vars in 1236 bytes} [Sat Sep 24 05:01:40 2022] GET /compute/v2.1/servers/b2daebb8-dfea-4ab9-8253-008a21f906e1 => generated 1363 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 05:01:40.932864 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-21b12701-5e26-4480-8e57-41607e1a9d77 tempest-DeleteServersTestJSON-1630660203 tempest-DeleteServersTestJSON-1630660203-project] Calling method '>' {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:01:40.933465 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.compute.api [None req-21b12701-5e26-4480-8e57-41607e1a9d77 tempest-DeleteServersTestJSON-1630660203 tempest-DeleteServersTestJSON-1630660203-project] [instance: ec88b440-40a0-459f-b94b-06c332e86094] Fetching instance by UUID {{(pid=120594) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:01:40.940128 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-21b12701-5e26-4480-8e57-41607e1a9d77 tempest-DeleteServersTestJSON-1630660203 tempest-DeleteServersTestJSON-1630660203-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:01:40.940615 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-21b12701-5e26-4480-8e57-41607e1a9d77 tempest-DeleteServersTestJSON-1630660203 tempest-DeleteServersTestJSON-1630660203-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:01:40.941377 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-21b12701-5e26-4480-8e57-41607e1a9d77 tempest-DeleteServersTestJSON-1630660203 tempest-DeleteServersTestJSON-1630660203-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:01:40.941698 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-21b12701-5e26-4480-8e57-41607e1a9d77 tempest-DeleteServersTestJSON-1630660203 tempest-DeleteServersTestJSON-1630660203-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:01:40.942180 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-21b12701-5e26-4480-8e57-41607e1a9d77 tempest-DeleteServersTestJSON-1630660203 tempest-DeleteServersTestJSON-1630660203-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:01:40.942599 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-21b12701-5e26-4480-8e57-41607e1a9d77 tempest-DeleteServersTestJSON-1630660203 tempest-DeleteServersTestJSON-1630660203-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:01:41.000545 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-9d95661f-8ba9-483c-a243-d4a25943ed3a tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Calling method '>' {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:01:41.001142 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.compute.api [None req-9d95661f-8ba9-483c-a243-d4a25943ed3a tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] [instance: 08fb826b-e891-46c4-990d-ca03cf3f4222] Fetching instance by UUID {{(pid=120593) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:01:41.011341 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-9d95661f-8ba9-483c-a243-d4a25943ed3a tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:01:41.011745 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-9d95661f-8ba9-483c-a243-d4a25943ed3a tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:01:41.012185 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-9d95661f-8ba9-483c-a243-d4a25943ed3a tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:01:41.015577 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-9d95661f-8ba9-483c-a243-d4a25943ed3a tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:01:41.017493 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-9d95661f-8ba9-483c-a243-d4a25943ed3a tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:01:41.018041 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-9d95661f-8ba9-483c-a243-d4a25943ed3a tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:01:41.123024 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.policy [None req-21b12701-5e26-4480-8e57-41607e1a9d77 tempest-DeleteServersTestJSON-1630660203 tempest-DeleteServersTestJSON-1630660203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27d1a24c9e15493195744bcbf598ac4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa84dfa1cc764dc99b6e804e778c3479', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:01:41.128588 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [None req-21b12701-5e26-4480-8e57-41607e1a9d77 tempest-DeleteServersTestJSON-1630660203 tempest-DeleteServersTestJSON-1630660203-project] 10.222.0.50 "GET /compute/v2.1/servers/ec88b440-40a0-459f-b94b-06c332e86094" status: 200 len: 1315 microversion: 2.1 time: 0.199755 Sep 24 05:01:41.129224 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 86/170] 10.222.0.50 () {58 vars in 1236 bytes} [Sat Sep 24 05:01:40 2022] GET /compute/v2.1/servers/ec88b440-40a0-459f-b94b-06c332e86094 => generated 1315 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 05:01:41.217194 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-9d95661f-8ba9-483c-a243-d4a25943ed3a tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0948754217fc4ff2ba0241fa35feaf90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1aaf20f480a423ea5feca81585aeeed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:01:41.227716 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-d18cc515-6548-4187-9948-55bb18b39f8c tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Calling method '>' {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:01:41.228333 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.compute.api [None req-d18cc515-6548-4187-9948-55bb18b39f8c tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] [instance: 50eed27b-6da2-4dda-94cc-02fc5cfec071] Fetching instance by UUID {{(pid=120594) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:01:41.232115 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-9d95661f-8ba9-483c-a243-d4a25943ed3a tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0948754217fc4ff2ba0241fa35feaf90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1aaf20f480a423ea5feca81585aeeed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:01:41.235354 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-9d95661f-8ba9-483c-a243-d4a25943ed3a tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0948754217fc4ff2ba0241fa35feaf90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1aaf20f480a423ea5feca81585aeeed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:01:41.235974 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-d18cc515-6548-4187-9948-55bb18b39f8c tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:01:41.236722 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-d18cc515-6548-4187-9948-55bb18b39f8c tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:01:41.237199 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-d18cc515-6548-4187-9948-55bb18b39f8c tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:01:41.237786 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-9d95661f-8ba9-483c-a243-d4a25943ed3a tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] 10.222.0.50 "GET /compute/v2.1/servers/08fb826b-e891-46c4-990d-ca03cf3f4222" status: 200 len: 1404 microversion: 2.20 time: 0.241300 Sep 24 05:01:41.237932 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-d18cc515-6548-4187-9948-55bb18b39f8c tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:01:41.238613 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-d18cc515-6548-4187-9948-55bb18b39f8c tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:01:41.238932 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 85/171] 10.222.0.50 () {60 vars in 1277 bytes} [Sat Sep 24 05:01:40 2022] GET /compute/v2.1/servers/08fb826b-e891-46c4-990d-ca03cf3f4222 => generated 1404 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 24 05:01:41.250381 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-d18cc515-6548-4187-9948-55bb18b39f8c tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:01:41.380558 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.policy [None req-d18cc515-6548-4187-9948-55bb18b39f8c tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cdd0da2c7bc4139bcd48ef36a2ee183', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a18a3756ba2b460d977f738a115ebfe0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:01:41.387968 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [None req-d18cc515-6548-4187-9948-55bb18b39f8c tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] 10.222.0.50 "GET /compute/v2.1/servers/50eed27b-6da2-4dda-94cc-02fc5cfec071" status: 200 len: 1322 microversion: 2.1 time: 0.164190 Sep 24 05:01:41.388514 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 87/172] 10.222.0.50 () {58 vars in 1236 bytes} [Sat Sep 24 05:01:41 2022] GET /compute/v2.1/servers/50eed27b-6da2-4dda-94cc-02fc5cfec071 => generated 1322 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 05:01:41.723541 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-7cbd8685-fd5e-4992-ab35-7b1840d47d23 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Calling method '>' {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:01:41.724146 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.compute.api [None req-7cbd8685-fd5e-4992-ab35-7b1840d47d23 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] [instance: 201433d5-db4e-4e57-a800-42fe5cfc95ca] Fetching instance by UUID {{(pid=120593) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:01:41.734029 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-7cbd8685-fd5e-4992-ab35-7b1840d47d23 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:01:41.735585 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-7cbd8685-fd5e-4992-ab35-7b1840d47d23 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:01:41.736834 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-7cbd8685-fd5e-4992-ab35-7b1840d47d23 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:01:41.737496 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-7cbd8685-fd5e-4992-ab35-7b1840d47d23 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:01:41.738190 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-7cbd8685-fd5e-4992-ab35-7b1840d47d23 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:01:41.738656 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-7cbd8685-fd5e-4992-ab35-7b1840d47d23 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:01:41.757735 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG dbcounter [-] [120593] Writing DB stats nova_cell1:SELECT=100 {{(pid=120593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 05:01:41.899750 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-7cbd8685-fd5e-4992-ab35-7b1840d47d23 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74a8cc19ab204424ab23c62915ac2bab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87d5229e39fe4817b5187068d8acecc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:01:41.902929 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-75e25a19-2c40-42b0-af86-8864de092b16 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Calling method '>' {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:01:41.903774 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.compute.api [None req-75e25a19-2c40-42b0-af86-8864de092b16 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] [instance: b2daebb8-dfea-4ab9-8253-008a21f906e1] Fetching instance by UUID {{(pid=120594) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:01:41.911336 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-7cbd8685-fd5e-4992-ab35-7b1840d47d23 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] 10.222.0.50 "GET /compute/v2.1/servers/201433d5-db4e-4e57-a800-42fe5cfc95ca" status: 200 len: 1367 microversion: 2.1 time: 0.191651 Sep 24 05:01:41.913323 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-75e25a19-2c40-42b0-af86-8864de092b16 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:01:41.914386 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-75e25a19-2c40-42b0-af86-8864de092b16 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:01:41.915172 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-75e25a19-2c40-42b0-af86-8864de092b16 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:01:41.917547 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-75e25a19-2c40-42b0-af86-8864de092b16 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:01:41.918349 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-75e25a19-2c40-42b0-af86-8864de092b16 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:01:41.919130 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-75e25a19-2c40-42b0-af86-8864de092b16 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:01:41.930608 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 86/173] 10.222.0.50 () {58 vars in 1236 bytes} [Sat Sep 24 05:01:41 2022] GET /compute/v2.1/servers/201433d5-db4e-4e57-a800-42fe5cfc95ca => generated 1367 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 05:01:42.033123 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [req-f95a9d1e-58b8-4870-9a14-5cd9804b0b17 req-e8d68d4f-68c9-4120-a5ff-f46a0cdfd729 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "87dcedb5-91c7-4bc3-b46f-124ccffedf78", "name": "network-vif-plugged", "status": "completed", "tag": "0dd07bd5-e74b-434c-a105-6a9c537c3c96"}]} {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 05:01:42.051439 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [req-f95a9d1e-58b8-4870-9a14-5cd9804b0b17 req-e8d68d4f-68c9-4120-a5ff-f46a0cdfd729 service nova] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:01:42.051908 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [req-f95a9d1e-58b8-4870-9a14-5cd9804b0b17 req-e8d68d4f-68c9-4120-a5ff-f46a0cdfd729 service nova] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:01:42.052331 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [req-f95a9d1e-58b8-4870-9a14-5cd9804b0b17 req-e8d68d4f-68c9-4120-a5ff-f46a0cdfd729 service nova] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:01:42.066169 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.compute.server_external_events [req-f95a9d1e-58b8-4870-9a14-5cd9804b0b17 req-e8d68d4f-68c9-4120-a5ff-f46a0cdfd729 service nova] Creating event network-vif-plugged:0dd07bd5-e74b-434c-a105-6a9c537c3c96 for instance 87dcedb5-91c7-4bc3-b46f-124ccffedf78 on hv-cinder-85918 Sep 24 05:01:42.071334 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [req-f95a9d1e-58b8-4870-9a14-5cd9804b0b17 req-e8d68d4f-68c9-4120-a5ff-f46a0cdfd729 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041907 Sep 24 05:01:42.072441 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 87/174] 10.222.0.50 () {64 vars in 1317 bytes} [Sat Sep 24 05:01:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 05:01:42.153020 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-1d947e4e-c1d4-48c2-98eb-78ef827e33ef tempest-DeleteServersTestJSON-1630660203 tempest-DeleteServersTestJSON-1630660203-project] Calling method '>' {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:01:42.153761 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.compute.api [None req-1d947e4e-c1d4-48c2-98eb-78ef827e33ef tempest-DeleteServersTestJSON-1630660203 tempest-DeleteServersTestJSON-1630660203-project] [instance: ec88b440-40a0-459f-b94b-06c332e86094] Fetching instance by UUID {{(pid=120593) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:01:42.163604 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.policy [None req-75e25a19-2c40-42b0-af86-8864de092b16 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b1b0448e7f54e3aaae49e411699269e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66ec8bde739145dda504995dbea0914a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:01:42.165580 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-1d947e4e-c1d4-48c2-98eb-78ef827e33ef tempest-DeleteServersTestJSON-1630660203 tempest-DeleteServersTestJSON-1630660203-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:01:42.166207 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-1d947e4e-c1d4-48c2-98eb-78ef827e33ef tempest-DeleteServersTestJSON-1630660203 tempest-DeleteServersTestJSON-1630660203-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:01:42.167458 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-1d947e4e-c1d4-48c2-98eb-78ef827e33ef tempest-DeleteServersTestJSON-1630660203 tempest-DeleteServersTestJSON-1630660203-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:01:42.168357 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-1d947e4e-c1d4-48c2-98eb-78ef827e33ef tempest-DeleteServersTestJSON-1630660203 tempest-DeleteServersTestJSON-1630660203-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:01:42.168758 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-1d947e4e-c1d4-48c2-98eb-78ef827e33ef tempest-DeleteServersTestJSON-1630660203 tempest-DeleteServersTestJSON-1630660203-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:01:42.169618 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-1d947e4e-c1d4-48c2-98eb-78ef827e33ef tempest-DeleteServersTestJSON-1630660203 tempest-DeleteServersTestJSON-1630660203-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:01:42.171691 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [None req-75e25a19-2c40-42b0-af86-8864de092b16 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] 10.222.0.50 "GET /compute/v2.1/servers/b2daebb8-dfea-4ab9-8253-008a21f906e1" status: 200 len: 1363 microversion: 2.1 time: 0.272957 Sep 24 05:01:42.172283 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 88/175] 10.222.0.50 () {58 vars in 1236 bytes} [Sat Sep 24 05:01:41 2022] GET /compute/v2.1/servers/b2daebb8-dfea-4ab9-8253-008a21f906e1 => generated 1363 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 24 05:01:42.263560 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-55a5be8f-dd39-4179-9a1c-d7c16dbae47b tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Calling method '>' {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:01:42.264297 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.compute.api [None req-55a5be8f-dd39-4179-9a1c-d7c16dbae47b tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] [instance: 08fb826b-e891-46c4-990d-ca03cf3f4222] Fetching instance by UUID {{(pid=120594) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:01:42.271131 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-55a5be8f-dd39-4179-9a1c-d7c16dbae47b tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:01:42.271829 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-55a5be8f-dd39-4179-9a1c-d7c16dbae47b tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:01:42.272271 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-55a5be8f-dd39-4179-9a1c-d7c16dbae47b tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:01:42.272971 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-55a5be8f-dd39-4179-9a1c-d7c16dbae47b tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:01:42.273583 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-55a5be8f-dd39-4179-9a1c-d7c16dbae47b tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:01:42.274194 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-55a5be8f-dd39-4179-9a1c-d7c16dbae47b tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:01:42.309151 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-1d947e4e-c1d4-48c2-98eb-78ef827e33ef tempest-DeleteServersTestJSON-1630660203 tempest-DeleteServersTestJSON-1630660203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27d1a24c9e15493195744bcbf598ac4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa84dfa1cc764dc99b6e804e778c3479', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:01:42.317489 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-1d947e4e-c1d4-48c2-98eb-78ef827e33ef tempest-DeleteServersTestJSON-1630660203 tempest-DeleteServersTestJSON-1630660203-project] 10.222.0.50 "GET /compute/v2.1/servers/ec88b440-40a0-459f-b94b-06c332e86094" status: 200 len: 1315 microversion: 2.1 time: 0.168640 Sep 24 05:01:42.318076 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 88/176] 10.222.0.50 () {58 vars in 1236 bytes} [Sat Sep 24 05:01:42 2022] GET /compute/v2.1/servers/ec88b440-40a0-459f-b94b-06c332e86094 => generated 1315 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 24 05:01:42.413017 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-b80e048a-eeb9-4279-a454-8f92bcd28b5e tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Calling method '>' {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:01:42.413454 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.policy [None req-55a5be8f-dd39-4179-9a1c-d7c16dbae47b tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0948754217fc4ff2ba0241fa35feaf90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1aaf20f480a423ea5feca81585aeeed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:01:42.413910 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.compute.api [None req-b80e048a-eeb9-4279-a454-8f92bcd28b5e tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] [instance: 50eed27b-6da2-4dda-94cc-02fc5cfec071] Fetching instance by UUID {{(pid=120593) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:01:42.419832 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-b80e048a-eeb9-4279-a454-8f92bcd28b5e tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:01:42.420311 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-b80e048a-eeb9-4279-a454-8f92bcd28b5e tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:01:42.420740 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-b80e048a-eeb9-4279-a454-8f92bcd28b5e tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:01:42.422121 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-b80e048a-eeb9-4279-a454-8f92bcd28b5e tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:01:42.422529 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.policy [None req-55a5be8f-dd39-4179-9a1c-d7c16dbae47b tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0948754217fc4ff2ba0241fa35feaf90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1aaf20f480a423ea5feca81585aeeed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:01:42.422643 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-b80e048a-eeb9-4279-a454-8f92bcd28b5e tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:01:42.422976 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-b80e048a-eeb9-4279-a454-8f92bcd28b5e tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:01:42.424278 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.policy [None req-55a5be8f-dd39-4179-9a1c-d7c16dbae47b tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0948754217fc4ff2ba0241fa35feaf90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1aaf20f480a423ea5feca81585aeeed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:01:42.425577 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [None req-55a5be8f-dd39-4179-9a1c-d7c16dbae47b tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] 10.222.0.50 "GET /compute/v2.1/servers/08fb826b-e891-46c4-990d-ca03cf3f4222" status: 200 len: 1404 microversion: 2.20 time: 0.166198 Sep 24 05:01:42.426341 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 89/177] 10.222.0.50 () {60 vars in 1277 bytes} [Sat Sep 24 05:01:42 2022] GET /compute/v2.1/servers/08fb826b-e891-46c4-990d-ca03cf3f4222 => generated 1404 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 05:01:42.553031 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-b80e048a-eeb9-4279-a454-8f92bcd28b5e tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cdd0da2c7bc4139bcd48ef36a2ee183', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a18a3756ba2b460d977f738a115ebfe0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:01:42.562089 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-b80e048a-eeb9-4279-a454-8f92bcd28b5e tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] 10.222.0.50 "GET /compute/v2.1/servers/50eed27b-6da2-4dda-94cc-02fc5cfec071" status: 200 len: 1322 microversion: 2.1 time: 0.152863 Sep 24 05:01:42.562651 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 89/178] 10.222.0.50 () {58 vars in 1236 bytes} [Sat Sep 24 05:01:42 2022] GET /compute/v2.1/servers/50eed27b-6da2-4dda-94cc-02fc5cfec071 => generated 1322 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 24 05:01:42.940547 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-277ac34f-0903-4e56-bdc7-fecab98c8990 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Calling method '>' {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:01:42.941236 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.compute.api [None req-277ac34f-0903-4e56-bdc7-fecab98c8990 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] [instance: 201433d5-db4e-4e57-a800-42fe5cfc95ca] Fetching instance by UUID {{(pid=120594) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:01:42.947116 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-277ac34f-0903-4e56-bdc7-fecab98c8990 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:01:42.947589 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-277ac34f-0903-4e56-bdc7-fecab98c8990 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:01:42.948018 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-277ac34f-0903-4e56-bdc7-fecab98c8990 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:01:42.948730 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-277ac34f-0903-4e56-bdc7-fecab98c8990 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:01:42.949169 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-277ac34f-0903-4e56-bdc7-fecab98c8990 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:01:42.949590 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-277ac34f-0903-4e56-bdc7-fecab98c8990 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:01:43.084246 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.policy [None req-277ac34f-0903-4e56-bdc7-fecab98c8990 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74a8cc19ab204424ab23c62915ac2bab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87d5229e39fe4817b5187068d8acecc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:01:43.097216 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [None req-277ac34f-0903-4e56-bdc7-fecab98c8990 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] 10.222.0.50 "GET /compute/v2.1/servers/201433d5-db4e-4e57-a800-42fe5cfc95ca" status: 200 len: 1367 microversion: 2.1 time: 0.161355 Sep 24 05:01:43.097791 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 90/179] 10.222.0.50 () {58 vars in 1236 bytes} [Sat Sep 24 05:01:42 2022] GET /compute/v2.1/servers/201433d5-db4e-4e57-a800-42fe5cfc95ca => generated 1367 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 05:01:43.194809 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-fd037961-4e3c-4f24-88cd-570cb4d576df tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Calling method '>' {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:01:43.196124 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.compute.api [None req-fd037961-4e3c-4f24-88cd-570cb4d576df tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] [instance: b2daebb8-dfea-4ab9-8253-008a21f906e1] Fetching instance by UUID {{(pid=120593) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:01:43.202370 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-fd037961-4e3c-4f24-88cd-570cb4d576df tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:01:43.202925 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-fd037961-4e3c-4f24-88cd-570cb4d576df tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:01:43.203363 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-fd037961-4e3c-4f24-88cd-570cb4d576df tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:01:43.204220 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-fd037961-4e3c-4f24-88cd-570cb4d576df tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:01:43.204695 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-fd037961-4e3c-4f24-88cd-570cb4d576df tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:01:43.205334 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-fd037961-4e3c-4f24-88cd-570cb4d576df tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:01:43.344123 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-24f6e993-c1a8-4c58-95d5-b6405ee80beb tempest-DeleteServersTestJSON-1630660203 tempest-DeleteServersTestJSON-1630660203-project] Calling method '>' {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:01:43.345928 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.compute.api [None req-24f6e993-c1a8-4c58-95d5-b6405ee80beb tempest-DeleteServersTestJSON-1630660203 tempest-DeleteServersTestJSON-1630660203-project] [instance: ec88b440-40a0-459f-b94b-06c332e86094] Fetching instance by UUID {{(pid=120594) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:01:43.353616 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-fd037961-4e3c-4f24-88cd-570cb4d576df tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b1b0448e7f54e3aaae49e411699269e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66ec8bde739145dda504995dbea0914a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:01:43.360566 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-24f6e993-c1a8-4c58-95d5-b6405ee80beb tempest-DeleteServersTestJSON-1630660203 tempest-DeleteServersTestJSON-1630660203-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:01:43.362342 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-24f6e993-c1a8-4c58-95d5-b6405ee80beb tempest-DeleteServersTestJSON-1630660203 tempest-DeleteServersTestJSON-1630660203-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:01:43.363402 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-24f6e993-c1a8-4c58-95d5-b6405ee80beb tempest-DeleteServersTestJSON-1630660203 tempest-DeleteServersTestJSON-1630660203-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:01:43.364453 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-24f6e993-c1a8-4c58-95d5-b6405ee80beb tempest-DeleteServersTestJSON-1630660203 tempest-DeleteServersTestJSON-1630660203-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:01:43.365114 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-24f6e993-c1a8-4c58-95d5-b6405ee80beb tempest-DeleteServersTestJSON-1630660203 tempest-DeleteServersTestJSON-1630660203-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:01:43.366127 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-24f6e993-c1a8-4c58-95d5-b6405ee80beb tempest-DeleteServersTestJSON-1630660203 tempest-DeleteServersTestJSON-1630660203-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:01:43.369169 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-fd037961-4e3c-4f24-88cd-570cb4d576df tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] 10.222.0.50 "GET /compute/v2.1/servers/b2daebb8-dfea-4ab9-8253-008a21f906e1" status: 200 len: 1363 microversion: 2.1 time: 0.178000 Sep 24 05:01:43.378053 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 90/180] 10.222.0.50 () {58 vars in 1236 bytes} [Sat Sep 24 05:01:43 2022] GET /compute/v2.1/servers/b2daebb8-dfea-4ab9-8253-008a21f906e1 => generated 1363 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 05:01:43.456068 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-d9f76e5c-82d8-46c6-8c01-b248de1f026f tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Calling method '>' {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:01:43.456686 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.compute.api [None req-d9f76e5c-82d8-46c6-8c01-b248de1f026f tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] [instance: 08fb826b-e891-46c4-990d-ca03cf3f4222] Fetching instance by UUID {{(pid=120593) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:01:43.464363 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-d9f76e5c-82d8-46c6-8c01-b248de1f026f tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:01:43.465322 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-d9f76e5c-82d8-46c6-8c01-b248de1f026f tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:01:43.466256 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-d9f76e5c-82d8-46c6-8c01-b248de1f026f tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:01:43.467492 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-d9f76e5c-82d8-46c6-8c01-b248de1f026f tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:01:43.468652 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-d9f76e5c-82d8-46c6-8c01-b248de1f026f tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:01:43.469341 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-d9f76e5c-82d8-46c6-8c01-b248de1f026f tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:01:43.624618 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.policy [None req-24f6e993-c1a8-4c58-95d5-b6405ee80beb tempest-DeleteServersTestJSON-1630660203 tempest-DeleteServersTestJSON-1630660203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27d1a24c9e15493195744bcbf598ac4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa84dfa1cc764dc99b6e804e778c3479', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:01:43.632984 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [None req-24f6e993-c1a8-4c58-95d5-b6405ee80beb tempest-DeleteServersTestJSON-1630660203 tempest-DeleteServersTestJSON-1630660203-project] 10.222.0.50 "GET /compute/v2.1/servers/ec88b440-40a0-459f-b94b-06c332e86094" status: 200 len: 1315 microversion: 2.1 time: 0.296930 Sep 24 05:01:43.634124 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 91/181] 10.222.0.50 () {58 vars in 1236 bytes} [Sat Sep 24 05:01:43 2022] GET /compute/v2.1/servers/ec88b440-40a0-459f-b94b-06c332e86094 => generated 1315 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 05:01:43.638697 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-537c38e1-3220-42c7-af26-a95658046c8f tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Calling method '>' {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:01:43.639374 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.compute.api [None req-537c38e1-3220-42c7-af26-a95658046c8f tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] [instance: 50eed27b-6da2-4dda-94cc-02fc5cfec071] Fetching instance by UUID {{(pid=120594) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:01:43.646550 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-537c38e1-3220-42c7-af26-a95658046c8f tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:01:43.647129 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-537c38e1-3220-42c7-af26-a95658046c8f tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:01:43.647638 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-537c38e1-3220-42c7-af26-a95658046c8f tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:01:43.648411 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-537c38e1-3220-42c7-af26-a95658046c8f tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:01:43.648927 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-537c38e1-3220-42c7-af26-a95658046c8f tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:01:43.649415 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-537c38e1-3220-42c7-af26-a95658046c8f tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:01:43.715452 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-d9f76e5c-82d8-46c6-8c01-b248de1f026f tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0948754217fc4ff2ba0241fa35feaf90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1aaf20f480a423ea5feca81585aeeed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:01:43.725852 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-d9f76e5c-82d8-46c6-8c01-b248de1f026f tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0948754217fc4ff2ba0241fa35feaf90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1aaf20f480a423ea5feca81585aeeed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:01:43.727315 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-d9f76e5c-82d8-46c6-8c01-b248de1f026f tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0948754217fc4ff2ba0241fa35feaf90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1aaf20f480a423ea5feca81585aeeed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:01:43.728432 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-d9f76e5c-82d8-46c6-8c01-b248de1f026f tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] 10.222.0.50 "GET /compute/v2.1/servers/08fb826b-e891-46c4-990d-ca03cf3f4222" status: 200 len: 1404 microversion: 2.20 time: 0.279477 Sep 24 05:01:43.728979 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 91/182] 10.222.0.50 () {60 vars in 1277 bytes} [Sat Sep 24 05:01:43 2022] GET /compute/v2.1/servers/08fb826b-e891-46c4-990d-ca03cf3f4222 => generated 1404 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 05:01:43.840156 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.policy [None req-537c38e1-3220-42c7-af26-a95658046c8f tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cdd0da2c7bc4139bcd48ef36a2ee183', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a18a3756ba2b460d977f738a115ebfe0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:01:43.850951 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [None req-537c38e1-3220-42c7-af26-a95658046c8f tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] 10.222.0.50 "GET /compute/v2.1/servers/50eed27b-6da2-4dda-94cc-02fc5cfec071" status: 200 len: 1322 microversion: 2.1 time: 0.215653 Sep 24 05:01:43.851617 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 92/183] 10.222.0.50 () {58 vars in 1236 bytes} [Sat Sep 24 05:01:43 2022] GET /compute/v2.1/servers/50eed27b-6da2-4dda-94cc-02fc5cfec071 => generated 1322 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 05:01:44.125839 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-b7299737-ef17-4677-b1e3-fea84455ea8f tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Calling method '>' {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:01:44.128396 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.compute.api [None req-b7299737-ef17-4677-b1e3-fea84455ea8f tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] [instance: 201433d5-db4e-4e57-a800-42fe5cfc95ca] Fetching instance by UUID {{(pid=120593) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:01:44.142205 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-b7299737-ef17-4677-b1e3-fea84455ea8f tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:01:44.143105 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-b7299737-ef17-4677-b1e3-fea84455ea8f tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:01:44.144050 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-b7299737-ef17-4677-b1e3-fea84455ea8f tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:01:44.145250 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-b7299737-ef17-4677-b1e3-fea84455ea8f tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:01:44.146073 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-b7299737-ef17-4677-b1e3-fea84455ea8f tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:01:44.147007 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-b7299737-ef17-4677-b1e3-fea84455ea8f tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:01:44.336842 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-b7299737-ef17-4677-b1e3-fea84455ea8f tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74a8cc19ab204424ab23c62915ac2bab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87d5229e39fe4817b5187068d8acecc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:01:44.347983 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-b7299737-ef17-4677-b1e3-fea84455ea8f tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] 10.222.0.50 "GET /compute/v2.1/servers/201433d5-db4e-4e57-a800-42fe5cfc95ca" status: 200 len: 1367 microversion: 2.1 time: 0.229860 Sep 24 05:01:44.349187 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 92/184] 10.222.0.50 () {58 vars in 1236 bytes} [Sat Sep 24 05:01:44 2022] GET /compute/v2.1/servers/201433d5-db4e-4e57-a800-42fe5cfc95ca => generated 1367 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 05:01:44.399986 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-e42b937a-bcec-4627-89b0-bfbc1bf71355 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Calling method '>' {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:01:44.400764 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.compute.api [None req-e42b937a-bcec-4627-89b0-bfbc1bf71355 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] [instance: b2daebb8-dfea-4ab9-8253-008a21f906e1] Fetching instance by UUID {{(pid=120594) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:01:44.406292 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG dbcounter [-] [120594] Writing DB stats nova_api:SELECT=100 {{(pid=120594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 05:01:44.412133 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-e42b937a-bcec-4627-89b0-bfbc1bf71355 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:01:44.412808 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-e42b937a-bcec-4627-89b0-bfbc1bf71355 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:01:44.413374 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-e42b937a-bcec-4627-89b0-bfbc1bf71355 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:01:44.414255 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-e42b937a-bcec-4627-89b0-bfbc1bf71355 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:01:44.414920 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-e42b937a-bcec-4627-89b0-bfbc1bf71355 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:01:44.415358 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-e42b937a-bcec-4627-89b0-bfbc1bf71355 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:01:44.437657 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG dbcounter [-] [120594] Writing DB stats nova_cell1:SELECT=100 {{(pid=120594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 05:01:44.573040 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.policy [None req-e42b937a-bcec-4627-89b0-bfbc1bf71355 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b1b0448e7f54e3aaae49e411699269e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66ec8bde739145dda504995dbea0914a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:01:44.582830 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [None req-e42b937a-bcec-4627-89b0-bfbc1bf71355 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] 10.222.0.50 "GET /compute/v2.1/servers/b2daebb8-dfea-4ab9-8253-008a21f906e1" status: 200 len: 1363 microversion: 2.1 time: 0.187530 Sep 24 05:01:44.583981 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 93/185] 10.222.0.50 () {58 vars in 1236 bytes} [Sat Sep 24 05:01:44 2022] GET /compute/v2.1/servers/b2daebb8-dfea-4ab9-8253-008a21f906e1 => generated 1363 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 05:01:44.659120 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-dee23b8a-ccac-41ec-89eb-77f7b4b27add tempest-DeleteServersTestJSON-1630660203 tempest-DeleteServersTestJSON-1630660203-project] Calling method '>' {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:01:44.660067 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.compute.api [None req-dee23b8a-ccac-41ec-89eb-77f7b4b27add tempest-DeleteServersTestJSON-1630660203 tempest-DeleteServersTestJSON-1630660203-project] [instance: ec88b440-40a0-459f-b94b-06c332e86094] Fetching instance by UUID {{(pid=120593) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:01:44.668639 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-dee23b8a-ccac-41ec-89eb-77f7b4b27add tempest-DeleteServersTestJSON-1630660203 tempest-DeleteServersTestJSON-1630660203-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:01:44.669354 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-dee23b8a-ccac-41ec-89eb-77f7b4b27add tempest-DeleteServersTestJSON-1630660203 tempest-DeleteServersTestJSON-1630660203-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:01:44.669870 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-dee23b8a-ccac-41ec-89eb-77f7b4b27add tempest-DeleteServersTestJSON-1630660203 tempest-DeleteServersTestJSON-1630660203-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:01:44.670647 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-dee23b8a-ccac-41ec-89eb-77f7b4b27add tempest-DeleteServersTestJSON-1630660203 tempest-DeleteServersTestJSON-1630660203-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:01:44.671359 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-dee23b8a-ccac-41ec-89eb-77f7b4b27add tempest-DeleteServersTestJSON-1630660203 tempest-DeleteServersTestJSON-1630660203-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:01:44.671845 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-dee23b8a-ccac-41ec-89eb-77f7b4b27add tempest-DeleteServersTestJSON-1630660203 tempest-DeleteServersTestJSON-1630660203-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:01:44.756627 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-867d41ef-2151-4a91-8044-a0dd021063c4 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Calling method '>' {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:01:44.758461 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.compute.api [None req-867d41ef-2151-4a91-8044-a0dd021063c4 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] [instance: 08fb826b-e891-46c4-990d-ca03cf3f4222] Fetching instance by UUID {{(pid=120594) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:01:44.768064 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-867d41ef-2151-4a91-8044-a0dd021063c4 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:01:44.769454 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-867d41ef-2151-4a91-8044-a0dd021063c4 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:01:44.769924 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-867d41ef-2151-4a91-8044-a0dd021063c4 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:01:44.771048 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-867d41ef-2151-4a91-8044-a0dd021063c4 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:01:44.771582 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-867d41ef-2151-4a91-8044-a0dd021063c4 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:01:44.772206 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-867d41ef-2151-4a91-8044-a0dd021063c4 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:01:44.882586 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-dee23b8a-ccac-41ec-89eb-77f7b4b27add tempest-DeleteServersTestJSON-1630660203 tempest-DeleteServersTestJSON-1630660203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27d1a24c9e15493195744bcbf598ac4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa84dfa1cc764dc99b6e804e778c3479', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:01:44.892041 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-dee23b8a-ccac-41ec-89eb-77f7b4b27add tempest-DeleteServersTestJSON-1630660203 tempest-DeleteServersTestJSON-1630660203-project] 10.222.0.50 "GET /compute/v2.1/servers/ec88b440-40a0-459f-b94b-06c332e86094" status: 200 len: 1315 microversion: 2.1 time: 0.238858 Sep 24 05:01:44.893263 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 93/186] 10.222.0.50 () {58 vars in 1236 bytes} [Sat Sep 24 05:01:44 2022] GET /compute/v2.1/servers/ec88b440-40a0-459f-b94b-06c332e86094 => generated 1315 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 05:01:44.902559 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-149a0a6c-d703-4833-baff-ae849d907194 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Calling method '>' {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:01:44.903367 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.compute.api [None req-149a0a6c-d703-4833-baff-ae849d907194 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] [instance: 50eed27b-6da2-4dda-94cc-02fc5cfec071] Fetching instance by UUID {{(pid=120593) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:01:44.912189 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-149a0a6c-d703-4833-baff-ae849d907194 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:01:44.912653 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-149a0a6c-d703-4833-baff-ae849d907194 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:01:44.913085 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-149a0a6c-d703-4833-baff-ae849d907194 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:01:44.913786 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-149a0a6c-d703-4833-baff-ae849d907194 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:01:44.914382 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-149a0a6c-d703-4833-baff-ae849d907194 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:01:44.914788 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-149a0a6c-d703-4833-baff-ae849d907194 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:01:45.025075 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.policy [None req-867d41ef-2151-4a91-8044-a0dd021063c4 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0948754217fc4ff2ba0241fa35feaf90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1aaf20f480a423ea5feca81585aeeed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:01:45.034729 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.policy [None req-867d41ef-2151-4a91-8044-a0dd021063c4 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0948754217fc4ff2ba0241fa35feaf90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1aaf20f480a423ea5feca81585aeeed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:01:45.036454 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.policy [None req-867d41ef-2151-4a91-8044-a0dd021063c4 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0948754217fc4ff2ba0241fa35feaf90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1aaf20f480a423ea5feca81585aeeed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:01:45.037628 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [None req-867d41ef-2151-4a91-8044-a0dd021063c4 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] 10.222.0.50 "GET /compute/v2.1/servers/08fb826b-e891-46c4-990d-ca03cf3f4222" status: 200 len: 1404 microversion: 2.20 time: 0.288723 Sep 24 05:01:45.038546 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 94/187] 10.222.0.50 () {60 vars in 1277 bytes} [Sat Sep 24 05:01:44 2022] GET /compute/v2.1/servers/08fb826b-e891-46c4-990d-ca03cf3f4222 => generated 1404 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 24 05:01:45.137309 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-149a0a6c-d703-4833-baff-ae849d907194 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cdd0da2c7bc4139bcd48ef36a2ee183', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a18a3756ba2b460d977f738a115ebfe0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:01:45.146505 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-149a0a6c-d703-4833-baff-ae849d907194 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] 10.222.0.50 "GET /compute/v2.1/servers/50eed27b-6da2-4dda-94cc-02fc5cfec071" status: 200 len: 1322 microversion: 2.1 time: 0.251922 Sep 24 05:01:45.159715 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 94/188] 10.222.0.50 () {58 vars in 1236 bytes} [Sat Sep 24 05:01:44 2022] GET /compute/v2.1/servers/50eed27b-6da2-4dda-94cc-02fc5cfec071 => generated 1322 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 05:01:45.373711 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-5a1fafd6-5a44-418e-9e3f-9f6b953f1c0a tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Calling method '>' {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:01:45.375282 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.compute.api [None req-5a1fafd6-5a44-418e-9e3f-9f6b953f1c0a tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] [instance: 201433d5-db4e-4e57-a800-42fe5cfc95ca] Fetching instance by UUID {{(pid=120594) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:01:45.384740 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-5a1fafd6-5a44-418e-9e3f-9f6b953f1c0a tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:01:45.385670 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-5a1fafd6-5a44-418e-9e3f-9f6b953f1c0a tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:01:45.389526 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-5a1fafd6-5a44-418e-9e3f-9f6b953f1c0a tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:01:45.391605 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-5a1fafd6-5a44-418e-9e3f-9f6b953f1c0a tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:01:45.393903 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-5a1fafd6-5a44-418e-9e3f-9f6b953f1c0a tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:01:45.394669 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-5a1fafd6-5a44-418e-9e3f-9f6b953f1c0a tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:01:45.610736 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-dcc6f553-f394-407b-9744-4e56d2fa0a02 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Calling method '>' {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:01:45.612081 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.compute.api [None req-dcc6f553-f394-407b-9744-4e56d2fa0a02 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] [instance: b2daebb8-dfea-4ab9-8253-008a21f906e1] Fetching instance by UUID {{(pid=120593) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:01:45.619382 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-dcc6f553-f394-407b-9744-4e56d2fa0a02 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:01:45.620222 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-dcc6f553-f394-407b-9744-4e56d2fa0a02 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:01:45.620875 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-dcc6f553-f394-407b-9744-4e56d2fa0a02 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:01:45.621822 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-dcc6f553-f394-407b-9744-4e56d2fa0a02 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:01:45.622575 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-dcc6f553-f394-407b-9744-4e56d2fa0a02 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:01:45.623203 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-dcc6f553-f394-407b-9744-4e56d2fa0a02 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:01:46.027699 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.policy [None req-5a1fafd6-5a44-418e-9e3f-9f6b953f1c0a tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74a8cc19ab204424ab23c62915ac2bab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87d5229e39fe4817b5187068d8acecc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:01:46.040905 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [None req-5a1fafd6-5a44-418e-9e3f-9f6b953f1c0a tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] 10.222.0.50 "GET /compute/v2.1/servers/201433d5-db4e-4e57-a800-42fe5cfc95ca" status: 200 len: 1367 microversion: 2.1 time: 0.672750 Sep 24 05:01:46.043737 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 95/189] 10.222.0.50 () {58 vars in 1236 bytes} [Sat Sep 24 05:01:45 2022] GET /compute/v2.1/servers/201433d5-db4e-4e57-a800-42fe5cfc95ca => generated 1367 bytes in 676 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 05:01:46.065664 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-45a00bcf-49e5-4ef0-9979-f4d1bd51ac4a tempest-DeleteServersTestJSON-1630660203 tempest-DeleteServersTestJSON-1630660203-project] Calling method '>' {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:01:46.066637 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.compute.api [None req-45a00bcf-49e5-4ef0-9979-f4d1bd51ac4a tempest-DeleteServersTestJSON-1630660203 tempest-DeleteServersTestJSON-1630660203-project] [instance: ec88b440-40a0-459f-b94b-06c332e86094] Fetching instance by UUID {{(pid=120594) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:01:46.083108 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-45a00bcf-49e5-4ef0-9979-f4d1bd51ac4a tempest-DeleteServersTestJSON-1630660203 tempest-DeleteServersTestJSON-1630660203-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:01:46.084855 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-45a00bcf-49e5-4ef0-9979-f4d1bd51ac4a tempest-DeleteServersTestJSON-1630660203 tempest-DeleteServersTestJSON-1630660203-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:01:46.087583 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-45a00bcf-49e5-4ef0-9979-f4d1bd51ac4a tempest-DeleteServersTestJSON-1630660203 tempest-DeleteServersTestJSON-1630660203-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:01:46.088557 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-45a00bcf-49e5-4ef0-9979-f4d1bd51ac4a tempest-DeleteServersTestJSON-1630660203 tempest-DeleteServersTestJSON-1630660203-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:01:46.089125 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-45a00bcf-49e5-4ef0-9979-f4d1bd51ac4a tempest-DeleteServersTestJSON-1630660203 tempest-DeleteServersTestJSON-1630660203-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:01:46.089741 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-45a00bcf-49e5-4ef0-9979-f4d1bd51ac4a tempest-DeleteServersTestJSON-1630660203 tempest-DeleteServersTestJSON-1630660203-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:01:46.096848 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-dcc6f553-f394-407b-9744-4e56d2fa0a02 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b1b0448e7f54e3aaae49e411699269e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66ec8bde739145dda504995dbea0914a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:01:46.109935 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-dcc6f553-f394-407b-9744-4e56d2fa0a02 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] 10.222.0.50 "GET /compute/v2.1/servers/b2daebb8-dfea-4ab9-8253-008a21f906e1" status: 200 len: 1363 microversion: 2.1 time: 0.503264 Sep 24 05:01:46.112386 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 95/190] 10.222.0.50 () {58 vars in 1236 bytes} [Sat Sep 24 05:01:45 2022] GET /compute/v2.1/servers/b2daebb8-dfea-4ab9-8253-008a21f906e1 => generated 1363 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 05:01:46.123578 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-bfda0175-c5ff-4f8f-bdab-64d58520c9c3 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Calling method '>' {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:01:46.124196 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.compute.api [None req-bfda0175-c5ff-4f8f-bdab-64d58520c9c3 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] [instance: 08fb826b-e891-46c4-990d-ca03cf3f4222] Fetching instance by UUID {{(pid=120593) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:01:46.156631 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-bfda0175-c5ff-4f8f-bdab-64d58520c9c3 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:01:46.157299 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-bfda0175-c5ff-4f8f-bdab-64d58520c9c3 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:01:46.157746 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-bfda0175-c5ff-4f8f-bdab-64d58520c9c3 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:01:46.158488 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-bfda0175-c5ff-4f8f-bdab-64d58520c9c3 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:01:46.159239 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-bfda0175-c5ff-4f8f-bdab-64d58520c9c3 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:01:46.159815 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-bfda0175-c5ff-4f8f-bdab-64d58520c9c3 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:01:46.418702 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.policy [None req-45a00bcf-49e5-4ef0-9979-f4d1bd51ac4a tempest-DeleteServersTestJSON-1630660203 tempest-DeleteServersTestJSON-1630660203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27d1a24c9e15493195744bcbf598ac4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa84dfa1cc764dc99b6e804e778c3479', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:01:46.430319 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [None req-45a00bcf-49e5-4ef0-9979-f4d1bd51ac4a tempest-DeleteServersTestJSON-1630660203 tempest-DeleteServersTestJSON-1630660203-project] 10.222.0.50 "GET /compute/v2.1/servers/ec88b440-40a0-459f-b94b-06c332e86094" status: 200 len: 1502 microversion: 2.1 time: 0.378543 Sep 24 05:01:46.430910 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 96/191] 10.222.0.50 () {58 vars in 1236 bytes} [Sat Sep 24 05:01:46 2022] GET /compute/v2.1/servers/ec88b440-40a0-459f-b94b-06c332e86094 => generated 1502 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 05:01:46.448011 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-49f3105a-dc11-4458-bf80-445fc2d1e65c tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Calling method '>' {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:01:46.449585 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.compute.api [None req-49f3105a-dc11-4458-bf80-445fc2d1e65c tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] [instance: 50eed27b-6da2-4dda-94cc-02fc5cfec071] Fetching instance by UUID {{(pid=120594) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:01:46.465237 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-49f3105a-dc11-4458-bf80-445fc2d1e65c tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:01:46.467305 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-49f3105a-dc11-4458-bf80-445fc2d1e65c tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:01:46.468121 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-49f3105a-dc11-4458-bf80-445fc2d1e65c tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:01:46.471527 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-49f3105a-dc11-4458-bf80-445fc2d1e65c tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:01:46.472775 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-49f3105a-dc11-4458-bf80-445fc2d1e65c tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:01:46.473986 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-49f3105a-dc11-4458-bf80-445fc2d1e65c tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:01:46.513409 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-bfda0175-c5ff-4f8f-bdab-64d58520c9c3 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0948754217fc4ff2ba0241fa35feaf90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1aaf20f480a423ea5feca81585aeeed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:01:46.523074 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-bfda0175-c5ff-4f8f-bdab-64d58520c9c3 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0948754217fc4ff2ba0241fa35feaf90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1aaf20f480a423ea5feca81585aeeed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:01:46.525056 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-bfda0175-c5ff-4f8f-bdab-64d58520c9c3 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0948754217fc4ff2ba0241fa35feaf90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1aaf20f480a423ea5feca81585aeeed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:01:46.526350 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-bfda0175-c5ff-4f8f-bdab-64d58520c9c3 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] 10.222.0.50 "GET /compute/v2.1/servers/08fb826b-e891-46c4-990d-ca03cf3f4222" status: 200 len: 1404 microversion: 2.20 time: 0.412995 Sep 24 05:01:46.545938 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 96/192] 10.222.0.50 () {60 vars in 1277 bytes} [Sat Sep 24 05:01:46 2022] GET /compute/v2.1/servers/08fb826b-e891-46c4-990d-ca03cf3f4222 => generated 1404 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 05:01:46.556498 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [req-1b187e7d-6646-4088-bd95-d96588c26116 req-37fd8f3b-e66d-4487-8bc3-ed50c1d58617 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "50eed27b-6da2-4dda-94cc-02fc5cfec071", "name": "network-vif-plugged", "status": "completed", "tag": "990ceab0-dcdb-43e0-ab13-ed36ddfbeabf"}]} {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 05:01:46.580898 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [req-1b187e7d-6646-4088-bd95-d96588c26116 req-37fd8f3b-e66d-4487-8bc3-ed50c1d58617 service nova] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:01:46.581379 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [req-1b187e7d-6646-4088-bd95-d96588c26116 req-37fd8f3b-e66d-4487-8bc3-ed50c1d58617 service nova] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:01:46.581810 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [req-1b187e7d-6646-4088-bd95-d96588c26116 req-37fd8f3b-e66d-4487-8bc3-ed50c1d58617 service nova] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:01:46.598592 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.compute.server_external_events [req-1b187e7d-6646-4088-bd95-d96588c26116 req-37fd8f3b-e66d-4487-8bc3-ed50c1d58617 service nova] Creating event network-vif-plugged:990ceab0-dcdb-43e0-ab13-ed36ddfbeabf for instance 50eed27b-6da2-4dda-94cc-02fc5cfec071 on hv-cinder-85918 Sep 24 05:01:46.605840 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [req-1b187e7d-6646-4088-bd95-d96588c26116 req-37fd8f3b-e66d-4487-8bc3-ed50c1d58617 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.057996 Sep 24 05:01:46.606410 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 97/193] 10.222.0.50 () {64 vars in 1317 bytes} [Sat Sep 24 05:01:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 05:01:46.688009 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.policy [None req-49f3105a-dc11-4458-bf80-445fc2d1e65c tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cdd0da2c7bc4139bcd48ef36a2ee183', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a18a3756ba2b460d977f738a115ebfe0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:01:46.698736 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [None req-49f3105a-dc11-4458-bf80-445fc2d1e65c tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] 10.222.0.50 "GET /compute/v2.1/servers/50eed27b-6da2-4dda-94cc-02fc5cfec071" status: 200 len: 1322 microversion: 2.1 time: 0.265586 Sep 24 05:01:46.699560 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 97/194] 10.222.0.50 () {58 vars in 1236 bytes} [Sat Sep 24 05:01:46 2022] GET /compute/v2.1/servers/50eed27b-6da2-4dda-94cc-02fc5cfec071 => generated 1322 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 05:01:47.068475 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-a8f8d002-88e8-4653-9139-8932e4366bb9 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Calling method '>' {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:01:47.070554 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.compute.api [None req-a8f8d002-88e8-4653-9139-8932e4366bb9 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] [instance: 201433d5-db4e-4e57-a800-42fe5cfc95ca] Fetching instance by UUID {{(pid=120593) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:01:47.076403 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-a8f8d002-88e8-4653-9139-8932e4366bb9 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:01:47.076906 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-a8f8d002-88e8-4653-9139-8932e4366bb9 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:01:47.077349 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-a8f8d002-88e8-4653-9139-8932e4366bb9 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:01:47.078185 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-a8f8d002-88e8-4653-9139-8932e4366bb9 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:01:47.078971 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-a8f8d002-88e8-4653-9139-8932e4366bb9 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:01:47.079404 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-a8f8d002-88e8-4653-9139-8932e4366bb9 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:01:47.137719 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-9cdf0ccf-a7fb-473d-b312-3970bbf477f2 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Calling method '>' {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:01:47.139299 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.compute.api [None req-9cdf0ccf-a7fb-473d-b312-3970bbf477f2 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] [instance: b2daebb8-dfea-4ab9-8253-008a21f906e1] Fetching instance by UUID {{(pid=120594) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:01:47.148767 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-9cdf0ccf-a7fb-473d-b312-3970bbf477f2 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:01:47.149418 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-9cdf0ccf-a7fb-473d-b312-3970bbf477f2 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:01:47.149953 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-9cdf0ccf-a7fb-473d-b312-3970bbf477f2 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:01:47.150912 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-9cdf0ccf-a7fb-473d-b312-3970bbf477f2 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:01:47.151633 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-9cdf0ccf-a7fb-473d-b312-3970bbf477f2 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:01:47.154106 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-9cdf0ccf-a7fb-473d-b312-3970bbf477f2 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:01:47.274830 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-a8f8d002-88e8-4653-9139-8932e4366bb9 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74a8cc19ab204424ab23c62915ac2bab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87d5229e39fe4817b5187068d8acecc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:01:47.291327 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-a8f8d002-88e8-4653-9139-8932e4366bb9 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] 10.222.0.50 "GET /compute/v2.1/servers/201433d5-db4e-4e57-a800-42fe5cfc95ca" status: 200 len: 1367 microversion: 2.1 time: 0.227383 Sep 24 05:01:47.294692 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 98/195] 10.222.0.50 () {58 vars in 1236 bytes} [Sat Sep 24 05:01:47 2022] GET /compute/v2.1/servers/201433d5-db4e-4e57-a800-42fe5cfc95ca => generated 1367 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 05:01:47.411456 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.policy [None req-9cdf0ccf-a7fb-473d-b312-3970bbf477f2 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b1b0448e7f54e3aaae49e411699269e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66ec8bde739145dda504995dbea0914a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:01:47.419796 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [None req-9cdf0ccf-a7fb-473d-b312-3970bbf477f2 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] 10.222.0.50 "GET /compute/v2.1/servers/b2daebb8-dfea-4ab9-8253-008a21f906e1" status: 200 len: 1363 microversion: 2.1 time: 0.286895 Sep 24 05:01:47.434381 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 98/196] 10.222.0.50 () {58 vars in 1236 bytes} [Sat Sep 24 05:01:47 2022] GET /compute/v2.1/servers/b2daebb8-dfea-4ab9-8253-008a21f906e1 => generated 1363 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 24 05:01:47.551442 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-ac55060a-fa5e-472a-8904-0e73ab75d182 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Calling method '>' {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:01:47.552009 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.compute.api [None req-ac55060a-fa5e-472a-8904-0e73ab75d182 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] [instance: 08fb826b-e891-46c4-990d-ca03cf3f4222] Fetching instance by UUID {{(pid=120593) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:01:47.557873 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-ac55060a-fa5e-472a-8904-0e73ab75d182 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:01:47.558395 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-ac55060a-fa5e-472a-8904-0e73ab75d182 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:01:47.558827 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-ac55060a-fa5e-472a-8904-0e73ab75d182 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:01:47.559612 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-ac55060a-fa5e-472a-8904-0e73ab75d182 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:01:47.560065 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-ac55060a-fa5e-472a-8904-0e73ab75d182 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:01:47.560647 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-ac55060a-fa5e-472a-8904-0e73ab75d182 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:01:47.697459 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-ac55060a-fa5e-472a-8904-0e73ab75d182 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0948754217fc4ff2ba0241fa35feaf90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1aaf20f480a423ea5feca81585aeeed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:01:47.705678 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-ac55060a-fa5e-472a-8904-0e73ab75d182 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0948754217fc4ff2ba0241fa35feaf90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1aaf20f480a423ea5feca81585aeeed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:01:47.707307 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-ac55060a-fa5e-472a-8904-0e73ab75d182 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0948754217fc4ff2ba0241fa35feaf90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1aaf20f480a423ea5feca81585aeeed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:01:47.708413 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-ac55060a-fa5e-472a-8904-0e73ab75d182 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] 10.222.0.50 "GET /compute/v2.1/servers/08fb826b-e891-46c4-990d-ca03cf3f4222" status: 200 len: 1404 microversion: 2.20 time: 0.160840 Sep 24 05:01:47.708959 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 99/197] 10.222.0.50 () {60 vars in 1277 bytes} [Sat Sep 24 05:01:47 2022] GET /compute/v2.1/servers/08fb826b-e891-46c4-990d-ca03cf3f4222 => generated 1404 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 05:01:47.723538 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-ae08a510-1acc-473c-8a21-9e0dcba4ef03 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Calling method '>' {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:01:47.724221 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.compute.api [None req-ae08a510-1acc-473c-8a21-9e0dcba4ef03 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] [instance: 50eed27b-6da2-4dda-94cc-02fc5cfec071] Fetching instance by UUID {{(pid=120594) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:01:47.730586 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-ae08a510-1acc-473c-8a21-9e0dcba4ef03 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:01:47.731068 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-ae08a510-1acc-473c-8a21-9e0dcba4ef03 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:01:47.731529 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-ae08a510-1acc-473c-8a21-9e0dcba4ef03 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:01:47.732241 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-ae08a510-1acc-473c-8a21-9e0dcba4ef03 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:01:47.732690 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-ae08a510-1acc-473c-8a21-9e0dcba4ef03 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:01:47.733111 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-ae08a510-1acc-473c-8a21-9e0dcba4ef03 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:01:47.871738 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.policy [None req-ae08a510-1acc-473c-8a21-9e0dcba4ef03 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cdd0da2c7bc4139bcd48ef36a2ee183', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a18a3756ba2b460d977f738a115ebfe0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:01:47.879772 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [None req-ae08a510-1acc-473c-8a21-9e0dcba4ef03 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] 10.222.0.50 "GET /compute/v2.1/servers/50eed27b-6da2-4dda-94cc-02fc5cfec071" status: 200 len: 1322 microversion: 2.1 time: 0.160359 Sep 24 05:01:47.880344 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 99/198] 10.222.0.50 () {58 vars in 1236 bytes} [Sat Sep 24 05:01:47 2022] GET /compute/v2.1/servers/50eed27b-6da2-4dda-94cc-02fc5cfec071 => generated 1322 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 05:01:48.013590 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-45904415-adda-4ebb-a503-ced99eaf83a9 tempest-DeleteServersTestJSON-1630660203 tempest-DeleteServersTestJSON-1630660203-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "bab57448-5a92-4940-9eed-3cbf64933b7c"}} {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 05:01:48.016827 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.compute.api [None req-45904415-adda-4ebb-a503-ced99eaf83a9 tempest-DeleteServersTestJSON-1630660203 tempest-DeleteServersTestJSON-1630660203-project] [instance: ec88b440-40a0-459f-b94b-06c332e86094] Fetching instance by UUID {{(pid=120593) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:01:48.022765 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-45904415-adda-4ebb-a503-ced99eaf83a9 tempest-DeleteServersTestJSON-1630660203 tempest-DeleteServersTestJSON-1630660203-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:01:48.023238 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-45904415-adda-4ebb-a503-ced99eaf83a9 tempest-DeleteServersTestJSON-1630660203 tempest-DeleteServersTestJSON-1630660203-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:01:48.023726 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-45904415-adda-4ebb-a503-ced99eaf83a9 tempest-DeleteServersTestJSON-1630660203 tempest-DeleteServersTestJSON-1630660203-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:01:48.024416 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-45904415-adda-4ebb-a503-ced99eaf83a9 tempest-DeleteServersTestJSON-1630660203 tempest-DeleteServersTestJSON-1630660203-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:01:48.024931 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-45904415-adda-4ebb-a503-ced99eaf83a9 tempest-DeleteServersTestJSON-1630660203 tempest-DeleteServersTestJSON-1630660203-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:01:48.025337 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-45904415-adda-4ebb-a503-ced99eaf83a9 tempest-DeleteServersTestJSON-1630660203 tempest-DeleteServersTestJSON-1630660203-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:01:48.321903 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-c8ff2e6a-6779-4109-9b4e-81e54a26b62a tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Calling method '>' {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:01:48.321903 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.compute.api [None req-c8ff2e6a-6779-4109-9b4e-81e54a26b62a tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] [instance: 201433d5-db4e-4e57-a800-42fe5cfc95ca] Fetching instance by UUID {{(pid=120594) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:01:48.334449 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-c8ff2e6a-6779-4109-9b4e-81e54a26b62a tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:01:48.335208 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-c8ff2e6a-6779-4109-9b4e-81e54a26b62a tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:01:48.335649 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-c8ff2e6a-6779-4109-9b4e-81e54a26b62a tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:01:48.336349 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-c8ff2e6a-6779-4109-9b4e-81e54a26b62a tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:01:48.336922 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-c8ff2e6a-6779-4109-9b4e-81e54a26b62a tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:01:48.337379 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-c8ff2e6a-6779-4109-9b4e-81e54a26b62a tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:01:48.513873 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.policy [None req-c8ff2e6a-6779-4109-9b4e-81e54a26b62a tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74a8cc19ab204424ab23c62915ac2bab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87d5229e39fe4817b5187068d8acecc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:01:48.522965 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [None req-c8ff2e6a-6779-4109-9b4e-81e54a26b62a tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] 10.222.0.50 "GET /compute/v2.1/servers/201433d5-db4e-4e57-a800-42fe5cfc95ca" status: 200 len: 1367 microversion: 2.1 time: 0.209038 Sep 24 05:01:48.530313 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 100/199] 10.222.0.50 () {58 vars in 1236 bytes} [Sat Sep 24 05:01:48 2022] GET /compute/v2.1/servers/201433d5-db4e-4e57-a800-42fe5cfc95ca => generated 1367 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 24 05:01:48.535642 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-141465d8-31f6-4769-aabf-7d8c39a109fe tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Calling method '>' {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:01:48.536260 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.compute.api [None req-141465d8-31f6-4769-aabf-7d8c39a109fe tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] [instance: b2daebb8-dfea-4ab9-8253-008a21f906e1] Fetching instance by UUID {{(pid=120594) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:01:48.548853 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-141465d8-31f6-4769-aabf-7d8c39a109fe tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:01:48.549369 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-141465d8-31f6-4769-aabf-7d8c39a109fe tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:01:48.550038 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-141465d8-31f6-4769-aabf-7d8c39a109fe tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:01:48.550962 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-141465d8-31f6-4769-aabf-7d8c39a109fe tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:01:48.551506 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-141465d8-31f6-4769-aabf-7d8c39a109fe tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:01:48.552361 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-141465d8-31f6-4769-aabf-7d8c39a109fe tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:01:48.736369 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.policy [None req-141465d8-31f6-4769-aabf-7d8c39a109fe tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b1b0448e7f54e3aaae49e411699269e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66ec8bde739145dda504995dbea0914a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:01:48.750176 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [None req-141465d8-31f6-4769-aabf-7d8c39a109fe tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] 10.222.0.50 "GET /compute/v2.1/servers/b2daebb8-dfea-4ab9-8253-008a21f906e1" status: 200 len: 1363 microversion: 2.1 time: 0.217807 Sep 24 05:01:48.751291 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 101/200] 10.222.0.50 () {58 vars in 1236 bytes} [Sat Sep 24 05:01:48 2022] GET /compute/v2.1/servers/b2daebb8-dfea-4ab9-8253-008a21f906e1 => generated 1363 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 05:01:48.757510 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [req-d302b2f1-0d5b-43c8-9201-a05f2eebdc37 req-8b1b5f8d-c0dc-4758-a94c-b2d2ffc43f81 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "08fb826b-e891-46c4-990d-ca03cf3f4222", "name": "network-vif-plugged", "status": "completed", "tag": "4de1eabe-932e-4cda-804d-49eeff37c34c"}]} {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 05:01:48.775681 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [req-d302b2f1-0d5b-43c8-9201-a05f2eebdc37 req-8b1b5f8d-c0dc-4758-a94c-b2d2ffc43f81 service nova] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:01:48.776154 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [req-d302b2f1-0d5b-43c8-9201-a05f2eebdc37 req-8b1b5f8d-c0dc-4758-a94c-b2d2ffc43f81 service nova] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:01:48.776630 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [req-d302b2f1-0d5b-43c8-9201-a05f2eebdc37 req-8b1b5f8d-c0dc-4758-a94c-b2d2ffc43f81 service nova] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:01:48.792449 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: INFO nova.api.openstack.compute.server_external_events [req-d302b2f1-0d5b-43c8-9201-a05f2eebdc37 req-8b1b5f8d-c0dc-4758-a94c-b2d2ffc43f81 service nova] Creating event network-vif-plugged:4de1eabe-932e-4cda-804d-49eeff37c34c for instance 08fb826b-e891-46c4-990d-ca03cf3f4222 on hv-cinder-85918 Sep 24 05:01:48.797979 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [req-d302b2f1-0d5b-43c8-9201-a05f2eebdc37 req-8b1b5f8d-c0dc-4758-a94c-b2d2ffc43f81 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044068 Sep 24 05:01:48.798607 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 102/201] 10.222.0.50 () {64 vars in 1317 bytes} [Sat Sep 24 05:01:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 05:01:48.803808 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-0a3b1d7b-febe-4eb3-8aaf-d9c578d2d43f tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Calling method '>' {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:01:48.804499 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.compute.api [None req-0a3b1d7b-febe-4eb3-8aaf-d9c578d2d43f tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] [instance: 08fb826b-e891-46c4-990d-ca03cf3f4222] Fetching instance by UUID {{(pid=120594) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:01:48.810806 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-0a3b1d7b-febe-4eb3-8aaf-d9c578d2d43f tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:01:48.811289 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-0a3b1d7b-febe-4eb3-8aaf-d9c578d2d43f tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:01:48.811786 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-0a3b1d7b-febe-4eb3-8aaf-d9c578d2d43f tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:01:48.812990 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-0a3b1d7b-febe-4eb3-8aaf-d9c578d2d43f tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:01:48.813443 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-0a3b1d7b-febe-4eb3-8aaf-d9c578d2d43f tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:01:48.813868 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-0a3b1d7b-febe-4eb3-8aaf-d9c578d2d43f tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:01:48.948117 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.policy [None req-0a3b1d7b-febe-4eb3-8aaf-d9c578d2d43f tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0948754217fc4ff2ba0241fa35feaf90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1aaf20f480a423ea5feca81585aeeed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:01:48.957146 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.policy [None req-0a3b1d7b-febe-4eb3-8aaf-d9c578d2d43f tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0948754217fc4ff2ba0241fa35feaf90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1aaf20f480a423ea5feca81585aeeed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:01:48.958630 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.policy [None req-0a3b1d7b-febe-4eb3-8aaf-d9c578d2d43f tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0948754217fc4ff2ba0241fa35feaf90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1aaf20f480a423ea5feca81585aeeed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:01:48.959729 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [None req-0a3b1d7b-febe-4eb3-8aaf-d9c578d2d43f tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] 10.222.0.50 "GET /compute/v2.1/servers/08fb826b-e891-46c4-990d-ca03cf3f4222" status: 200 len: 1404 microversion: 2.20 time: 0.159885 Sep 24 05:01:48.960300 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 103/202] 10.222.0.50 () {60 vars in 1277 bytes} [Sat Sep 24 05:01:48 2022] GET /compute/v2.1/servers/08fb826b-e891-46c4-990d-ca03cf3f4222 => generated 1404 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 05:01:48.964663 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-f114e0f9-4ed4-4383-8468-90916b880751 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Calling method '>' {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:01:48.965254 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.compute.api [None req-f114e0f9-4ed4-4383-8468-90916b880751 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] [instance: 50eed27b-6da2-4dda-94cc-02fc5cfec071] Fetching instance by UUID {{(pid=120594) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:01:48.972776 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-f114e0f9-4ed4-4383-8468-90916b880751 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:01:48.972776 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-f114e0f9-4ed4-4383-8468-90916b880751 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:01:48.972776 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-f114e0f9-4ed4-4383-8468-90916b880751 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:01:48.973423 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-f114e0f9-4ed4-4383-8468-90916b880751 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:01:48.973856 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-f114e0f9-4ed4-4383-8468-90916b880751 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:01:48.974376 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-f114e0f9-4ed4-4383-8468-90916b880751 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:01:49.108974 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.policy [None req-f114e0f9-4ed4-4383-8468-90916b880751 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cdd0da2c7bc4139bcd48ef36a2ee183', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a18a3756ba2b460d977f738a115ebfe0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:01:49.117076 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [None req-f114e0f9-4ed4-4383-8468-90916b880751 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] 10.222.0.50 "GET /compute/v2.1/servers/50eed27b-6da2-4dda-94cc-02fc5cfec071" status: 200 len: 1322 microversion: 2.1 time: 0.155782 Sep 24 05:01:49.117665 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 104/203] 10.222.0.50 () {58 vars in 1236 bytes} [Sat Sep 24 05:01:48 2022] GET /compute/v2.1/servers/50eed27b-6da2-4dda-94cc-02fc5cfec071 => generated 1322 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 05:01:49.551359 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-720ed30a-e442-4c1b-9bea-975e6f6c6c5d tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Calling method '>' {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:01:49.552065 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.compute.api [None req-720ed30a-e442-4c1b-9bea-975e6f6c6c5d tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] [instance: 201433d5-db4e-4e57-a800-42fe5cfc95ca] Fetching instance by UUID {{(pid=120594) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:01:49.558371 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-720ed30a-e442-4c1b-9bea-975e6f6c6c5d tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:01:49.558766 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-720ed30a-e442-4c1b-9bea-975e6f6c6c5d tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:01:49.559189 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-720ed30a-e442-4c1b-9bea-975e6f6c6c5d tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:01:49.559895 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-720ed30a-e442-4c1b-9bea-975e6f6c6c5d tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:01:49.560656 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-720ed30a-e442-4c1b-9bea-975e6f6c6c5d tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:01:49.561080 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-720ed30a-e442-4c1b-9bea-975e6f6c6c5d tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:01:49.703354 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.policy [None req-720ed30a-e442-4c1b-9bea-975e6f6c6c5d tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74a8cc19ab204424ab23c62915ac2bab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87d5229e39fe4817b5187068d8acecc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:01:49.710837 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [None req-720ed30a-e442-4c1b-9bea-975e6f6c6c5d tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] 10.222.0.50 "GET /compute/v2.1/servers/201433d5-db4e-4e57-a800-42fe5cfc95ca" status: 200 len: 1367 microversion: 2.1 time: 0.163574 Sep 24 05:01:49.711405 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 105/204] 10.222.0.50 () {58 vars in 1236 bytes} [Sat Sep 24 05:01:49 2022] GET /compute/v2.1/servers/201433d5-db4e-4e57-a800-42fe5cfc95ca => generated 1367 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 24 05:01:49.778859 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-5557286e-3857-4ce2-ae82-1eb5f4a2e493 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Calling method '>' {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:01:49.779887 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.compute.api [None req-5557286e-3857-4ce2-ae82-1eb5f4a2e493 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] [instance: b2daebb8-dfea-4ab9-8253-008a21f906e1] Fetching instance by UUID {{(pid=120594) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:01:49.788334 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-5557286e-3857-4ce2-ae82-1eb5f4a2e493 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:01:49.788944 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-5557286e-3857-4ce2-ae82-1eb5f4a2e493 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:01:49.789496 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-5557286e-3857-4ce2-ae82-1eb5f4a2e493 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:01:49.790286 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-5557286e-3857-4ce2-ae82-1eb5f4a2e493 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:01:49.790771 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-5557286e-3857-4ce2-ae82-1eb5f4a2e493 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:01:49.791193 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-5557286e-3857-4ce2-ae82-1eb5f4a2e493 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:01:49.932878 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.policy [None req-5557286e-3857-4ce2-ae82-1eb5f4a2e493 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b1b0448e7f54e3aaae49e411699269e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66ec8bde739145dda504995dbea0914a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:01:49.943004 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [None req-5557286e-3857-4ce2-ae82-1eb5f4a2e493 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] 10.222.0.50 "GET /compute/v2.1/servers/b2daebb8-dfea-4ab9-8253-008a21f906e1" status: 200 len: 1363 microversion: 2.1 time: 0.168800 Sep 24 05:01:49.943537 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 106/205] 10.222.0.50 () {58 vars in 1236 bytes} [Sat Sep 24 05:01:49 2022] GET /compute/v2.1/servers/b2daebb8-dfea-4ab9-8253-008a21f906e1 => generated 1363 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 24 05:01:49.984997 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-d5c7d246-b0c5-4539-ac0f-a39ea8b5ac85 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Calling method '>' {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:01:49.986550 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.compute.api [None req-d5c7d246-b0c5-4539-ac0f-a39ea8b5ac85 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] [instance: 08fb826b-e891-46c4-990d-ca03cf3f4222] Fetching instance by UUID {{(pid=120594) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:01:49.992920 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-d5c7d246-b0c5-4539-ac0f-a39ea8b5ac85 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:01:49.993401 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-d5c7d246-b0c5-4539-ac0f-a39ea8b5ac85 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:01:49.993987 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-d5c7d246-b0c5-4539-ac0f-a39ea8b5ac85 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:01:49.994705 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-d5c7d246-b0c5-4539-ac0f-a39ea8b5ac85 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:01:49.995152 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-d5c7d246-b0c5-4539-ac0f-a39ea8b5ac85 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:01:49.995745 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-d5c7d246-b0c5-4539-ac0f-a39ea8b5ac85 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:01:50.134391 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.policy [None req-d5c7d246-b0c5-4539-ac0f-a39ea8b5ac85 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0948754217fc4ff2ba0241fa35feaf90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1aaf20f480a423ea5feca81585aeeed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:01:50.144079 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.policy [None req-d5c7d246-b0c5-4539-ac0f-a39ea8b5ac85 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0948754217fc4ff2ba0241fa35feaf90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1aaf20f480a423ea5feca81585aeeed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:01:50.145804 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.policy [None req-d5c7d246-b0c5-4539-ac0f-a39ea8b5ac85 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0948754217fc4ff2ba0241fa35feaf90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1aaf20f480a423ea5feca81585aeeed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:01:50.146941 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [None req-d5c7d246-b0c5-4539-ac0f-a39ea8b5ac85 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] 10.222.0.50 "GET /compute/v2.1/servers/08fb826b-e891-46c4-990d-ca03cf3f4222" status: 200 len: 1404 microversion: 2.20 time: 0.166456 Sep 24 05:01:50.147551 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 107/206] 10.222.0.50 () {60 vars in 1277 bytes} [Sat Sep 24 05:01:49 2022] GET /compute/v2.1/servers/08fb826b-e891-46c4-990d-ca03cf3f4222 => generated 1404 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 24 05:01:50.162472 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-2528626c-cde1-4723-afe9-eed439ffbf3b tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Calling method '>' {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:01:50.164228 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.compute.api [None req-2528626c-cde1-4723-afe9-eed439ffbf3b tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] [instance: 50eed27b-6da2-4dda-94cc-02fc5cfec071] Fetching instance by UUID {{(pid=120594) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:01:50.170624 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-2528626c-cde1-4723-afe9-eed439ffbf3b tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:01:50.171128 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-2528626c-cde1-4723-afe9-eed439ffbf3b tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:01:50.171563 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-2528626c-cde1-4723-afe9-eed439ffbf3b tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:01:50.172254 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-2528626c-cde1-4723-afe9-eed439ffbf3b tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:01:50.172702 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-2528626c-cde1-4723-afe9-eed439ffbf3b tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:01:50.173152 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-2528626c-cde1-4723-afe9-eed439ffbf3b tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:01:50.314993 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.policy [None req-2528626c-cde1-4723-afe9-eed439ffbf3b tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cdd0da2c7bc4139bcd48ef36a2ee183', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a18a3756ba2b460d977f738a115ebfe0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:01:50.323113 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [None req-2528626c-cde1-4723-afe9-eed439ffbf3b tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] 10.222.0.50 "GET /compute/v2.1/servers/50eed27b-6da2-4dda-94cc-02fc5cfec071" status: 200 len: 1322 microversion: 2.1 time: 0.173502 Sep 24 05:01:50.323778 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 108/207] 10.222.0.50 () {58 vars in 1236 bytes} [Sat Sep 24 05:01:50 2022] GET /compute/v2.1/servers/50eed27b-6da2-4dda-94cc-02fc5cfec071 => generated 1322 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 05:01:50.734323 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-c2e6ff1d-0279-4f07-a228-508cc8d59f9b tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Calling method '>' {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:01:50.735072 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.compute.api [None req-c2e6ff1d-0279-4f07-a228-508cc8d59f9b tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] [instance: 201433d5-db4e-4e57-a800-42fe5cfc95ca] Fetching instance by UUID {{(pid=120594) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:01:50.741564 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-c2e6ff1d-0279-4f07-a228-508cc8d59f9b tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:01:50.742061 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-c2e6ff1d-0279-4f07-a228-508cc8d59f9b tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:01:50.742492 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-c2e6ff1d-0279-4f07-a228-508cc8d59f9b tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:01:50.743348 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-c2e6ff1d-0279-4f07-a228-508cc8d59f9b tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:01:50.743783 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-c2e6ff1d-0279-4f07-a228-508cc8d59f9b tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:01:50.744202 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-c2e6ff1d-0279-4f07-a228-508cc8d59f9b tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:01:50.876007 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.policy [None req-c2e6ff1d-0279-4f07-a228-508cc8d59f9b tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74a8cc19ab204424ab23c62915ac2bab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87d5229e39fe4817b5187068d8acecc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:01:50.883722 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [None req-c2e6ff1d-0279-4f07-a228-508cc8d59f9b tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] 10.222.0.50 "GET /compute/v2.1/servers/201433d5-db4e-4e57-a800-42fe5cfc95ca" status: 200 len: 1367 microversion: 2.1 time: 0.153917 Sep 24 05:01:50.884291 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 109/208] 10.222.0.50 () {58 vars in 1236 bytes} [Sat Sep 24 05:01:50 2022] GET /compute/v2.1/servers/201433d5-db4e-4e57-a800-42fe5cfc95ca => generated 1367 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 24 05:01:50.966152 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-894582fa-3ea6-4665-aa4a-299b292b92da tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Calling method '>' {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:01:50.966757 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.compute.api [None req-894582fa-3ea6-4665-aa4a-299b292b92da tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] [instance: b2daebb8-dfea-4ab9-8253-008a21f906e1] Fetching instance by UUID {{(pid=120594) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:01:50.972759 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-894582fa-3ea6-4665-aa4a-299b292b92da tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:01:50.973232 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-894582fa-3ea6-4665-aa4a-299b292b92da tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:01:50.973662 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-894582fa-3ea6-4665-aa4a-299b292b92da tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:01:50.974390 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-894582fa-3ea6-4665-aa4a-299b292b92da tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:01:50.974832 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-894582fa-3ea6-4665-aa4a-299b292b92da tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:01:50.975248 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-894582fa-3ea6-4665-aa4a-299b292b92da tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:01:51.110967 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.policy [None req-894582fa-3ea6-4665-aa4a-299b292b92da tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b1b0448e7f54e3aaae49e411699269e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66ec8bde739145dda504995dbea0914a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:01:51.114488 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG dbcounter [-] [120594] Writing DB stats nova_cell1:SELECT=100 {{(pid=120594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 05:01:51.119715 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [None req-894582fa-3ea6-4665-aa4a-299b292b92da tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] 10.222.0.50 "GET /compute/v2.1/servers/b2daebb8-dfea-4ab9-8253-008a21f906e1" status: 200 len: 1363 microversion: 2.1 time: 0.157406 Sep 24 05:01:51.120670 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 110/209] 10.222.0.50 () {58 vars in 1236 bytes} [Sat Sep 24 05:01:50 2022] GET /compute/v2.1/servers/b2daebb8-dfea-4ab9-8253-008a21f906e1 => generated 1363 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 24 05:01:51.172825 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-1303349e-f649-48f7-9b2f-152eb84e189d tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Calling method '>' {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:01:51.173434 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.compute.api [None req-1303349e-f649-48f7-9b2f-152eb84e189d tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] [instance: 08fb826b-e891-46c4-990d-ca03cf3f4222] Fetching instance by UUID {{(pid=120594) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:01:51.180119 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-1303349e-f649-48f7-9b2f-152eb84e189d tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:01:51.180593 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-1303349e-f649-48f7-9b2f-152eb84e189d tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:01:51.181019 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-1303349e-f649-48f7-9b2f-152eb84e189d tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:01:51.181988 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-1303349e-f649-48f7-9b2f-152eb84e189d tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:01:51.182452 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-1303349e-f649-48f7-9b2f-152eb84e189d tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:01:51.182863 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-1303349e-f649-48f7-9b2f-152eb84e189d tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:01:51.315346 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.policy [None req-1303349e-f649-48f7-9b2f-152eb84e189d tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0948754217fc4ff2ba0241fa35feaf90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1aaf20f480a423ea5feca81585aeeed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:01:51.323573 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.policy [None req-1303349e-f649-48f7-9b2f-152eb84e189d tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0948754217fc4ff2ba0241fa35feaf90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1aaf20f480a423ea5feca81585aeeed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:01:51.325011 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.policy [None req-1303349e-f649-48f7-9b2f-152eb84e189d tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0948754217fc4ff2ba0241fa35feaf90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1aaf20f480a423ea5feca81585aeeed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:01:51.326151 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [None req-1303349e-f649-48f7-9b2f-152eb84e189d tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] 10.222.0.50 "GET /compute/v2.1/servers/08fb826b-e891-46c4-990d-ca03cf3f4222" status: 200 len: 1404 microversion: 2.20 time: 0.157834 Sep 24 05:01:51.326714 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 111/210] 10.222.0.50 () {60 vars in 1277 bytes} [Sat Sep 24 05:01:51 2022] GET /compute/v2.1/servers/08fb826b-e891-46c4-990d-ca03cf3f4222 => generated 1404 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 24 05:01:51.348986 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-c8c87ea0-acc5-4df4-9c24-6a21ca18239e tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Calling method '>' {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:01:51.349650 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.compute.api [None req-c8c87ea0-acc5-4df4-9c24-6a21ca18239e tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] [instance: 50eed27b-6da2-4dda-94cc-02fc5cfec071] Fetching instance by UUID {{(pid=120594) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:01:51.355501 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-c8c87ea0-acc5-4df4-9c24-6a21ca18239e tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:01:51.355976 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-c8c87ea0-acc5-4df4-9c24-6a21ca18239e tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:01:51.356413 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-c8c87ea0-acc5-4df4-9c24-6a21ca18239e tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:01:51.357101 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-c8c87ea0-acc5-4df4-9c24-6a21ca18239e tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:01:51.357547 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-c8c87ea0-acc5-4df4-9c24-6a21ca18239e tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:01:51.357969 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-c8c87ea0-acc5-4df4-9c24-6a21ca18239e tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:01:51.496571 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.policy [None req-c8c87ea0-acc5-4df4-9c24-6a21ca18239e tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cdd0da2c7bc4139bcd48ef36a2ee183', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a18a3756ba2b460d977f738a115ebfe0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:01:51.504563 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [None req-c8c87ea0-acc5-4df4-9c24-6a21ca18239e tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] 10.222.0.50 "GET /compute/v2.1/servers/50eed27b-6da2-4dda-94cc-02fc5cfec071" status: 200 len: 1322 microversion: 2.1 time: 0.162458 Sep 24 05:01:51.505116 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 112/211] 10.222.0.50 () {58 vars in 1236 bytes} [Sat Sep 24 05:01:51 2022] GET /compute/v2.1/servers/50eed27b-6da2-4dda-94cc-02fc5cfec071 => generated 1322 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 24 05:01:51.906737 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-e0f6fe87-afe8-46a6-94b3-d057adb68935 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Calling method '>' {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:01:51.907675 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.compute.api [None req-e0f6fe87-afe8-46a6-94b3-d057adb68935 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] [instance: 201433d5-db4e-4e57-a800-42fe5cfc95ca] Fetching instance by UUID {{(pid=120594) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:01:51.913777 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-e0f6fe87-afe8-46a6-94b3-d057adb68935 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:01:51.914292 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-e0f6fe87-afe8-46a6-94b3-d057adb68935 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:01:51.914718 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-e0f6fe87-afe8-46a6-94b3-d057adb68935 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:01:51.915391 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-e0f6fe87-afe8-46a6-94b3-d057adb68935 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:01:51.915827 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-e0f6fe87-afe8-46a6-94b3-d057adb68935 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:01:51.916292 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-e0f6fe87-afe8-46a6-94b3-d057adb68935 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:01:52.066180 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.policy [None req-e0f6fe87-afe8-46a6-94b3-d057adb68935 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74a8cc19ab204424ab23c62915ac2bab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87d5229e39fe4817b5187068d8acecc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:01:52.074425 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [None req-e0f6fe87-afe8-46a6-94b3-d057adb68935 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] 10.222.0.50 "GET /compute/v2.1/servers/201433d5-db4e-4e57-a800-42fe5cfc95ca" status: 200 len: 1367 microversion: 2.1 time: 0.171742 Sep 24 05:01:52.075176 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 113/212] 10.222.0.50 () {58 vars in 1236 bytes} [Sat Sep 24 05:01:51 2022] GET /compute/v2.1/servers/201433d5-db4e-4e57-a800-42fe5cfc95ca => generated 1367 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 24 05:01:52.143072 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-9e8ffa51-ea86-48e8-b08c-81263167367e tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Calling method '>' {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:01:52.143667 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.compute.api [None req-9e8ffa51-ea86-48e8-b08c-81263167367e tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] [instance: b2daebb8-dfea-4ab9-8253-008a21f906e1] Fetching instance by UUID {{(pid=120594) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:01:52.149442 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-9e8ffa51-ea86-48e8-b08c-81263167367e tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:01:52.149913 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-9e8ffa51-ea86-48e8-b08c-81263167367e tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:01:52.150374 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-9e8ffa51-ea86-48e8-b08c-81263167367e tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:01:52.151049 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-9e8ffa51-ea86-48e8-b08c-81263167367e tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:01:52.151508 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-9e8ffa51-ea86-48e8-b08c-81263167367e tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:01:52.151904 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-9e8ffa51-ea86-48e8-b08c-81263167367e tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:01:52.275016 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.policy [None req-9e8ffa51-ea86-48e8-b08c-81263167367e tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b1b0448e7f54e3aaae49e411699269e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66ec8bde739145dda504995dbea0914a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:01:52.283026 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [None req-9e8ffa51-ea86-48e8-b08c-81263167367e tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] 10.222.0.50 "GET /compute/v2.1/servers/b2daebb8-dfea-4ab9-8253-008a21f906e1" status: 200 len: 1363 microversion: 2.1 time: 0.144158 Sep 24 05:01:52.283586 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 114/213] 10.222.0.50 () {58 vars in 1236 bytes} [Sat Sep 24 05:01:52 2022] GET /compute/v2.1/servers/b2daebb8-dfea-4ab9-8253-008a21f906e1 => generated 1363 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 24 05:01:52.351123 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-cb0b4569-bf48-4e96-9eb0-f8738c900512 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Calling method '>' {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:01:52.351730 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.compute.api [None req-cb0b4569-bf48-4e96-9eb0-f8738c900512 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] [instance: 08fb826b-e891-46c4-990d-ca03cf3f4222] Fetching instance by UUID {{(pid=120594) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:01:52.357610 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-cb0b4569-bf48-4e96-9eb0-f8738c900512 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:01:52.358125 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-cb0b4569-bf48-4e96-9eb0-f8738c900512 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:01:52.358613 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-cb0b4569-bf48-4e96-9eb0-f8738c900512 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:01:52.359845 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-cb0b4569-bf48-4e96-9eb0-f8738c900512 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:01:52.360346 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-cb0b4569-bf48-4e96-9eb0-f8738c900512 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:01:52.360769 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-cb0b4569-bf48-4e96-9eb0-f8738c900512 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:01:52.499610 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.policy [None req-cb0b4569-bf48-4e96-9eb0-f8738c900512 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0948754217fc4ff2ba0241fa35feaf90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1aaf20f480a423ea5feca81585aeeed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:01:52.507908 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.policy [None req-cb0b4569-bf48-4e96-9eb0-f8738c900512 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0948754217fc4ff2ba0241fa35feaf90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1aaf20f480a423ea5feca81585aeeed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:01:52.509496 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.policy [None req-cb0b4569-bf48-4e96-9eb0-f8738c900512 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0948754217fc4ff2ba0241fa35feaf90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1aaf20f480a423ea5feca81585aeeed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:01:52.510640 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [None req-cb0b4569-bf48-4e96-9eb0-f8738c900512 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] 10.222.0.50 "GET /compute/v2.1/servers/08fb826b-e891-46c4-990d-ca03cf3f4222" status: 200 len: 1404 microversion: 2.20 time: 0.163348 Sep 24 05:01:52.511203 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 115/214] 10.222.0.50 () {60 vars in 1277 bytes} [Sat Sep 24 05:01:52 2022] GET /compute/v2.1/servers/08fb826b-e891-46c4-990d-ca03cf3f4222 => generated 1404 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 24 05:01:52.529129 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-043a2bd8-e5f4-43e8-ae1c-203ecb731c77 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Calling method '>' {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:01:52.530701 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.compute.api [None req-043a2bd8-e5f4-43e8-ae1c-203ecb731c77 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] [instance: 50eed27b-6da2-4dda-94cc-02fc5cfec071] Fetching instance by UUID {{(pid=120594) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:01:52.538440 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-043a2bd8-e5f4-43e8-ae1c-203ecb731c77 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:01:52.539141 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-043a2bd8-e5f4-43e8-ae1c-203ecb731c77 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:01:52.539684 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-043a2bd8-e5f4-43e8-ae1c-203ecb731c77 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:01:52.540513 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-043a2bd8-e5f4-43e8-ae1c-203ecb731c77 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:01:52.541062 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-043a2bd8-e5f4-43e8-ae1c-203ecb731c77 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:01:52.541649 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-043a2bd8-e5f4-43e8-ae1c-203ecb731c77 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:01:52.671692 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.policy [None req-043a2bd8-e5f4-43e8-ae1c-203ecb731c77 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cdd0da2c7bc4139bcd48ef36a2ee183', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a18a3756ba2b460d977f738a115ebfe0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:01:52.679467 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [None req-043a2bd8-e5f4-43e8-ae1c-203ecb731c77 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] 10.222.0.50 "GET /compute/v2.1/servers/50eed27b-6da2-4dda-94cc-02fc5cfec071" status: 200 len: 1322 microversion: 2.1 time: 0.155369 Sep 24 05:01:52.680116 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 116/215] 10.222.0.50 () {58 vars in 1236 bytes} [Sat Sep 24 05:01:52 2022] GET /compute/v2.1/servers/50eed27b-6da2-4dda-94cc-02fc5cfec071 => generated 1322 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 24 05:01:53.096645 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-83e0bec9-27b1-4fec-b918-ee028fe91b54 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Calling method '>' {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:01:53.097258 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.compute.api [None req-83e0bec9-27b1-4fec-b918-ee028fe91b54 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] [instance: 201433d5-db4e-4e57-a800-42fe5cfc95ca] Fetching instance by UUID {{(pid=120594) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:01:53.103106 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-83e0bec9-27b1-4fec-b918-ee028fe91b54 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:01:53.103580 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-83e0bec9-27b1-4fec-b918-ee028fe91b54 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:01:53.104005 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-83e0bec9-27b1-4fec-b918-ee028fe91b54 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:01:53.104676 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-83e0bec9-27b1-4fec-b918-ee028fe91b54 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:01:53.105118 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-83e0bec9-27b1-4fec-b918-ee028fe91b54 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:01:53.105531 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-83e0bec9-27b1-4fec-b918-ee028fe91b54 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:01:53.237891 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.policy [None req-83e0bec9-27b1-4fec-b918-ee028fe91b54 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74a8cc19ab204424ab23c62915ac2bab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87d5229e39fe4817b5187068d8acecc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:01:53.245578 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [None req-83e0bec9-27b1-4fec-b918-ee028fe91b54 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] 10.222.0.50 "GET /compute/v2.1/servers/201433d5-db4e-4e57-a800-42fe5cfc95ca" status: 200 len: 1367 microversion: 2.1 time: 0.152787 Sep 24 05:01:53.246185 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 117/216] 10.222.0.50 () {58 vars in 1236 bytes} [Sat Sep 24 05:01:53 2022] GET /compute/v2.1/servers/201433d5-db4e-4e57-a800-42fe5cfc95ca => generated 1367 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 24 05:01:53.305944 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-e6256704-10e3-4355-81d6-ecc15fc6a31c tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Calling method '>' {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:01:53.306568 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.compute.api [None req-e6256704-10e3-4355-81d6-ecc15fc6a31c tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] [instance: b2daebb8-dfea-4ab9-8253-008a21f906e1] Fetching instance by UUID {{(pid=120594) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:01:53.313209 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-e6256704-10e3-4355-81d6-ecc15fc6a31c tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:01:53.313690 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-e6256704-10e3-4355-81d6-ecc15fc6a31c tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:01:53.314155 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-e6256704-10e3-4355-81d6-ecc15fc6a31c tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:01:53.314840 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-e6256704-10e3-4355-81d6-ecc15fc6a31c tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:01:53.315293 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-e6256704-10e3-4355-81d6-ecc15fc6a31c tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:01:53.315713 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-e6256704-10e3-4355-81d6-ecc15fc6a31c tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:01:53.440108 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.policy [None req-e6256704-10e3-4355-81d6-ecc15fc6a31c tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b1b0448e7f54e3aaae49e411699269e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66ec8bde739145dda504995dbea0914a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:01:53.447544 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [None req-e6256704-10e3-4355-81d6-ecc15fc6a31c tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] 10.222.0.50 "GET /compute/v2.1/servers/b2daebb8-dfea-4ab9-8253-008a21f906e1" status: 200 len: 1363 microversion: 2.1 time: 0.145414 Sep 24 05:01:53.448111 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 118/217] 10.222.0.50 () {58 vars in 1236 bytes} [Sat Sep 24 05:01:53 2022] GET /compute/v2.1/servers/b2daebb8-dfea-4ab9-8253-008a21f906e1 => generated 1363 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 24 05:01:53.535575 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-e4fc358f-d3ee-4543-871c-4e134b9dd817 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Calling method '>' {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:01:53.536165 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.compute.api [None req-e4fc358f-d3ee-4543-871c-4e134b9dd817 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] [instance: 08fb826b-e891-46c4-990d-ca03cf3f4222] Fetching instance by UUID {{(pid=120594) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:01:53.541793 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-e4fc358f-d3ee-4543-871c-4e134b9dd817 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:01:53.542307 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-e4fc358f-d3ee-4543-871c-4e134b9dd817 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:01:53.542733 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-e4fc358f-d3ee-4543-871c-4e134b9dd817 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:01:53.543410 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-e4fc358f-d3ee-4543-871c-4e134b9dd817 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:01:53.543851 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-e4fc358f-d3ee-4543-871c-4e134b9dd817 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:01:53.544267 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-e4fc358f-d3ee-4543-871c-4e134b9dd817 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:01:53.675781 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.policy [None req-e4fc358f-d3ee-4543-871c-4e134b9dd817 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0948754217fc4ff2ba0241fa35feaf90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1aaf20f480a423ea5feca81585aeeed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:01:53.683745 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.policy [None req-e4fc358f-d3ee-4543-871c-4e134b9dd817 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0948754217fc4ff2ba0241fa35feaf90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1aaf20f480a423ea5feca81585aeeed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:01:53.685197 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.policy [None req-e4fc358f-d3ee-4543-871c-4e134b9dd817 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0948754217fc4ff2ba0241fa35feaf90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1aaf20f480a423ea5feca81585aeeed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:01:53.686313 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [None req-e4fc358f-d3ee-4543-871c-4e134b9dd817 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] 10.222.0.50 "GET /compute/v2.1/servers/08fb826b-e891-46c4-990d-ca03cf3f4222" status: 200 len: 1404 microversion: 2.20 time: 0.154477 Sep 24 05:01:53.687384 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 119/218] 10.222.0.50 () {60 vars in 1277 bytes} [Sat Sep 24 05:01:53 2022] GET /compute/v2.1/servers/08fb826b-e891-46c4-990d-ca03cf3f4222 => generated 1404 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 24 05:01:53.702182 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-1c4ef82b-6e0e-4d7c-b90a-b4b987bc0e2b tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Calling method '>' {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:01:53.703314 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.compute.api [None req-1c4ef82b-6e0e-4d7c-b90a-b4b987bc0e2b tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] [instance: 50eed27b-6da2-4dda-94cc-02fc5cfec071] Fetching instance by UUID {{(pid=120594) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:01:53.708888 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-1c4ef82b-6e0e-4d7c-b90a-b4b987bc0e2b tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:01:53.709360 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-1c4ef82b-6e0e-4d7c-b90a-b4b987bc0e2b tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:01:53.709783 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-1c4ef82b-6e0e-4d7c-b90a-b4b987bc0e2b tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:01:53.710476 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-1c4ef82b-6e0e-4d7c-b90a-b4b987bc0e2b tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:01:53.710921 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-1c4ef82b-6e0e-4d7c-b90a-b4b987bc0e2b tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:01:53.711333 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-1c4ef82b-6e0e-4d7c-b90a-b4b987bc0e2b tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:01:53.835994 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.policy [None req-1c4ef82b-6e0e-4d7c-b90a-b4b987bc0e2b tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cdd0da2c7bc4139bcd48ef36a2ee183', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a18a3756ba2b460d977f738a115ebfe0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:01:53.843432 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [None req-1c4ef82b-6e0e-4d7c-b90a-b4b987bc0e2b tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] 10.222.0.50 "GET /compute/v2.1/servers/50eed27b-6da2-4dda-94cc-02fc5cfec071" status: 200 len: 1322 microversion: 2.1 time: 0.144841 Sep 24 05:01:53.844002 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 120/219] 10.222.0.50 () {58 vars in 1236 bytes} [Sat Sep 24 05:01:53 2022] GET /compute/v2.1/servers/50eed27b-6da2-4dda-94cc-02fc5cfec071 => generated 1322 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 24 05:01:54.268962 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-88a9348f-f8f2-4836-964e-df88f2448fef tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Calling method '>' {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:01:54.269559 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.compute.api [None req-88a9348f-f8f2-4836-964e-df88f2448fef tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] [instance: 201433d5-db4e-4e57-a800-42fe5cfc95ca] Fetching instance by UUID {{(pid=120594) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:01:54.275326 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-88a9348f-f8f2-4836-964e-df88f2448fef tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:01:54.275800 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-88a9348f-f8f2-4836-964e-df88f2448fef tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:01:54.276228 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-88a9348f-f8f2-4836-964e-df88f2448fef tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:01:54.276903 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-88a9348f-f8f2-4836-964e-df88f2448fef tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:01:54.277346 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-88a9348f-f8f2-4836-964e-df88f2448fef tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:01:54.277757 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-88a9348f-f8f2-4836-964e-df88f2448fef tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:01:54.401069 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.policy [None req-88a9348f-f8f2-4836-964e-df88f2448fef tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74a8cc19ab204424ab23c62915ac2bab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87d5229e39fe4817b5187068d8acecc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:01:54.409309 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [None req-88a9348f-f8f2-4836-964e-df88f2448fef tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] 10.222.0.50 "GET /compute/v2.1/servers/201433d5-db4e-4e57-a800-42fe5cfc95ca" status: 200 len: 1367 microversion: 2.1 time: 0.144525 Sep 24 05:01:54.410055 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 121/220] 10.222.0.50 () {58 vars in 1236 bytes} [Sat Sep 24 05:01:54 2022] GET /compute/v2.1/servers/201433d5-db4e-4e57-a800-42fe5cfc95ca => generated 1367 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 24 05:01:54.469627 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-770558a0-01f0-48d1-8bb7-40a68289ff8a tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Calling method '>' {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:01:54.470255 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.compute.api [None req-770558a0-01f0-48d1-8bb7-40a68289ff8a tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] [instance: b2daebb8-dfea-4ab9-8253-008a21f906e1] Fetching instance by UUID {{(pid=120594) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:01:54.475910 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-770558a0-01f0-48d1-8bb7-40a68289ff8a tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:01:54.476386 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-770558a0-01f0-48d1-8bb7-40a68289ff8a tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:01:54.476812 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-770558a0-01f0-48d1-8bb7-40a68289ff8a tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:01:54.477484 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-770558a0-01f0-48d1-8bb7-40a68289ff8a tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:01:54.477924 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-770558a0-01f0-48d1-8bb7-40a68289ff8a tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:01:54.478363 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-770558a0-01f0-48d1-8bb7-40a68289ff8a tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:01:54.604001 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.policy [None req-770558a0-01f0-48d1-8bb7-40a68289ff8a tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b1b0448e7f54e3aaae49e411699269e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66ec8bde739145dda504995dbea0914a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:01:54.611544 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [None req-770558a0-01f0-48d1-8bb7-40a68289ff8a tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] 10.222.0.50 "GET /compute/v2.1/servers/b2daebb8-dfea-4ab9-8253-008a21f906e1" status: 200 len: 1363 microversion: 2.1 time: 0.145518 Sep 24 05:01:54.612101 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 122/221] 10.222.0.50 () {58 vars in 1236 bytes} [Sat Sep 24 05:01:54 2022] GET /compute/v2.1/servers/b2daebb8-dfea-4ab9-8253-008a21f906e1 => generated 1363 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 05:01:54.711802 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-5b2b4639-1dda-4839-8bcb-a49cb483dda5 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Calling method '>' {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:01:54.712399 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.compute.api [None req-5b2b4639-1dda-4839-8bcb-a49cb483dda5 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] [instance: 08fb826b-e891-46c4-990d-ca03cf3f4222] Fetching instance by UUID {{(pid=120594) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:01:54.718479 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-5b2b4639-1dda-4839-8bcb-a49cb483dda5 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:01:54.718954 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-5b2b4639-1dda-4839-8bcb-a49cb483dda5 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:01:54.719387 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-5b2b4639-1dda-4839-8bcb-a49cb483dda5 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:01:54.720123 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-5b2b4639-1dda-4839-8bcb-a49cb483dda5 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:01:54.720515 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-5b2b4639-1dda-4839-8bcb-a49cb483dda5 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:01:54.720930 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-5b2b4639-1dda-4839-8bcb-a49cb483dda5 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:01:54.845480 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.policy [None req-5b2b4639-1dda-4839-8bcb-a49cb483dda5 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0948754217fc4ff2ba0241fa35feaf90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1aaf20f480a423ea5feca81585aeeed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:01:54.853408 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.policy [None req-5b2b4639-1dda-4839-8bcb-a49cb483dda5 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0948754217fc4ff2ba0241fa35feaf90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1aaf20f480a423ea5feca81585aeeed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:01:54.854865 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.policy [None req-5b2b4639-1dda-4839-8bcb-a49cb483dda5 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0948754217fc4ff2ba0241fa35feaf90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1aaf20f480a423ea5feca81585aeeed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:01:54.855946 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [None req-5b2b4639-1dda-4839-8bcb-a49cb483dda5 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] 10.222.0.50 "GET /compute/v2.1/servers/08fb826b-e891-46c4-990d-ca03cf3f4222" status: 200 len: 1404 microversion: 2.20 time: 0.148043 Sep 24 05:01:54.856497 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 123/222] 10.222.0.50 () {60 vars in 1277 bytes} [Sat Sep 24 05:01:54 2022] GET /compute/v2.1/servers/08fb826b-e891-46c4-990d-ca03cf3f4222 => generated 1404 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 24 05:01:54.865638 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-7095d671-79db-4642-9894-3ff86f1dfabc tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Calling method '>' {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:01:54.866268 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.compute.api [None req-7095d671-79db-4642-9894-3ff86f1dfabc tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] [instance: 50eed27b-6da2-4dda-94cc-02fc5cfec071] Fetching instance by UUID {{(pid=120594) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:01:54.871880 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-7095d671-79db-4642-9894-3ff86f1dfabc tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:01:54.872359 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-7095d671-79db-4642-9894-3ff86f1dfabc tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:01:54.872788 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-7095d671-79db-4642-9894-3ff86f1dfabc tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:01:54.873468 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-7095d671-79db-4642-9894-3ff86f1dfabc tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:01:54.873914 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-7095d671-79db-4642-9894-3ff86f1dfabc tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:01:54.875016 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-7095d671-79db-4642-9894-3ff86f1dfabc tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:01:55.004460 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.policy [None req-7095d671-79db-4642-9894-3ff86f1dfabc tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cdd0da2c7bc4139bcd48ef36a2ee183', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a18a3756ba2b460d977f738a115ebfe0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:01:55.011965 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [None req-7095d671-79db-4642-9894-3ff86f1dfabc tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] 10.222.0.50 "GET /compute/v2.1/servers/50eed27b-6da2-4dda-94cc-02fc5cfec071" status: 200 len: 1322 microversion: 2.1 time: 0.149889 Sep 24 05:01:55.012518 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 124/223] 10.222.0.50 () {58 vars in 1236 bytes} [Sat Sep 24 05:01:54 2022] GET /compute/v2.1/servers/50eed27b-6da2-4dda-94cc-02fc5cfec071 => generated 1322 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 24 05:01:55.431556 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-706169db-7859-4413-b266-deadcf376348 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Calling method '>' {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:01:55.432203 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.compute.api [None req-706169db-7859-4413-b266-deadcf376348 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] [instance: 201433d5-db4e-4e57-a800-42fe5cfc95ca] Fetching instance by UUID {{(pid=120594) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:01:55.437977 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-706169db-7859-4413-b266-deadcf376348 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:01:55.438475 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-706169db-7859-4413-b266-deadcf376348 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:01:55.438906 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-706169db-7859-4413-b266-deadcf376348 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:01:55.439582 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-706169db-7859-4413-b266-deadcf376348 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:01:55.440028 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-706169db-7859-4413-b266-deadcf376348 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:01:55.440446 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-706169db-7859-4413-b266-deadcf376348 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:01:55.569596 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.policy [None req-706169db-7859-4413-b266-deadcf376348 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74a8cc19ab204424ab23c62915ac2bab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87d5229e39fe4817b5187068d8acecc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:01:55.577763 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [None req-706169db-7859-4413-b266-deadcf376348 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] 10.222.0.50 "GET /compute/v2.1/servers/201433d5-db4e-4e57-a800-42fe5cfc95ca" status: 200 len: 1367 microversion: 2.1 time: 0.149679 Sep 24 05:01:55.578354 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 125/224] 10.222.0.50 () {58 vars in 1236 bytes} [Sat Sep 24 05:01:55 2022] GET /compute/v2.1/servers/201433d5-db4e-4e57-a800-42fe5cfc95ca => generated 1367 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 24 05:01:55.634752 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-5d91f685-93d5-4490-a0be-c528501a4db2 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Calling method '>' {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:01:55.635359 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.compute.api [None req-5d91f685-93d5-4490-a0be-c528501a4db2 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] [instance: b2daebb8-dfea-4ab9-8253-008a21f906e1] Fetching instance by UUID {{(pid=120594) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:01:55.642014 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-5d91f685-93d5-4490-a0be-c528501a4db2 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:01:55.642510 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-5d91f685-93d5-4490-a0be-c528501a4db2 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:01:55.642952 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-5d91f685-93d5-4490-a0be-c528501a4db2 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:01:55.643641 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-5d91f685-93d5-4490-a0be-c528501a4db2 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:01:55.644093 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-5d91f685-93d5-4490-a0be-c528501a4db2 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:01:55.644516 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-5d91f685-93d5-4490-a0be-c528501a4db2 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:01:55.777885 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.policy [None req-5d91f685-93d5-4490-a0be-c528501a4db2 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b1b0448e7f54e3aaae49e411699269e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66ec8bde739145dda504995dbea0914a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:01:55.785976 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [None req-5d91f685-93d5-4490-a0be-c528501a4db2 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] 10.222.0.50 "GET /compute/v2.1/servers/b2daebb8-dfea-4ab9-8253-008a21f906e1" status: 200 len: 1363 microversion: 2.1 time: 0.155119 Sep 24 05:01:55.786558 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 126/225] 10.222.0.50 () {58 vars in 1236 bytes} [Sat Sep 24 05:01:55 2022] GET /compute/v2.1/servers/b2daebb8-dfea-4ab9-8253-008a21f906e1 => generated 1363 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 24 05:01:55.880688 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-524c5fbf-1ff8-4fe4-9f58-913a839ae914 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Calling method '>' {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:01:55.881285 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.compute.api [None req-524c5fbf-1ff8-4fe4-9f58-913a839ae914 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] [instance: 08fb826b-e891-46c4-990d-ca03cf3f4222] Fetching instance by UUID {{(pid=120594) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:01:55.887776 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-524c5fbf-1ff8-4fe4-9f58-913a839ae914 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:01:55.888253 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-524c5fbf-1ff8-4fe4-9f58-913a839ae914 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:01:55.888814 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-524c5fbf-1ff8-4fe4-9f58-913a839ae914 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:01:55.889607 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-524c5fbf-1ff8-4fe4-9f58-913a839ae914 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:01:55.891087 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-524c5fbf-1ff8-4fe4-9f58-913a839ae914 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:01:55.891596 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-524c5fbf-1ff8-4fe4-9f58-913a839ae914 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:01:55.910359 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG dbcounter [-] [120594] Writing DB stats nova_cell1:SELECT=100 {{(pid=120594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 05:01:56.030074 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.policy [None req-524c5fbf-1ff8-4fe4-9f58-913a839ae914 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0948754217fc4ff2ba0241fa35feaf90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1aaf20f480a423ea5feca81585aeeed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:01:56.038244 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.policy [None req-524c5fbf-1ff8-4fe4-9f58-913a839ae914 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0948754217fc4ff2ba0241fa35feaf90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1aaf20f480a423ea5feca81585aeeed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:01:56.039788 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.policy [None req-524c5fbf-1ff8-4fe4-9f58-913a839ae914 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0948754217fc4ff2ba0241fa35feaf90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1aaf20f480a423ea5feca81585aeeed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:01:56.040946 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [None req-524c5fbf-1ff8-4fe4-9f58-913a839ae914 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] 10.222.0.50 "GET /compute/v2.1/servers/08fb826b-e891-46c4-990d-ca03cf3f4222" status: 200 len: 1404 microversion: 2.20 time: 0.164149 Sep 24 05:01:56.041533 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 127/226] 10.222.0.50 () {60 vars in 1277 bytes} [Sat Sep 24 05:01:55 2022] GET /compute/v2.1/servers/08fb826b-e891-46c4-990d-ca03cf3f4222 => generated 1404 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 24 05:01:56.045877 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-abf6020e-5b9a-4018-b7b9-460b1c75ac9b tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Calling method '>' {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:01:56.046541 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.compute.api [None req-abf6020e-5b9a-4018-b7b9-460b1c75ac9b tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] [instance: 50eed27b-6da2-4dda-94cc-02fc5cfec071] Fetching instance by UUID {{(pid=120594) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:01:56.052781 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-abf6020e-5b9a-4018-b7b9-460b1c75ac9b tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:01:56.053256 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-abf6020e-5b9a-4018-b7b9-460b1c75ac9b tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:01:56.053693 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-abf6020e-5b9a-4018-b7b9-460b1c75ac9b tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:01:56.054399 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-abf6020e-5b9a-4018-b7b9-460b1c75ac9b tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:01:56.054849 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-abf6020e-5b9a-4018-b7b9-460b1c75ac9b tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:01:56.055270 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-abf6020e-5b9a-4018-b7b9-460b1c75ac9b tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:01:56.296987 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.policy [None req-abf6020e-5b9a-4018-b7b9-460b1c75ac9b tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cdd0da2c7bc4139bcd48ef36a2ee183', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a18a3756ba2b460d977f738a115ebfe0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:01:56.308345 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [None req-abf6020e-5b9a-4018-b7b9-460b1c75ac9b tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] 10.222.0.50 "GET /compute/v2.1/servers/50eed27b-6da2-4dda-94cc-02fc5cfec071" status: 200 len: 1322 microversion: 2.1 time: 0.265227 Sep 24 05:01:56.308770 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 128/227] 10.222.0.50 () {58 vars in 1236 bytes} [Sat Sep 24 05:01:56 2022] GET /compute/v2.1/servers/50eed27b-6da2-4dda-94cc-02fc5cfec071 => generated 1322 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 05:01:56.473580 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-45904415-adda-4ebb-a503-ced99eaf83a9 tempest-DeleteServersTestJSON-1630660203 tempest-DeleteServersTestJSON-1630660203-project] 10.222.0.50 "POST /compute/v2.1/servers/ec88b440-40a0-459f-b94b-06c332e86094/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 8.463781 Sep 24 05:01:56.475773 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 100/228] 10.222.0.50 () {60 vars in 1323 bytes} [Sat Sep 24 05:01:48 2022] POST /compute/v2.1/servers/ec88b440-40a0-459f-b94b-06c332e86094/os-volume_attachments => generated 194 bytes in 8467 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 05:01:56.605688 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-d0eef81a-19d1-41bc-bdee-3086cb6d2a12 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Calling method '>' {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:01:56.608677 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.compute.api [None req-d0eef81a-19d1-41bc-bdee-3086cb6d2a12 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] [instance: 201433d5-db4e-4e57-a800-42fe5cfc95ca] Fetching instance by UUID {{(pid=120594) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:01:56.622712 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-d0eef81a-19d1-41bc-bdee-3086cb6d2a12 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:01:56.623478 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-d0eef81a-19d1-41bc-bdee-3086cb6d2a12 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:01:56.624068 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-d0eef81a-19d1-41bc-bdee-3086cb6d2a12 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:01:56.625447 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-d0eef81a-19d1-41bc-bdee-3086cb6d2a12 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:01:56.627406 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-d0eef81a-19d1-41bc-bdee-3086cb6d2a12 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:01:56.628119 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-d0eef81a-19d1-41bc-bdee-3086cb6d2a12 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:01:56.809187 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-56e3f4d7-6045-480e-9f00-befd8b40b946 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Calling method '>' {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:01:56.809880 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.compute.api [None req-56e3f4d7-6045-480e-9f00-befd8b40b946 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] [instance: b2daebb8-dfea-4ab9-8253-008a21f906e1] Fetching instance by UUID {{(pid=120593) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:01:56.824122 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-56e3f4d7-6045-480e-9f00-befd8b40b946 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:01:56.825651 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-56e3f4d7-6045-480e-9f00-befd8b40b946 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:01:56.826312 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-56e3f4d7-6045-480e-9f00-befd8b40b946 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:01:56.827049 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-56e3f4d7-6045-480e-9f00-befd8b40b946 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:01:56.827576 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-56e3f4d7-6045-480e-9f00-befd8b40b946 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:01:56.828003 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-56e3f4d7-6045-480e-9f00-befd8b40b946 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:01:56.913176 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.policy [None req-d0eef81a-19d1-41bc-bdee-3086cb6d2a12 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74a8cc19ab204424ab23c62915ac2bab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87d5229e39fe4817b5187068d8acecc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:01:56.921971 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [None req-d0eef81a-19d1-41bc-bdee-3086cb6d2a12 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] 10.222.0.50 "GET /compute/v2.1/servers/201433d5-db4e-4e57-a800-42fe5cfc95ca" status: 200 len: 1367 microversion: 2.1 time: 0.323857 Sep 24 05:01:56.922600 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 129/229] 10.222.0.50 () {58 vars in 1236 bytes} [Sat Sep 24 05:01:56 2022] GET /compute/v2.1/servers/201433d5-db4e-4e57-a800-42fe5cfc95ca => generated 1367 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 05:01:56.984836 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-56e3f4d7-6045-480e-9f00-befd8b40b946 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b1b0448e7f54e3aaae49e411699269e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66ec8bde739145dda504995dbea0914a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:01:56.992477 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-56e3f4d7-6045-480e-9f00-befd8b40b946 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] 10.222.0.50 "GET /compute/v2.1/servers/b2daebb8-dfea-4ab9-8253-008a21f906e1" status: 200 len: 1363 microversion: 2.1 time: 0.187551 Sep 24 05:01:56.993039 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 101/230] 10.222.0.50 () {58 vars in 1236 bytes} [Sat Sep 24 05:01:56 2022] GET /compute/v2.1/servers/b2daebb8-dfea-4ab9-8253-008a21f906e1 => generated 1363 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 05:01:57.067423 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-6562d907-f25a-4db8-a48e-cff7f72d5d40 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Calling method '>' {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:01:57.068029 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.compute.api [None req-6562d907-f25a-4db8-a48e-cff7f72d5d40 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] [instance: 08fb826b-e891-46c4-990d-ca03cf3f4222] Fetching instance by UUID {{(pid=120594) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:01:57.073920 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-6562d907-f25a-4db8-a48e-cff7f72d5d40 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:01:57.074432 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-6562d907-f25a-4db8-a48e-cff7f72d5d40 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:01:57.074864 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-6562d907-f25a-4db8-a48e-cff7f72d5d40 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:01:57.075542 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-6562d907-f25a-4db8-a48e-cff7f72d5d40 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:01:57.075991 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-6562d907-f25a-4db8-a48e-cff7f72d5d40 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:01:57.076404 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-6562d907-f25a-4db8-a48e-cff7f72d5d40 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:01:57.206425 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.policy [None req-6562d907-f25a-4db8-a48e-cff7f72d5d40 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0948754217fc4ff2ba0241fa35feaf90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1aaf20f480a423ea5feca81585aeeed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:01:57.214525 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.policy [None req-6562d907-f25a-4db8-a48e-cff7f72d5d40 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0948754217fc4ff2ba0241fa35feaf90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1aaf20f480a423ea5feca81585aeeed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:01:57.215958 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.policy [None req-6562d907-f25a-4db8-a48e-cff7f72d5d40 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0948754217fc4ff2ba0241fa35feaf90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1aaf20f480a423ea5feca81585aeeed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:01:57.217030 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [None req-6562d907-f25a-4db8-a48e-cff7f72d5d40 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] 10.222.0.50 "GET /compute/v2.1/servers/08fb826b-e891-46c4-990d-ca03cf3f4222" status: 200 len: 1404 microversion: 2.20 time: 0.153482 Sep 24 05:01:57.217590 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 130/231] 10.222.0.50 () {60 vars in 1277 bytes} [Sat Sep 24 05:01:57 2022] GET /compute/v2.1/servers/08fb826b-e891-46c4-990d-ca03cf3f4222 => generated 1404 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 05:01:57.332795 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-6235de54-3d84-4065-ab59-f8eaa7d52bd2 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Calling method '>' {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:01:57.333311 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.compute.api [None req-6235de54-3d84-4065-ab59-f8eaa7d52bd2 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] [instance: 50eed27b-6da2-4dda-94cc-02fc5cfec071] Fetching instance by UUID {{(pid=120593) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:01:57.339715 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-6235de54-3d84-4065-ab59-f8eaa7d52bd2 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:01:57.340190 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-6235de54-3d84-4065-ab59-f8eaa7d52bd2 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:01:57.340624 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-6235de54-3d84-4065-ab59-f8eaa7d52bd2 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:01:57.341300 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-6235de54-3d84-4065-ab59-f8eaa7d52bd2 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:01:57.341747 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-6235de54-3d84-4065-ab59-f8eaa7d52bd2 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:01:57.342196 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-6235de54-3d84-4065-ab59-f8eaa7d52bd2 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:01:57.469551 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-6235de54-3d84-4065-ab59-f8eaa7d52bd2 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cdd0da2c7bc4139bcd48ef36a2ee183', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a18a3756ba2b460d977f738a115ebfe0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:01:57.477465 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-6235de54-3d84-4065-ab59-f8eaa7d52bd2 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] 10.222.0.50 "GET /compute/v2.1/servers/50eed27b-6da2-4dda-94cc-02fc5cfec071" status: 200 len: 1322 microversion: 2.1 time: 0.148618 Sep 24 05:01:57.478369 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 102/232] 10.222.0.50 () {58 vars in 1236 bytes} [Sat Sep 24 05:01:57 2022] GET /compute/v2.1/servers/50eed27b-6da2-4dda-94cc-02fc5cfec071 => generated 1322 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 05:01:57.720768 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [req-48a2bef5-c9d9-49d0-9a23-37f396bb0573 req-f63691a6-1255-4d63-bd03-b4c9f259db6b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b2daebb8-dfea-4ab9-8253-008a21f906e1", "name": "network-vif-plugged", "status": "completed", "tag": "27e14393-9cd2-49fc-924d-ab63297b8de7"}]} {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 05:01:57.730688 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [req-48a2bef5-c9d9-49d0-9a23-37f396bb0573 req-f63691a6-1255-4d63-bd03-b4c9f259db6b service nova] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:01:57.731264 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [req-48a2bef5-c9d9-49d0-9a23-37f396bb0573 req-f63691a6-1255-4d63-bd03-b4c9f259db6b service nova] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:01:57.731575 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [req-48a2bef5-c9d9-49d0-9a23-37f396bb0573 req-f63691a6-1255-4d63-bd03-b4c9f259db6b service nova] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:01:57.744299 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: INFO nova.api.openstack.compute.server_external_events [req-48a2bef5-c9d9-49d0-9a23-37f396bb0573 req-f63691a6-1255-4d63-bd03-b4c9f259db6b service nova] Creating event network-vif-plugged:27e14393-9cd2-49fc-924d-ab63297b8de7 for instance b2daebb8-dfea-4ab9-8253-008a21f906e1 on hv-cinder-85918 Sep 24 05:01:57.750934 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [req-48a2bef5-c9d9-49d0-9a23-37f396bb0573 req-f63691a6-1255-4d63-bd03-b4c9f259db6b service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034573 Sep 24 05:01:57.751904 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 131/233] 10.222.0.50 () {64 vars in 1317 bytes} [Sat Sep 24 05:01:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 05:01:57.944573 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-226fe7ff-f833-4b91-9ac5-88b8264ee0c3 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Calling method '>' {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:01:57.945206 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.compute.api [None req-226fe7ff-f833-4b91-9ac5-88b8264ee0c3 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] [instance: 201433d5-db4e-4e57-a800-42fe5cfc95ca] Fetching instance by UUID {{(pid=120593) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:01:57.951180 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-226fe7ff-f833-4b91-9ac5-88b8264ee0c3 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:01:57.951656 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-226fe7ff-f833-4b91-9ac5-88b8264ee0c3 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:01:57.952085 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-226fe7ff-f833-4b91-9ac5-88b8264ee0c3 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:01:57.953290 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-226fe7ff-f833-4b91-9ac5-88b8264ee0c3 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:01:57.953741 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-226fe7ff-f833-4b91-9ac5-88b8264ee0c3 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:01:57.954194 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-226fe7ff-f833-4b91-9ac5-88b8264ee0c3 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:01:57.958267 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG dbcounter [-] [120593] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 05:01:58.015681 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-3da104b5-b44a-4c27-bc2a-3fffcea4ebe5 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Calling method '>' {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:01:58.016379 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.compute.api [None req-3da104b5-b44a-4c27-bc2a-3fffcea4ebe5 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] [instance: b2daebb8-dfea-4ab9-8253-008a21f906e1] Fetching instance by UUID {{(pid=120594) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:01:58.023837 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-3da104b5-b44a-4c27-bc2a-3fffcea4ebe5 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:01:58.024388 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-3da104b5-b44a-4c27-bc2a-3fffcea4ebe5 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:01:58.024825 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-3da104b5-b44a-4c27-bc2a-3fffcea4ebe5 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:01:58.025515 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-3da104b5-b44a-4c27-bc2a-3fffcea4ebe5 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:01:58.025960 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-3da104b5-b44a-4c27-bc2a-3fffcea4ebe5 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:01:58.026406 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-3da104b5-b44a-4c27-bc2a-3fffcea4ebe5 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:01:58.126150 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-226fe7ff-f833-4b91-9ac5-88b8264ee0c3 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74a8cc19ab204424ab23c62915ac2bab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87d5229e39fe4817b5187068d8acecc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:01:58.133795 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-226fe7ff-f833-4b91-9ac5-88b8264ee0c3 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] 10.222.0.50 "GET /compute/v2.1/servers/201433d5-db4e-4e57-a800-42fe5cfc95ca" status: 200 len: 1367 microversion: 2.1 time: 0.192990 Sep 24 05:01:58.134396 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 103/234] 10.222.0.50 () {58 vars in 1236 bytes} [Sat Sep 24 05:01:57 2022] GET /compute/v2.1/servers/201433d5-db4e-4e57-a800-42fe5cfc95ca => generated 1367 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 05:01:58.169612 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.policy [None req-3da104b5-b44a-4c27-bc2a-3fffcea4ebe5 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b1b0448e7f54e3aaae49e411699269e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66ec8bde739145dda504995dbea0914a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:01:58.177186 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [None req-3da104b5-b44a-4c27-bc2a-3fffcea4ebe5 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] 10.222.0.50 "GET /compute/v2.1/servers/b2daebb8-dfea-4ab9-8253-008a21f906e1" status: 200 len: 1363 microversion: 2.1 time: 0.166317 Sep 24 05:01:58.177741 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 132/235] 10.222.0.50 () {58 vars in 1236 bytes} [Sat Sep 24 05:01:58 2022] GET /compute/v2.1/servers/b2daebb8-dfea-4ab9-8253-008a21f906e1 => generated 1363 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 24 05:01:58.241800 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-76a58943-f77d-4da5-af32-d8337a2dd435 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Calling method '>' {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:01:58.242425 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.compute.api [None req-76a58943-f77d-4da5-af32-d8337a2dd435 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] [instance: 08fb826b-e891-46c4-990d-ca03cf3f4222] Fetching instance by UUID {{(pid=120593) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:01:58.248240 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-76a58943-f77d-4da5-af32-d8337a2dd435 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:01:58.248715 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-76a58943-f77d-4da5-af32-d8337a2dd435 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:01:58.249663 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-76a58943-f77d-4da5-af32-d8337a2dd435 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:01:58.250373 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-76a58943-f77d-4da5-af32-d8337a2dd435 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:01:58.250820 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-76a58943-f77d-4da5-af32-d8337a2dd435 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:01:58.251237 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-76a58943-f77d-4da5-af32-d8337a2dd435 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:01:58.374834 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-76a58943-f77d-4da5-af32-d8337a2dd435 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0948754217fc4ff2ba0241fa35feaf90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1aaf20f480a423ea5feca81585aeeed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:01:58.382799 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-76a58943-f77d-4da5-af32-d8337a2dd435 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0948754217fc4ff2ba0241fa35feaf90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1aaf20f480a423ea5feca81585aeeed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:01:58.384243 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-76a58943-f77d-4da5-af32-d8337a2dd435 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0948754217fc4ff2ba0241fa35feaf90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1aaf20f480a423ea5feca81585aeeed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:01:58.385328 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-76a58943-f77d-4da5-af32-d8337a2dd435 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] 10.222.0.50 "GET /compute/v2.1/servers/08fb826b-e891-46c4-990d-ca03cf3f4222" status: 200 len: 1404 microversion: 2.20 time: 0.147410 Sep 24 05:01:58.385885 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 104/236] 10.222.0.50 () {60 vars in 1277 bytes} [Sat Sep 24 05:01:58 2022] GET /compute/v2.1/servers/08fb826b-e891-46c4-990d-ca03cf3f4222 => generated 1404 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 05:01:58.500441 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-e23debba-4a9b-4cb8-a9c7-7b3440c02614 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Calling method '>' {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:01:58.501042 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.compute.api [None req-e23debba-4a9b-4cb8-a9c7-7b3440c02614 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] [instance: 50eed27b-6da2-4dda-94cc-02fc5cfec071] Fetching instance by UUID {{(pid=120594) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:01:58.506935 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-e23debba-4a9b-4cb8-a9c7-7b3440c02614 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:01:58.507414 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-e23debba-4a9b-4cb8-a9c7-7b3440c02614 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:01:58.507842 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-e23debba-4a9b-4cb8-a9c7-7b3440c02614 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:01:58.508522 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-e23debba-4a9b-4cb8-a9c7-7b3440c02614 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:01:58.508966 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-e23debba-4a9b-4cb8-a9c7-7b3440c02614 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:01:58.509382 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-e23debba-4a9b-4cb8-a9c7-7b3440c02614 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:01:58.636148 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.policy [None req-e23debba-4a9b-4cb8-a9c7-7b3440c02614 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cdd0da2c7bc4139bcd48ef36a2ee183', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a18a3756ba2b460d977f738a115ebfe0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:01:58.643928 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [None req-e23debba-4a9b-4cb8-a9c7-7b3440c02614 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] 10.222.0.50 "GET /compute/v2.1/servers/50eed27b-6da2-4dda-94cc-02fc5cfec071" status: 200 len: 1322 microversion: 2.1 time: 0.147349 Sep 24 05:01:58.644488 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 133/237] 10.222.0.50 () {58 vars in 1236 bytes} [Sat Sep 24 05:01:58 2022] GET /compute/v2.1/servers/50eed27b-6da2-4dda-94cc-02fc5cfec071 => generated 1322 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 05:01:59.157535 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-0303de7a-20e0-4b35-ba79-07b8ba6e213b tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Calling method '>' {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:01:59.158105 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.compute.api [None req-0303de7a-20e0-4b35-ba79-07b8ba6e213b tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] [instance: 201433d5-db4e-4e57-a800-42fe5cfc95ca] Fetching instance by UUID {{(pid=120593) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:01:59.164304 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-0303de7a-20e0-4b35-ba79-07b8ba6e213b tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:01:59.164805 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-0303de7a-20e0-4b35-ba79-07b8ba6e213b tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:01:59.165269 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-0303de7a-20e0-4b35-ba79-07b8ba6e213b tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:01:59.166038 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-0303de7a-20e0-4b35-ba79-07b8ba6e213b tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:01:59.166529 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-0303de7a-20e0-4b35-ba79-07b8ba6e213b tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:01:59.166992 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-0303de7a-20e0-4b35-ba79-07b8ba6e213b tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:01:59.200139 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-911107e9-0a41-4282-b73b-b81e329efa39 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Calling method '>' {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:01:59.200862 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.compute.api [None req-911107e9-0a41-4282-b73b-b81e329efa39 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] [instance: b2daebb8-dfea-4ab9-8253-008a21f906e1] Fetching instance by UUID {{(pid=120594) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:01:59.207566 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-911107e9-0a41-4282-b73b-b81e329efa39 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:01:59.208140 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-911107e9-0a41-4282-b73b-b81e329efa39 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:01:59.208638 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-911107e9-0a41-4282-b73b-b81e329efa39 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:01:59.209397 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-911107e9-0a41-4282-b73b-b81e329efa39 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:01:59.209907 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-911107e9-0a41-4282-b73b-b81e329efa39 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:01:59.210421 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-911107e9-0a41-4282-b73b-b81e329efa39 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:01:59.349833 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-0303de7a-20e0-4b35-ba79-07b8ba6e213b tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74a8cc19ab204424ab23c62915ac2bab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87d5229e39fe4817b5187068d8acecc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:01:59.357658 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-0303de7a-20e0-4b35-ba79-07b8ba6e213b tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] 10.222.0.50 "GET /compute/v2.1/servers/201433d5-db4e-4e57-a800-42fe5cfc95ca" status: 200 len: 1367 microversion: 2.1 time: 0.204817 Sep 24 05:01:59.358290 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 105/238] 10.222.0.50 () {58 vars in 1236 bytes} [Sat Sep 24 05:01:59 2022] GET /compute/v2.1/servers/201433d5-db4e-4e57-a800-42fe5cfc95ca => generated 1367 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 05:01:59.372874 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.policy [None req-911107e9-0a41-4282-b73b-b81e329efa39 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b1b0448e7f54e3aaae49e411699269e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66ec8bde739145dda504995dbea0914a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:01:59.380524 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [None req-911107e9-0a41-4282-b73b-b81e329efa39 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] 10.222.0.50 "GET /compute/v2.1/servers/b2daebb8-dfea-4ab9-8253-008a21f906e1" status: 200 len: 1363 microversion: 2.1 time: 0.184148 Sep 24 05:01:59.381076 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 134/239] 10.222.0.50 () {58 vars in 1236 bytes} [Sat Sep 24 05:01:59 2022] GET /compute/v2.1/servers/b2daebb8-dfea-4ab9-8253-008a21f906e1 => generated 1363 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 24 05:01:59.411619 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-b29349a6-19f7-4d0e-aba8-b0658de456fb tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Calling method '>' {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:01:59.412182 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.compute.api [None req-b29349a6-19f7-4d0e-aba8-b0658de456fb tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] [instance: 08fb826b-e891-46c4-990d-ca03cf3f4222] Fetching instance by UUID {{(pid=120593) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:01:59.418364 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-b29349a6-19f7-4d0e-aba8-b0658de456fb tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:01:59.418845 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-b29349a6-19f7-4d0e-aba8-b0658de456fb tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:01:59.419279 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-b29349a6-19f7-4d0e-aba8-b0658de456fb tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:01:59.419961 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-b29349a6-19f7-4d0e-aba8-b0658de456fb tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:01:59.420414 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-b29349a6-19f7-4d0e-aba8-b0658de456fb tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:01:59.420843 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-b29349a6-19f7-4d0e-aba8-b0658de456fb tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:01:59.545358 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-b29349a6-19f7-4d0e-aba8-b0658de456fb tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0948754217fc4ff2ba0241fa35feaf90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1aaf20f480a423ea5feca81585aeeed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:01:59.553356 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-b29349a6-19f7-4d0e-aba8-b0658de456fb tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0948754217fc4ff2ba0241fa35feaf90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1aaf20f480a423ea5feca81585aeeed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:01:59.554829 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-b29349a6-19f7-4d0e-aba8-b0658de456fb tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0948754217fc4ff2ba0241fa35feaf90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1aaf20f480a423ea5feca81585aeeed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:01:59.555918 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-b29349a6-19f7-4d0e-aba8-b0658de456fb tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] 10.222.0.50 "GET /compute/v2.1/servers/08fb826b-e891-46c4-990d-ca03cf3f4222" status: 200 len: 1404 microversion: 2.20 time: 0.148391 Sep 24 05:01:59.556476 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 106/240] 10.222.0.50 () {60 vars in 1277 bytes} [Sat Sep 24 05:01:59 2022] GET /compute/v2.1/servers/08fb826b-e891-46c4-990d-ca03cf3f4222 => generated 1404 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 05:01:59.666065 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-3648739f-b16e-49b9-9d59-b68ee51d1d97 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Calling method '>' {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:01:59.666617 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.compute.api [None req-3648739f-b16e-49b9-9d59-b68ee51d1d97 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] [instance: 50eed27b-6da2-4dda-94cc-02fc5cfec071] Fetching instance by UUID {{(pid=120594) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:01:59.672677 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-3648739f-b16e-49b9-9d59-b68ee51d1d97 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:01:59.673161 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-3648739f-b16e-49b9-9d59-b68ee51d1d97 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:01:59.673601 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-3648739f-b16e-49b9-9d59-b68ee51d1d97 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:01:59.674311 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-3648739f-b16e-49b9-9d59-b68ee51d1d97 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:01:59.674763 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-3648739f-b16e-49b9-9d59-b68ee51d1d97 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:01:59.675189 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-3648739f-b16e-49b9-9d59-b68ee51d1d97 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:01:59.806866 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.policy [None req-3648739f-b16e-49b9-9d59-b68ee51d1d97 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cdd0da2c7bc4139bcd48ef36a2ee183', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a18a3756ba2b460d977f738a115ebfe0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:01:59.814677 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [None req-3648739f-b16e-49b9-9d59-b68ee51d1d97 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] 10.222.0.50 "GET /compute/v2.1/servers/50eed27b-6da2-4dda-94cc-02fc5cfec071" status: 200 len: 1322 microversion: 2.1 time: 0.153009 Sep 24 05:01:59.815239 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 135/241] 10.222.0.50 () {58 vars in 1236 bytes} [Sat Sep 24 05:01:59 2022] GET /compute/v2.1/servers/50eed27b-6da2-4dda-94cc-02fc5cfec071 => generated 1322 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 05:02:00.380564 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-94622d68-fe7e-4f72-8fa7-2db0495e2633 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Calling method '>' {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:02:00.381163 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.compute.api [None req-94622d68-fe7e-4f72-8fa7-2db0495e2633 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] [instance: 201433d5-db4e-4e57-a800-42fe5cfc95ca] Fetching instance by UUID {{(pid=120593) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:02:00.387563 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-94622d68-fe7e-4f72-8fa7-2db0495e2633 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:02:00.388035 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-94622d68-fe7e-4f72-8fa7-2db0495e2633 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:02:00.388460 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-94622d68-fe7e-4f72-8fa7-2db0495e2633 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:02:00.389126 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-94622d68-fe7e-4f72-8fa7-2db0495e2633 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:02:00.389566 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-94622d68-fe7e-4f72-8fa7-2db0495e2633 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:02:00.389984 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-94622d68-fe7e-4f72-8fa7-2db0495e2633 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:02:00.406827 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-61ab4a80-6474-4f66-8fd0-f6af156df147 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Calling method '>' {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:02:00.407523 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.compute.api [None req-61ab4a80-6474-4f66-8fd0-f6af156df147 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] [instance: b2daebb8-dfea-4ab9-8253-008a21f906e1] Fetching instance by UUID {{(pid=120594) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:02:00.413578 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-61ab4a80-6474-4f66-8fd0-f6af156df147 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:02:00.414107 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-61ab4a80-6474-4f66-8fd0-f6af156df147 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:02:00.414576 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-61ab4a80-6474-4f66-8fd0-f6af156df147 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:02:00.415334 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-61ab4a80-6474-4f66-8fd0-f6af156df147 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:02:00.415788 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-61ab4a80-6474-4f66-8fd0-f6af156df147 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:02:00.416214 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-61ab4a80-6474-4f66-8fd0-f6af156df147 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:02:00.586687 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-94622d68-fe7e-4f72-8fa7-2db0495e2633 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74a8cc19ab204424ab23c62915ac2bab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87d5229e39fe4817b5187068d8acecc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:02:00.590340 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.policy [None req-61ab4a80-6474-4f66-8fd0-f6af156df147 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b1b0448e7f54e3aaae49e411699269e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66ec8bde739145dda504995dbea0914a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:02:00.594682 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-94622d68-fe7e-4f72-8fa7-2db0495e2633 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] 10.222.0.50 "GET /compute/v2.1/servers/201433d5-db4e-4e57-a800-42fe5cfc95ca" status: 200 len: 1367 microversion: 2.1 time: 0.217901 Sep 24 05:02:00.595241 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 107/242] 10.222.0.50 () {58 vars in 1236 bytes} [Sat Sep 24 05:02:00 2022] GET /compute/v2.1/servers/201433d5-db4e-4e57-a800-42fe5cfc95ca => generated 1367 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 05:02:00.599593 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-aa4366ac-41e0-4d63-89f1-85d35557ac65 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Calling method '>' {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:02:00.600178 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.compute.api [None req-aa4366ac-41e0-4d63-89f1-85d35557ac65 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] [instance: 08fb826b-e891-46c4-990d-ca03cf3f4222] Fetching instance by UUID {{(pid=120593) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:02:00.604991 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [None req-61ab4a80-6474-4f66-8fd0-f6af156df147 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] 10.222.0.50 "GET /compute/v2.1/servers/b2daebb8-dfea-4ab9-8253-008a21f906e1" status: 200 len: 1363 microversion: 2.1 time: 0.203990 Sep 24 05:02:00.605908 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-aa4366ac-41e0-4d63-89f1-85d35557ac65 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:02:00.606070 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 136/243] 10.222.0.50 () {58 vars in 1236 bytes} [Sat Sep 24 05:02:00 2022] GET /compute/v2.1/servers/b2daebb8-dfea-4ab9-8253-008a21f906e1 => generated 1363 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 05:02:00.606247 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-aa4366ac-41e0-4d63-89f1-85d35557ac65 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:02:00.606666 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-aa4366ac-41e0-4d63-89f1-85d35557ac65 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:02:00.607336 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-aa4366ac-41e0-4d63-89f1-85d35557ac65 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:02:00.607777 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-aa4366ac-41e0-4d63-89f1-85d35557ac65 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:02:00.608187 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-aa4366ac-41e0-4d63-89f1-85d35557ac65 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:02:00.734973 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-aa4366ac-41e0-4d63-89f1-85d35557ac65 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0948754217fc4ff2ba0241fa35feaf90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1aaf20f480a423ea5feca81585aeeed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:02:00.743263 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-aa4366ac-41e0-4d63-89f1-85d35557ac65 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0948754217fc4ff2ba0241fa35feaf90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1aaf20f480a423ea5feca81585aeeed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:02:00.744687 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-aa4366ac-41e0-4d63-89f1-85d35557ac65 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0948754217fc4ff2ba0241fa35feaf90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1aaf20f480a423ea5feca81585aeeed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:02:00.745763 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-aa4366ac-41e0-4d63-89f1-85d35557ac65 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] 10.222.0.50 "GET /compute/v2.1/servers/08fb826b-e891-46c4-990d-ca03cf3f4222" status: 200 len: 1404 microversion: 2.20 time: 0.149627 Sep 24 05:02:00.746348 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 108/244] 10.222.0.50 () {60 vars in 1277 bytes} [Sat Sep 24 05:02:00 2022] GET /compute/v2.1/servers/08fb826b-e891-46c4-990d-ca03cf3f4222 => generated 1404 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 05:02:00.836566 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-80ab2275-54bb-47eb-a67b-12b908c24e2d tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Calling method '>' {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:02:00.837100 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.compute.api [None req-80ab2275-54bb-47eb-a67b-12b908c24e2d tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] [instance: 50eed27b-6da2-4dda-94cc-02fc5cfec071] Fetching instance by UUID {{(pid=120594) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:02:00.843246 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-80ab2275-54bb-47eb-a67b-12b908c24e2d tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:02:00.843771 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-80ab2275-54bb-47eb-a67b-12b908c24e2d tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:02:00.844205 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-80ab2275-54bb-47eb-a67b-12b908c24e2d tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:02:00.844894 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-80ab2275-54bb-47eb-a67b-12b908c24e2d tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:02:00.845339 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-80ab2275-54bb-47eb-a67b-12b908c24e2d tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:02:00.845755 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-80ab2275-54bb-47eb-a67b-12b908c24e2d tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:02:00.968826 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.policy [None req-80ab2275-54bb-47eb-a67b-12b908c24e2d tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cdd0da2c7bc4139bcd48ef36a2ee183', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a18a3756ba2b460d977f738a115ebfe0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:02:00.976388 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [None req-80ab2275-54bb-47eb-a67b-12b908c24e2d tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] 10.222.0.50 "GET /compute/v2.1/servers/50eed27b-6da2-4dda-94cc-02fc5cfec071" status: 200 len: 1322 microversion: 2.1 time: 0.143681 Sep 24 05:02:00.976953 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 137/245] 10.222.0.50 () {58 vars in 1236 bytes} [Sat Sep 24 05:02:00 2022] GET /compute/v2.1/servers/50eed27b-6da2-4dda-94cc-02fc5cfec071 => generated 1322 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 05:02:01.616846 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-cc539aeb-2c06-4900-b17a-d14de6a0e9e0 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Calling method '>' {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:02:01.617446 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.compute.api [None req-cc539aeb-2c06-4900-b17a-d14de6a0e9e0 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] [instance: 201433d5-db4e-4e57-a800-42fe5cfc95ca] Fetching instance by UUID {{(pid=120593) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:02:01.623716 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-cc539aeb-2c06-4900-b17a-d14de6a0e9e0 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:02:01.624189 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-cc539aeb-2c06-4900-b17a-d14de6a0e9e0 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:02:01.624618 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-cc539aeb-2c06-4900-b17a-d14de6a0e9e0 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:02:01.625289 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-cc539aeb-2c06-4900-b17a-d14de6a0e9e0 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:02:01.625730 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-cc539aeb-2c06-4900-b17a-d14de6a0e9e0 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:02:01.626192 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-cc539aeb-2c06-4900-b17a-d14de6a0e9e0 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:02:01.628311 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-e7257fad-d8ea-459d-9a03-35df2003173d tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Calling method '>' {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:02:01.628912 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.compute.api [None req-e7257fad-d8ea-459d-9a03-35df2003173d tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] [instance: b2daebb8-dfea-4ab9-8253-008a21f906e1] Fetching instance by UUID {{(pid=120594) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:02:01.634692 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-e7257fad-d8ea-459d-9a03-35df2003173d tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:02:01.635168 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-e7257fad-d8ea-459d-9a03-35df2003173d tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:02:01.635592 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-e7257fad-d8ea-459d-9a03-35df2003173d tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:02:01.636266 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-e7257fad-d8ea-459d-9a03-35df2003173d tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:02:01.636707 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-e7257fad-d8ea-459d-9a03-35df2003173d tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:02:01.637122 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-e7257fad-d8ea-459d-9a03-35df2003173d tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:02:01.826214 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-cc539aeb-2c06-4900-b17a-d14de6a0e9e0 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74a8cc19ab204424ab23c62915ac2bab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87d5229e39fe4817b5187068d8acecc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:02:01.828985 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.policy [None req-e7257fad-d8ea-459d-9a03-35df2003173d tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b1b0448e7f54e3aaae49e411699269e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66ec8bde739145dda504995dbea0914a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:02:01.834901 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-cc539aeb-2c06-4900-b17a-d14de6a0e9e0 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] 10.222.0.50 "GET /compute/v2.1/servers/201433d5-db4e-4e57-a800-42fe5cfc95ca" status: 200 len: 1367 microversion: 2.1 time: 0.221852 Sep 24 05:02:01.836242 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 109/246] 10.222.0.50 () {58 vars in 1236 bytes} [Sat Sep 24 05:02:01 2022] GET /compute/v2.1/servers/201433d5-db4e-4e57-a800-42fe5cfc95ca => generated 1367 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 05:02:01.836910 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [None req-e7257fad-d8ea-459d-9a03-35df2003173d tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] 10.222.0.50 "GET /compute/v2.1/servers/b2daebb8-dfea-4ab9-8253-008a21f906e1" status: 200 len: 1363 microversion: 2.1 time: 0.212523 Sep 24 05:02:01.846033 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 138/247] 10.222.0.50 () {58 vars in 1236 bytes} [Sat Sep 24 05:02:01 2022] GET /compute/v2.1/servers/b2daebb8-dfea-4ab9-8253-008a21f906e1 => generated 1363 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 24 05:02:01.846178 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-bd8f5d0f-a8d5-4128-8f95-a5dd6a18f470 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Calling method '>' {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:02:01.846178 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.compute.api [None req-bd8f5d0f-a8d5-4128-8f95-a5dd6a18f470 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] [instance: 08fb826b-e891-46c4-990d-ca03cf3f4222] Fetching instance by UUID {{(pid=120593) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:02:01.856913 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-bd8f5d0f-a8d5-4128-8f95-a5dd6a18f470 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:02:01.857404 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-bd8f5d0f-a8d5-4128-8f95-a5dd6a18f470 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:02:01.857840 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-bd8f5d0f-a8d5-4128-8f95-a5dd6a18f470 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:02:01.859384 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-bd8f5d0f-a8d5-4128-8f95-a5dd6a18f470 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:02:01.859870 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-bd8f5d0f-a8d5-4128-8f95-a5dd6a18f470 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:02:01.860299 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-bd8f5d0f-a8d5-4128-8f95-a5dd6a18f470 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:02:02.000397 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-55e6ba78-d72f-4291-b805-828de62b360c tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Calling method '>' {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:02:02.001009 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.compute.api [None req-55e6ba78-d72f-4291-b805-828de62b360c tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] [instance: 50eed27b-6da2-4dda-94cc-02fc5cfec071] Fetching instance by UUID {{(pid=120594) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:02:02.002410 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-bd8f5d0f-a8d5-4128-8f95-a5dd6a18f470 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0948754217fc4ff2ba0241fa35feaf90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1aaf20f480a423ea5feca81585aeeed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:02:02.011205 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-55e6ba78-d72f-4291-b805-828de62b360c tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:02:02.011205 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-55e6ba78-d72f-4291-b805-828de62b360c tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:02:02.011205 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-55e6ba78-d72f-4291-b805-828de62b360c tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:02:02.011205 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-55e6ba78-d72f-4291-b805-828de62b360c tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:02:02.011560 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-55e6ba78-d72f-4291-b805-828de62b360c tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:02:02.011560 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-55e6ba78-d72f-4291-b805-828de62b360c tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:02:02.011865 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-bd8f5d0f-a8d5-4128-8f95-a5dd6a18f470 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0948754217fc4ff2ba0241fa35feaf90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1aaf20f480a423ea5feca81585aeeed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:02:02.016292 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-bd8f5d0f-a8d5-4128-8f95-a5dd6a18f470 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0948754217fc4ff2ba0241fa35feaf90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1aaf20f480a423ea5feca81585aeeed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:02:02.017895 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-bd8f5d0f-a8d5-4128-8f95-a5dd6a18f470 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] 10.222.0.50 "GET /compute/v2.1/servers/08fb826b-e891-46c4-990d-ca03cf3f4222" status: 200 len: 1404 microversion: 2.20 time: 0.181479 Sep 24 05:02:02.019026 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 110/248] 10.222.0.50 () {60 vars in 1277 bytes} [Sat Sep 24 05:02:01 2022] GET /compute/v2.1/servers/08fb826b-e891-46c4-990d-ca03cf3f4222 => generated 1404 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 05:02:02.145238 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.policy [None req-55e6ba78-d72f-4291-b805-828de62b360c tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cdd0da2c7bc4139bcd48ef36a2ee183', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a18a3756ba2b460d977f738a115ebfe0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:02:02.153984 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [None req-55e6ba78-d72f-4291-b805-828de62b360c tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] 10.222.0.50 "GET /compute/v2.1/servers/50eed27b-6da2-4dda-94cc-02fc5cfec071" status: 200 len: 1322 microversion: 2.1 time: 0.157829 Sep 24 05:02:02.154848 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 139/249] 10.222.0.50 () {58 vars in 1236 bytes} [Sat Sep 24 05:02:01 2022] GET /compute/v2.1/servers/50eed27b-6da2-4dda-94cc-02fc5cfec071 => generated 1322 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 05:02:02.857876 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-453e2b2d-e57f-4fb7-b01b-51a65f48225f tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Calling method '>' {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:02:02.858594 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.compute.api [None req-453e2b2d-e57f-4fb7-b01b-51a65f48225f tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] [instance: 201433d5-db4e-4e57-a800-42fe5cfc95ca] Fetching instance by UUID {{(pid=120593) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:02:02.860373 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-0e698a74-c081-4a5c-a8a3-4c679fb431f4 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Calling method '>' {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:02:02.860973 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.compute.api [None req-0e698a74-c081-4a5c-a8a3-4c679fb431f4 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] [instance: b2daebb8-dfea-4ab9-8253-008a21f906e1] Fetching instance by UUID {{(pid=120594) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:02:02.865025 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-453e2b2d-e57f-4fb7-b01b-51a65f48225f tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:02:02.865507 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-453e2b2d-e57f-4fb7-b01b-51a65f48225f tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:02:02.865938 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-453e2b2d-e57f-4fb7-b01b-51a65f48225f tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:02:02.866674 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-453e2b2d-e57f-4fb7-b01b-51a65f48225f tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:02:02.867117 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-0e698a74-c081-4a5c-a8a3-4c679fb431f4 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:02:02.867238 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-453e2b2d-e57f-4fb7-b01b-51a65f48225f tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:02:02.867535 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-453e2b2d-e57f-4fb7-b01b-51a65f48225f tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:02:02.867638 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-0e698a74-c081-4a5c-a8a3-4c679fb431f4 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:02:02.868007 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-0e698a74-c081-4a5c-a8a3-4c679fb431f4 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:02:02.868685 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-0e698a74-c081-4a5c-a8a3-4c679fb431f4 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:02:02.869130 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-0e698a74-c081-4a5c-a8a3-4c679fb431f4 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:02:02.869552 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-0e698a74-c081-4a5c-a8a3-4c679fb431f4 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:02:03.060856 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-453e2b2d-e57f-4fb7-b01b-51a65f48225f tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74a8cc19ab204424ab23c62915ac2bab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87d5229e39fe4817b5187068d8acecc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:02:03.064820 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.policy [None req-0e698a74-c081-4a5c-a8a3-4c679fb431f4 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b1b0448e7f54e3aaae49e411699269e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66ec8bde739145dda504995dbea0914a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:02:03.068592 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-453e2b2d-e57f-4fb7-b01b-51a65f48225f tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] 10.222.0.50 "GET /compute/v2.1/servers/201433d5-db4e-4e57-a800-42fe5cfc95ca" status: 200 len: 1367 microversion: 2.1 time: 0.214768 Sep 24 05:02:03.069157 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 111/250] 10.222.0.50 () {58 vars in 1236 bytes} [Sat Sep 24 05:02:02 2022] GET /compute/v2.1/servers/201433d5-db4e-4e57-a800-42fe5cfc95ca => generated 1367 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 05:02:03.073647 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-6d08b48c-0c96-436d-96fd-ac492a238564 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Calling method '>' {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:02:03.074285 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.compute.api [None req-6d08b48c-0c96-436d-96fd-ac492a238564 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] [instance: 08fb826b-e891-46c4-990d-ca03cf3f4222] Fetching instance by UUID {{(pid=120593) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:02:03.076455 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [None req-0e698a74-c081-4a5c-a8a3-4c679fb431f4 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] 10.222.0.50 "GET /compute/v2.1/servers/b2daebb8-dfea-4ab9-8253-008a21f906e1" status: 200 len: 1363 microversion: 2.1 time: 0.219818 Sep 24 05:02:03.077119 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 140/251] 10.222.0.50 () {58 vars in 1236 bytes} [Sat Sep 24 05:02:02 2022] GET /compute/v2.1/servers/b2daebb8-dfea-4ab9-8253-008a21f906e1 => generated 1363 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 24 05:02:03.080533 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-6d08b48c-0c96-436d-96fd-ac492a238564 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:02:03.081012 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-6d08b48c-0c96-436d-96fd-ac492a238564 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:02:03.081444 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-6d08b48c-0c96-436d-96fd-ac492a238564 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:02:03.082161 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-6d08b48c-0c96-436d-96fd-ac492a238564 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:02:03.082612 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-6d08b48c-0c96-436d-96fd-ac492a238564 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:02:03.083031 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-6d08b48c-0c96-436d-96fd-ac492a238564 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:02:03.176906 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-57db28ad-c312-4460-8520-199843ce1322 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Calling method '>' {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:02:03.177627 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.compute.api [None req-57db28ad-c312-4460-8520-199843ce1322 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] [instance: 50eed27b-6da2-4dda-94cc-02fc5cfec071] Fetching instance by UUID {{(pid=120594) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:02:03.183449 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-57db28ad-c312-4460-8520-199843ce1322 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:02:03.183997 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-57db28ad-c312-4460-8520-199843ce1322 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:02:03.184508 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-57db28ad-c312-4460-8520-199843ce1322 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:02:03.185253 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-57db28ad-c312-4460-8520-199843ce1322 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:02:03.185763 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-57db28ad-c312-4460-8520-199843ce1322 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:02:03.186270 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-57db28ad-c312-4460-8520-199843ce1322 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:02:03.214117 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-6d08b48c-0c96-436d-96fd-ac492a238564 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0948754217fc4ff2ba0241fa35feaf90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1aaf20f480a423ea5feca81585aeeed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:02:03.226266 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-6d08b48c-0c96-436d-96fd-ac492a238564 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0948754217fc4ff2ba0241fa35feaf90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1aaf20f480a423ea5feca81585aeeed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:02:03.226266 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-6d08b48c-0c96-436d-96fd-ac492a238564 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0948754217fc4ff2ba0241fa35feaf90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1aaf20f480a423ea5feca81585aeeed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:02:03.226266 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-6d08b48c-0c96-436d-96fd-ac492a238564 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] 10.222.0.50 "GET /compute/v2.1/servers/08fb826b-e891-46c4-990d-ca03cf3f4222" status: 200 len: 1404 microversion: 2.20 time: 0.155913 Sep 24 05:02:03.226798 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 112/252] 10.222.0.50 () {60 vars in 1277 bytes} [Sat Sep 24 05:02:03 2022] GET /compute/v2.1/servers/08fb826b-e891-46c4-990d-ca03cf3f4222 => generated 1404 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 05:02:03.320336 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.policy [None req-57db28ad-c312-4460-8520-199843ce1322 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cdd0da2c7bc4139bcd48ef36a2ee183', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a18a3756ba2b460d977f738a115ebfe0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:02:03.328994 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [None req-57db28ad-c312-4460-8520-199843ce1322 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] 10.222.0.50 "GET /compute/v2.1/servers/50eed27b-6da2-4dda-94cc-02fc5cfec071" status: 200 len: 1322 microversion: 2.1 time: 0.155845 Sep 24 05:02:03.329702 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 141/253] 10.222.0.50 () {58 vars in 1236 bytes} [Sat Sep 24 05:02:03 2022] GET /compute/v2.1/servers/50eed27b-6da2-4dda-94cc-02fc5cfec071 => generated 1322 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 24 05:02:04.091073 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-df7d0416-e20c-482a-a0e0-a7f042a9b871 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Calling method '>' {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:02:04.091561 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.compute.api [None req-df7d0416-e20c-482a-a0e0-a7f042a9b871 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] [instance: 201433d5-db4e-4e57-a800-42fe5cfc95ca] Fetching instance by UUID {{(pid=120593) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:02:04.093792 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG dbcounter [-] [120593] Writing DB stats nova_api:SELECT=83 {{(pid=120593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 05:02:04.099553 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-88da16d5-7c26-47ac-b9a4-a88532ab08fd tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Calling method '>' {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:02:04.100171 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-df7d0416-e20c-482a-a0e0-a7f042a9b871 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:02:04.100316 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.compute.api [None req-88da16d5-7c26-47ac-b9a4-a88532ab08fd tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] [instance: b2daebb8-dfea-4ab9-8253-008a21f906e1] Fetching instance by UUID {{(pid=120594) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:02:04.100660 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-df7d0416-e20c-482a-a0e0-a7f042a9b871 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:02:04.101097 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-df7d0416-e20c-482a-a0e0-a7f042a9b871 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:02:04.101789 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-df7d0416-e20c-482a-a0e0-a7f042a9b871 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:02:04.102296 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-df7d0416-e20c-482a-a0e0-a7f042a9b871 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:02:04.103138 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-df7d0416-e20c-482a-a0e0-a7f042a9b871 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:02:04.107024 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-88da16d5-7c26-47ac-b9a4-a88532ab08fd tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:02:04.107578 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-88da16d5-7c26-47ac-b9a4-a88532ab08fd tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:02:04.108392 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-88da16d5-7c26-47ac-b9a4-a88532ab08fd tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:02:04.109291 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-88da16d5-7c26-47ac-b9a4-a88532ab08fd tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:02:04.110034 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-88da16d5-7c26-47ac-b9a4-a88532ab08fd tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:02:04.110461 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-88da16d5-7c26-47ac-b9a4-a88532ab08fd tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:02:04.309085 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-df7d0416-e20c-482a-a0e0-a7f042a9b871 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74a8cc19ab204424ab23c62915ac2bab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87d5229e39fe4817b5187068d8acecc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:02:04.314717 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.policy [None req-88da16d5-7c26-47ac-b9a4-a88532ab08fd tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b1b0448e7f54e3aaae49e411699269e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66ec8bde739145dda504995dbea0914a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:02:04.318692 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-df7d0416-e20c-482a-a0e0-a7f042a9b871 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] 10.222.0.50 "GET /compute/v2.1/servers/201433d5-db4e-4e57-a800-42fe5cfc95ca" status: 200 len: 1367 microversion: 2.1 time: 0.231686 Sep 24 05:02:04.330652 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 113/254] 10.222.0.50 () {58 vars in 1236 bytes} [Sat Sep 24 05:02:04 2022] GET /compute/v2.1/servers/201433d5-db4e-4e57-a800-42fe5cfc95ca => generated 1367 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 05:02:04.330944 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [None req-88da16d5-7c26-47ac-b9a4-a88532ab08fd tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] 10.222.0.50 "GET /compute/v2.1/servers/b2daebb8-dfea-4ab9-8253-008a21f906e1" status: 200 len: 1363 microversion: 2.1 time: 0.226720 Sep 24 05:02:04.330944 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 142/255] 10.222.0.50 () {58 vars in 1236 bytes} [Sat Sep 24 05:02:04 2022] GET /compute/v2.1/servers/b2daebb8-dfea-4ab9-8253-008a21f906e1 => generated 1363 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 05:02:04.331414 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-d02782f7-63f9-4dfd-a30f-1291fe1420b3 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Calling method '>' {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:02:04.335778 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.compute.api [None req-d02782f7-63f9-4dfd-a30f-1291fe1420b3 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] [instance: 08fb826b-e891-46c4-990d-ca03cf3f4222] Fetching instance by UUID {{(pid=120593) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:02:04.341899 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-d02782f7-63f9-4dfd-a30f-1291fe1420b3 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:02:04.342429 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-d02782f7-63f9-4dfd-a30f-1291fe1420b3 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:02:04.343427 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-d02782f7-63f9-4dfd-a30f-1291fe1420b3 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:02:04.344114 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-d02782f7-63f9-4dfd-a30f-1291fe1420b3 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:02:04.344564 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-d02782f7-63f9-4dfd-a30f-1291fe1420b3 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:02:04.344985 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-d02782f7-63f9-4dfd-a30f-1291fe1420b3 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:02:04.356285 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-4354780f-3454-4303-944f-a9f24945cd8d tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Calling method '>' {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:02:04.357175 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.compute.api [None req-4354780f-3454-4303-944f-a9f24945cd8d tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] [instance: 50eed27b-6da2-4dda-94cc-02fc5cfec071] Fetching instance by UUID {{(pid=120594) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:02:04.361149 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG dbcounter [-] [120594] Writing DB stats nova_api:SELECT=100 {{(pid=120594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 05:02:04.366944 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-4354780f-3454-4303-944f-a9f24945cd8d tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:02:04.367505 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-4354780f-3454-4303-944f-a9f24945cd8d tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:02:04.368645 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-4354780f-3454-4303-944f-a9f24945cd8d tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:02:04.369697 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-4354780f-3454-4303-944f-a9f24945cd8d tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:02:04.370330 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-4354780f-3454-4303-944f-a9f24945cd8d tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:02:04.370868 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-4354780f-3454-4303-944f-a9f24945cd8d tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:02:04.744533 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-d02782f7-63f9-4dfd-a30f-1291fe1420b3 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0948754217fc4ff2ba0241fa35feaf90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1aaf20f480a423ea5feca81585aeeed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:02:04.750881 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.policy [None req-4354780f-3454-4303-944f-a9f24945cd8d tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cdd0da2c7bc4139bcd48ef36a2ee183', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a18a3756ba2b460d977f738a115ebfe0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:02:04.759222 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-d02782f7-63f9-4dfd-a30f-1291fe1420b3 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0948754217fc4ff2ba0241fa35feaf90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1aaf20f480a423ea5feca81585aeeed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:02:04.760475 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-d02782f7-63f9-4dfd-a30f-1291fe1420b3 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0948754217fc4ff2ba0241fa35feaf90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1aaf20f480a423ea5feca81585aeeed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:02:04.761578 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-d02782f7-63f9-4dfd-a30f-1291fe1420b3 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] 10.222.0.50 "GET /compute/v2.1/servers/08fb826b-e891-46c4-990d-ca03cf3f4222" status: 200 len: 1404 microversion: 2.20 time: 0.440839 Sep 24 05:02:04.762163 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 114/256] 10.222.0.50 () {60 vars in 1277 bytes} [Sat Sep 24 05:02:04 2022] GET /compute/v2.1/servers/08fb826b-e891-46c4-990d-ca03cf3f4222 => generated 1404 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 05:02:04.767386 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [None req-4354780f-3454-4303-944f-a9f24945cd8d tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] 10.222.0.50 "GET /compute/v2.1/servers/50eed27b-6da2-4dda-94cc-02fc5cfec071" status: 200 len: 1322 microversion: 2.1 time: 0.416385 Sep 24 05:02:04.767953 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 143/257] 10.222.0.50 () {58 vars in 1236 bytes} [Sat Sep 24 05:02:04 2022] GET /compute/v2.1/servers/50eed27b-6da2-4dda-94cc-02fc5cfec071 => generated 1322 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 24 05:02:05.344218 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-22c8f854-bd96-4b2a-8749-80f53c988507 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Calling method '>' {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:02:05.344812 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.compute.api [None req-22c8f854-bd96-4b2a-8749-80f53c988507 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] [instance: 201433d5-db4e-4e57-a800-42fe5cfc95ca] Fetching instance by UUID {{(pid=120593) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:02:05.345983 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-2d3ad691-e5a2-4fb8-bbad-d46707159430 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Calling method '>' {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:02:05.346622 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.compute.api [None req-2d3ad691-e5a2-4fb8-bbad-d46707159430 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] [instance: b2daebb8-dfea-4ab9-8253-008a21f906e1] Fetching instance by UUID {{(pid=120594) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:02:05.351732 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-22c8f854-bd96-4b2a-8749-80f53c988507 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:02:05.352199 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-22c8f854-bd96-4b2a-8749-80f53c988507 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:02:05.352797 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-22c8f854-bd96-4b2a-8749-80f53c988507 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:02:05.352913 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-2d3ad691-e5a2-4fb8-bbad-d46707159430 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:02:05.353475 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-2d3ad691-e5a2-4fb8-bbad-d46707159430 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:02:05.353601 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-22c8f854-bd96-4b2a-8749-80f53c988507 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:02:05.353935 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-2d3ad691-e5a2-4fb8-bbad-d46707159430 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:02:05.354074 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-22c8f854-bd96-4b2a-8749-80f53c988507 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:02:05.354473 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-22c8f854-bd96-4b2a-8749-80f53c988507 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:02:05.354686 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-2d3ad691-e5a2-4fb8-bbad-d46707159430 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:02:05.355335 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-2d3ad691-e5a2-4fb8-bbad-d46707159430 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:02:05.355912 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-2d3ad691-e5a2-4fb8-bbad-d46707159430 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:02:05.551055 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-22c8f854-bd96-4b2a-8749-80f53c988507 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74a8cc19ab204424ab23c62915ac2bab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87d5229e39fe4817b5187068d8acecc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:02:05.556992 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.policy [None req-2d3ad691-e5a2-4fb8-bbad-d46707159430 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b1b0448e7f54e3aaae49e411699269e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66ec8bde739145dda504995dbea0914a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:02:05.558620 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-22c8f854-bd96-4b2a-8749-80f53c988507 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] 10.222.0.50 "GET /compute/v2.1/servers/201433d5-db4e-4e57-a800-42fe5cfc95ca" status: 200 len: 1367 microversion: 2.1 time: 0.218199 Sep 24 05:02:05.559194 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 115/258] 10.222.0.50 () {58 vars in 1236 bytes} [Sat Sep 24 05:02:05 2022] GET /compute/v2.1/servers/201433d5-db4e-4e57-a800-42fe5cfc95ca => generated 1367 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 05:02:05.570161 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG dbcounter [-] [120594] Writing DB stats nova_cell1:SELECT=100 {{(pid=120594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 05:02:05.570161 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [None req-2d3ad691-e5a2-4fb8-bbad-d46707159430 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] 10.222.0.50 "GET /compute/v2.1/servers/b2daebb8-dfea-4ab9-8253-008a21f906e1" status: 200 len: 1363 microversion: 2.1 time: 0.224578 Sep 24 05:02:05.570161 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 144/259] 10.222.0.50 () {58 vars in 1236 bytes} [Sat Sep 24 05:02:05 2022] GET /compute/v2.1/servers/b2daebb8-dfea-4ab9-8253-008a21f906e1 => generated 1363 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 05:02:05.787354 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-abe3596b-09ae-4ebc-afae-9a90ab1c06b6 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Calling method '>' {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:02:05.788187 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.compute.api [None req-abe3596b-09ae-4ebc-afae-9a90ab1c06b6 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] [instance: 08fb826b-e891-46c4-990d-ca03cf3f4222] Fetching instance by UUID {{(pid=120594) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:02:05.789304 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-a38a4dca-dfd3-42fd-8d8f-3e4741b741d0 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Calling method '>' {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:02:05.790277 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.compute.api [None req-a38a4dca-dfd3-42fd-8d8f-3e4741b741d0 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] [instance: 50eed27b-6da2-4dda-94cc-02fc5cfec071] Fetching instance by UUID {{(pid=120593) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:02:05.795120 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-abe3596b-09ae-4ebc-afae-9a90ab1c06b6 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:02:05.795671 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-abe3596b-09ae-4ebc-afae-9a90ab1c06b6 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:02:05.796729 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-a38a4dca-dfd3-42fd-8d8f-3e4741b741d0 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:02:05.796873 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-abe3596b-09ae-4ebc-afae-9a90ab1c06b6 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:02:05.797464 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-abe3596b-09ae-4ebc-afae-9a90ab1c06b6 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:02:05.797574 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-a38a4dca-dfd3-42fd-8d8f-3e4741b741d0 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:02:05.797907 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-abe3596b-09ae-4ebc-afae-9a90ab1c06b6 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:02:05.798039 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-a38a4dca-dfd3-42fd-8d8f-3e4741b741d0 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:02:05.798351 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-abe3596b-09ae-4ebc-afae-9a90ab1c06b6 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:02:05.798613 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-a38a4dca-dfd3-42fd-8d8f-3e4741b741d0 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:02:05.799222 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-a38a4dca-dfd3-42fd-8d8f-3e4741b741d0 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:02:05.799645 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-a38a4dca-dfd3-42fd-8d8f-3e4741b741d0 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:02:06.001869 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.policy [None req-abe3596b-09ae-4ebc-afae-9a90ab1c06b6 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0948754217fc4ff2ba0241fa35feaf90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1aaf20f480a423ea5feca81585aeeed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:02:06.003551 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-a38a4dca-dfd3-42fd-8d8f-3e4741b741d0 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cdd0da2c7bc4139bcd48ef36a2ee183', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a18a3756ba2b460d977f738a115ebfe0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:02:06.011066 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.policy [None req-abe3596b-09ae-4ebc-afae-9a90ab1c06b6 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0948754217fc4ff2ba0241fa35feaf90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1aaf20f480a423ea5feca81585aeeed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:02:06.011335 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-a38a4dca-dfd3-42fd-8d8f-3e4741b741d0 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] 10.222.0.50 "GET /compute/v2.1/servers/50eed27b-6da2-4dda-94cc-02fc5cfec071" status: 200 len: 1322 microversion: 2.1 time: 0.226148 Sep 24 05:02:06.011904 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 116/260] 10.222.0.50 () {58 vars in 1236 bytes} [Sat Sep 24 05:02:05 2022] GET /compute/v2.1/servers/50eed27b-6da2-4dda-94cc-02fc5cfec071 => generated 1322 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 05:02:06.012929 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.policy [None req-abe3596b-09ae-4ebc-afae-9a90ab1c06b6 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0948754217fc4ff2ba0241fa35feaf90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1aaf20f480a423ea5feca81585aeeed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:02:06.014185 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [None req-abe3596b-09ae-4ebc-afae-9a90ab1c06b6 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] 10.222.0.50 "GET /compute/v2.1/servers/08fb826b-e891-46c4-990d-ca03cf3f4222" status: 200 len: 1404 microversion: 2.20 time: 0.230609 Sep 24 05:02:06.017147 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 145/261] 10.222.0.50 () {60 vars in 1277 bytes} [Sat Sep 24 05:02:05 2022] GET /compute/v2.1/servers/08fb826b-e891-46c4-990d-ca03cf3f4222 => generated 1404 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 05:02:06.581339 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-bd3002e7-b81a-4f61-9bda-6bedf5314984 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Calling method '>' {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:02:06.581937 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.compute.api [None req-bd3002e7-b81a-4f61-9bda-6bedf5314984 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] [instance: 201433d5-db4e-4e57-a800-42fe5cfc95ca] Fetching instance by UUID {{(pid=120593) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:02:06.588192 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-bd3002e7-b81a-4f61-9bda-6bedf5314984 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:02:06.588588 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-8c8a0b99-c0e4-4c17-9c5c-7e6dc6d7ed4f tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Calling method '>' {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:02:06.588985 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-bd3002e7-b81a-4f61-9bda-6bedf5314984 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:02:06.589097 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-bd3002e7-b81a-4f61-9bda-6bedf5314984 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:02:06.589567 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.compute.api [None req-8c8a0b99-c0e4-4c17-9c5c-7e6dc6d7ed4f tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] [instance: b2daebb8-dfea-4ab9-8253-008a21f906e1] Fetching instance by UUID {{(pid=120594) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:02:06.589766 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-bd3002e7-b81a-4f61-9bda-6bedf5314984 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:02:06.590232 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-bd3002e7-b81a-4f61-9bda-6bedf5314984 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:02:06.590649 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-bd3002e7-b81a-4f61-9bda-6bedf5314984 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:02:06.599914 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-8c8a0b99-c0e4-4c17-9c5c-7e6dc6d7ed4f tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:02:06.599914 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-8c8a0b99-c0e4-4c17-9c5c-7e6dc6d7ed4f tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:02:06.599914 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-8c8a0b99-c0e4-4c17-9c5c-7e6dc6d7ed4f tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:02:06.599914 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-8c8a0b99-c0e4-4c17-9c5c-7e6dc6d7ed4f tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:02:06.600246 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-8c8a0b99-c0e4-4c17-9c5c-7e6dc6d7ed4f tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:02:06.600246 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-8c8a0b99-c0e4-4c17-9c5c-7e6dc6d7ed4f tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:02:06.794748 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-bd3002e7-b81a-4f61-9bda-6bedf5314984 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74a8cc19ab204424ab23c62915ac2bab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87d5229e39fe4817b5187068d8acecc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:02:06.798209 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.policy [None req-8c8a0b99-c0e4-4c17-9c5c-7e6dc6d7ed4f tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b1b0448e7f54e3aaae49e411699269e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66ec8bde739145dda504995dbea0914a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:02:06.804457 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-bd3002e7-b81a-4f61-9bda-6bedf5314984 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] 10.222.0.50 "GET /compute/v2.1/servers/201433d5-db4e-4e57-a800-42fe5cfc95ca" status: 200 len: 1367 microversion: 2.1 time: 0.226907 Sep 24 05:02:06.805147 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 117/262] 10.222.0.50 () {58 vars in 1236 bytes} [Sat Sep 24 05:02:06 2022] GET /compute/v2.1/servers/201433d5-db4e-4e57-a800-42fe5cfc95ca => generated 1367 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 05:02:06.805716 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [None req-8c8a0b99-c0e4-4c17-9c5c-7e6dc6d7ed4f tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] 10.222.0.50 "GET /compute/v2.1/servers/b2daebb8-dfea-4ab9-8253-008a21f906e1" status: 200 len: 1363 microversion: 2.1 time: 0.221031 Sep 24 05:02:06.806572 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 146/263] 10.222.0.50 () {58 vars in 1236 bytes} [Sat Sep 24 05:02:06 2022] GET /compute/v2.1/servers/b2daebb8-dfea-4ab9-8253-008a21f906e1 => generated 1363 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 05:02:07.035496 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-e70882dc-4f79-40bf-9b4a-1202f8333eb2 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Calling method '>' {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:02:07.036065 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.compute.api [None req-e70882dc-4f79-40bf-9b4a-1202f8333eb2 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] [instance: 50eed27b-6da2-4dda-94cc-02fc5cfec071] Fetching instance by UUID {{(pid=120593) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:02:07.040370 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-638e022e-2b7b-4e3a-9074-11719b25ed0d tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Calling method '>' {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:02:07.040970 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.compute.api [None req-638e022e-2b7b-4e3a-9074-11719b25ed0d tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] [instance: 08fb826b-e891-46c4-990d-ca03cf3f4222] Fetching instance by UUID {{(pid=120594) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:02:07.042090 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-e70882dc-4f79-40bf-9b4a-1202f8333eb2 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:02:07.042578 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-e70882dc-4f79-40bf-9b4a-1202f8333eb2 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:02:07.043009 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-e70882dc-4f79-40bf-9b4a-1202f8333eb2 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:02:07.043700 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-e70882dc-4f79-40bf-9b4a-1202f8333eb2 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:02:07.044146 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-e70882dc-4f79-40bf-9b4a-1202f8333eb2 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:02:07.044570 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-e70882dc-4f79-40bf-9b4a-1202f8333eb2 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:02:07.047294 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-638e022e-2b7b-4e3a-9074-11719b25ed0d tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:02:07.047762 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-638e022e-2b7b-4e3a-9074-11719b25ed0d tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:02:07.048185 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-638e022e-2b7b-4e3a-9074-11719b25ed0d tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:02:07.048862 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-638e022e-2b7b-4e3a-9074-11719b25ed0d tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:02:07.049300 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-638e022e-2b7b-4e3a-9074-11719b25ed0d tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:02:07.049714 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-638e022e-2b7b-4e3a-9074-11719b25ed0d tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:02:07.238302 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-e70882dc-4f79-40bf-9b4a-1202f8333eb2 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cdd0da2c7bc4139bcd48ef36a2ee183', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a18a3756ba2b460d977f738a115ebfe0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:02:07.241432 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.policy [None req-638e022e-2b7b-4e3a-9074-11719b25ed0d tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0948754217fc4ff2ba0241fa35feaf90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1aaf20f480a423ea5feca81585aeeed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:02:07.246143 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-e70882dc-4f79-40bf-9b4a-1202f8333eb2 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] 10.222.0.50 "GET /compute/v2.1/servers/50eed27b-6da2-4dda-94cc-02fc5cfec071" status: 200 len: 1322 microversion: 2.1 time: 0.214621 Sep 24 05:02:07.246726 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 118/264] 10.222.0.50 () {58 vars in 1236 bytes} [Sat Sep 24 05:02:07 2022] GET /compute/v2.1/servers/50eed27b-6da2-4dda-94cc-02fc5cfec071 => generated 1322 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 05:02:07.249718 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.policy [None req-638e022e-2b7b-4e3a-9074-11719b25ed0d tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0948754217fc4ff2ba0241fa35feaf90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1aaf20f480a423ea5feca81585aeeed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:02:07.251197 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.policy [None req-638e022e-2b7b-4e3a-9074-11719b25ed0d tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0948754217fc4ff2ba0241fa35feaf90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1aaf20f480a423ea5feca81585aeeed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:02:07.252274 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [None req-638e022e-2b7b-4e3a-9074-11719b25ed0d tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] 10.222.0.50 "GET /compute/v2.1/servers/08fb826b-e891-46c4-990d-ca03cf3f4222" status: 200 len: 1404 microversion: 2.20 time: 0.215736 Sep 24 05:02:07.252805 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 147/265] 10.222.0.50 () {60 vars in 1277 bytes} [Sat Sep 24 05:02:07 2022] GET /compute/v2.1/servers/08fb826b-e891-46c4-990d-ca03cf3f4222 => generated 1404 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 24 05:02:07.828944 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-864895ea-96b4-4c65-adff-2a7400ec52a6 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Calling method '>' {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:02:07.829542 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.compute.api [None req-864895ea-96b4-4c65-adff-2a7400ec52a6 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] [instance: b2daebb8-dfea-4ab9-8253-008a21f906e1] Fetching instance by UUID {{(pid=120593) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:02:07.829644 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-a9c9bdfa-b6c1-43ca-9204-b48686e16533 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Calling method '>' {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:02:07.830256 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.compute.api [None req-a9c9bdfa-b6c1-43ca-9204-b48686e16533 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] [instance: 201433d5-db4e-4e57-a800-42fe5cfc95ca] Fetching instance by UUID {{(pid=120594) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:02:07.836084 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-864895ea-96b4-4c65-adff-2a7400ec52a6 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:02:07.836502 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-864895ea-96b4-4c65-adff-2a7400ec52a6 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:02:07.836929 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-864895ea-96b4-4c65-adff-2a7400ec52a6 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:02:07.837615 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-864895ea-96b4-4c65-adff-2a7400ec52a6 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:02:07.838080 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-864895ea-96b4-4c65-adff-2a7400ec52a6 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:02:07.838497 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-864895ea-96b4-4c65-adff-2a7400ec52a6 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:02:07.838648 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-a9c9bdfa-b6c1-43ca-9204-b48686e16533 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:02:07.839132 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-a9c9bdfa-b6c1-43ca-9204-b48686e16533 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:02:07.839568 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-a9c9bdfa-b6c1-43ca-9204-b48686e16533 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:02:07.840257 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-a9c9bdfa-b6c1-43ca-9204-b48686e16533 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:02:07.840711 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-a9c9bdfa-b6c1-43ca-9204-b48686e16533 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:02:07.841131 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-a9c9bdfa-b6c1-43ca-9204-b48686e16533 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:02:08.034391 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.policy [None req-a9c9bdfa-b6c1-43ca-9204-b48686e16533 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74a8cc19ab204424ab23c62915ac2bab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87d5229e39fe4817b5187068d8acecc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:02:08.037592 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-864895ea-96b4-4c65-adff-2a7400ec52a6 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b1b0448e7f54e3aaae49e411699269e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66ec8bde739145dda504995dbea0914a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:02:08.041321 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG dbcounter [-] [120593] Writing DB stats nova_cell1:SELECT=100 {{(pid=120593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 05:02:08.042258 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [None req-a9c9bdfa-b6c1-43ca-9204-b48686e16533 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] 10.222.0.50 "GET /compute/v2.1/servers/201433d5-db4e-4e57-a800-42fe5cfc95ca" status: 200 len: 1367 microversion: 2.1 time: 0.216805 Sep 24 05:02:08.042786 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 148/266] 10.222.0.50 () {58 vars in 1236 bytes} [Sat Sep 24 05:02:07 2022] GET /compute/v2.1/servers/201433d5-db4e-4e57-a800-42fe5cfc95ca => generated 1367 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 24 05:02:08.047521 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-864895ea-96b4-4c65-adff-2a7400ec52a6 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] 10.222.0.50 "GET /compute/v2.1/servers/b2daebb8-dfea-4ab9-8253-008a21f906e1" status: 200 len: 1363 microversion: 2.1 time: 0.223318 Sep 24 05:02:08.048102 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 119/267] 10.222.0.50 () {58 vars in 1236 bytes} [Sat Sep 24 05:02:07 2022] GET /compute/v2.1/servers/b2daebb8-dfea-4ab9-8253-008a21f906e1 => generated 1363 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 05:02:08.268751 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-13c0e22b-ef5e-4956-b943-9b3e7cc8cdfe tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Calling method '>' {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:02:08.269380 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.compute.api [None req-13c0e22b-ef5e-4956-b943-9b3e7cc8cdfe tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] [instance: 50eed27b-6da2-4dda-94cc-02fc5cfec071] Fetching instance by UUID {{(pid=120594) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:02:08.275540 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-13c0e22b-ef5e-4956-b943-9b3e7cc8cdfe tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:02:08.276047 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-13c0e22b-ef5e-4956-b943-9b3e7cc8cdfe tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:02:08.276409 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-aa661f7c-af05-4880-850e-745f781d53c0 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Calling method '>' {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:02:08.276528 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-13c0e22b-ef5e-4956-b943-9b3e7cc8cdfe tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:02:08.276996 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.compute.api [None req-aa661f7c-af05-4880-850e-745f781d53c0 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] [instance: 08fb826b-e891-46c4-990d-ca03cf3f4222] Fetching instance by UUID {{(pid=120593) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:02:08.277191 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-13c0e22b-ef5e-4956-b943-9b3e7cc8cdfe tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:02:08.277665 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-13c0e22b-ef5e-4956-b943-9b3e7cc8cdfe tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:02:08.278130 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-13c0e22b-ef5e-4956-b943-9b3e7cc8cdfe tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:02:08.283120 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-aa661f7c-af05-4880-850e-745f781d53c0 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:02:08.283598 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-aa661f7c-af05-4880-850e-745f781d53c0 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:02:08.284032 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-aa661f7c-af05-4880-850e-745f781d53c0 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:02:08.284713 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-aa661f7c-af05-4880-850e-745f781d53c0 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:02:08.285157 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-aa661f7c-af05-4880-850e-745f781d53c0 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:02:08.285579 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-aa661f7c-af05-4880-850e-745f781d53c0 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:02:08.475137 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.policy [None req-13c0e22b-ef5e-4956-b943-9b3e7cc8cdfe tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cdd0da2c7bc4139bcd48ef36a2ee183', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a18a3756ba2b460d977f738a115ebfe0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:02:08.479433 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-aa661f7c-af05-4880-850e-745f781d53c0 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0948754217fc4ff2ba0241fa35feaf90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1aaf20f480a423ea5feca81585aeeed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:02:08.484789 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [None req-13c0e22b-ef5e-4956-b943-9b3e7cc8cdfe tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] 10.222.0.50 "GET /compute/v2.1/servers/50eed27b-6da2-4dda-94cc-02fc5cfec071" status: 200 len: 1322 microversion: 2.1 time: 0.220007 Sep 24 05:02:08.485352 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 149/268] 10.222.0.50 () {58 vars in 1236 bytes} [Sat Sep 24 05:02:08 2022] GET /compute/v2.1/servers/50eed27b-6da2-4dda-94cc-02fc5cfec071 => generated 1322 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 05:02:08.488575 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-aa661f7c-af05-4880-850e-745f781d53c0 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0948754217fc4ff2ba0241fa35feaf90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1aaf20f480a423ea5feca81585aeeed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:02:08.490046 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-aa661f7c-af05-4880-850e-745f781d53c0 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0948754217fc4ff2ba0241fa35feaf90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1aaf20f480a423ea5feca81585aeeed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:02:08.491141 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-aa661f7c-af05-4880-850e-745f781d53c0 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] 10.222.0.50 "GET /compute/v2.1/servers/08fb826b-e891-46c4-990d-ca03cf3f4222" status: 200 len: 1404 microversion: 2.20 time: 0.218621 Sep 24 05:02:08.491685 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 120/269] 10.222.0.50 () {60 vars in 1277 bytes} [Sat Sep 24 05:02:08 2022] GET /compute/v2.1/servers/08fb826b-e891-46c4-990d-ca03cf3f4222 => generated 1404 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 24 05:02:09.065456 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-f00a0745-96d9-4b67-b780-2d7760c59d37 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Calling method '>' {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:02:09.066251 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.compute.api [None req-f00a0745-96d9-4b67-b780-2d7760c59d37 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] [instance: 201433d5-db4e-4e57-a800-42fe5cfc95ca] Fetching instance by UUID {{(pid=120594) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:02:09.069427 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-8315dfaf-4a76-4f2f-892c-837f5a281daf tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Calling method '>' {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:02:09.070048 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.compute.api [None req-8315dfaf-4a76-4f2f-892c-837f5a281daf tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] [instance: b2daebb8-dfea-4ab9-8253-008a21f906e1] Fetching instance by UUID {{(pid=120593) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:02:09.072205 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-f00a0745-96d9-4b67-b780-2d7760c59d37 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:02:09.072686 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-f00a0745-96d9-4b67-b780-2d7760c59d37 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:02:09.073128 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-f00a0745-96d9-4b67-b780-2d7760c59d37 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:02:09.073819 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-f00a0745-96d9-4b67-b780-2d7760c59d37 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:02:09.074300 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-f00a0745-96d9-4b67-b780-2d7760c59d37 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:02:09.074726 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-f00a0745-96d9-4b67-b780-2d7760c59d37 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:02:09.076392 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-8315dfaf-4a76-4f2f-892c-837f5a281daf tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:02:09.076864 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-8315dfaf-4a76-4f2f-892c-837f5a281daf tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:02:09.077802 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-8315dfaf-4a76-4f2f-892c-837f5a281daf tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:02:09.078516 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-8315dfaf-4a76-4f2f-892c-837f5a281daf tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:02:09.078963 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-8315dfaf-4a76-4f2f-892c-837f5a281daf tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:02:09.079410 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-8315dfaf-4a76-4f2f-892c-837f5a281daf tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:02:09.265183 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.policy [None req-f00a0745-96d9-4b67-b780-2d7760c59d37 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74a8cc19ab204424ab23c62915ac2bab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87d5229e39fe4817b5187068d8acecc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:02:09.268149 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-8315dfaf-4a76-4f2f-892c-837f5a281daf tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b1b0448e7f54e3aaae49e411699269e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66ec8bde739145dda504995dbea0914a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:02:09.274292 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [None req-f00a0745-96d9-4b67-b780-2d7760c59d37 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] 10.222.0.50 "GET /compute/v2.1/servers/201433d5-db4e-4e57-a800-42fe5cfc95ca" status: 200 len: 1367 microversion: 2.1 time: 0.212941 Sep 24 05:02:09.278062 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 150/270] 10.222.0.50 () {58 vars in 1236 bytes} [Sat Sep 24 05:02:09 2022] GET /compute/v2.1/servers/201433d5-db4e-4e57-a800-42fe5cfc95ca => generated 1367 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 05:02:09.278208 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-8315dfaf-4a76-4f2f-892c-837f5a281daf tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] 10.222.0.50 "GET /compute/v2.1/servers/b2daebb8-dfea-4ab9-8253-008a21f906e1" status: 200 len: 1363 microversion: 2.1 time: 0.209930 Sep 24 05:02:09.278208 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 121/271] 10.222.0.50 () {58 vars in 1236 bytes} [Sat Sep 24 05:02:09 2022] GET /compute/v2.1/servers/b2daebb8-dfea-4ab9-8253-008a21f906e1 => generated 1363 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 24 05:02:09.507302 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-7f70eab0-e5f4-4d10-9674-a3bcf2598ccb tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Calling method '>' {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:02:09.508004 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.compute.api [None req-7f70eab0-e5f4-4d10-9674-a3bcf2598ccb tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] [instance: 50eed27b-6da2-4dda-94cc-02fc5cfec071] Fetching instance by UUID {{(pid=120594) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:02:09.513898 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-7f70eab0-e5f4-4d10-9674-a3bcf2598ccb tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:02:09.514340 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-7f70eab0-e5f4-4d10-9674-a3bcf2598ccb tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:02:09.514768 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-7f70eab0-e5f4-4d10-9674-a3bcf2598ccb tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:02:09.515747 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-7f70eab0-e5f4-4d10-9674-a3bcf2598ccb tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:02:09.516039 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-039ede2a-2f79-4be7-9ec6-023de09123e1 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Calling method '>' {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:02:09.516188 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-7f70eab0-e5f4-4d10-9674-a3bcf2598ccb tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:02:09.516603 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-7f70eab0-e5f4-4d10-9674-a3bcf2598ccb tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:02:09.516715 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.compute.api [None req-039ede2a-2f79-4be7-9ec6-023de09123e1 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] [instance: 08fb826b-e891-46c4-990d-ca03cf3f4222] Fetching instance by UUID {{(pid=120593) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:02:09.522413 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-039ede2a-2f79-4be7-9ec6-023de09123e1 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:02:09.522888 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-039ede2a-2f79-4be7-9ec6-023de09123e1 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:02:09.523316 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-039ede2a-2f79-4be7-9ec6-023de09123e1 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:02:09.523995 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-039ede2a-2f79-4be7-9ec6-023de09123e1 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:02:09.524443 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-039ede2a-2f79-4be7-9ec6-023de09123e1 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:02:09.524863 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-039ede2a-2f79-4be7-9ec6-023de09123e1 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:02:09.704524 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.policy [None req-7f70eab0-e5f4-4d10-9674-a3bcf2598ccb tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cdd0da2c7bc4139bcd48ef36a2ee183', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a18a3756ba2b460d977f738a115ebfe0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:02:09.707853 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-039ede2a-2f79-4be7-9ec6-023de09123e1 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0948754217fc4ff2ba0241fa35feaf90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1aaf20f480a423ea5feca81585aeeed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:02:09.712397 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [None req-7f70eab0-e5f4-4d10-9674-a3bcf2598ccb tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] 10.222.0.50 "GET /compute/v2.1/servers/50eed27b-6da2-4dda-94cc-02fc5cfec071" status: 200 len: 1516 microversion: 2.1 time: 0.208869 Sep 24 05:02:09.713041 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 151/272] 10.222.0.50 () {58 vars in 1236 bytes} [Sat Sep 24 05:02:09 2022] GET /compute/v2.1/servers/50eed27b-6da2-4dda-94cc-02fc5cfec071 => generated 1516 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 05:02:09.717430 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-039ede2a-2f79-4be7-9ec6-023de09123e1 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0948754217fc4ff2ba0241fa35feaf90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1aaf20f480a423ea5feca81585aeeed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:02:09.719663 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-039ede2a-2f79-4be7-9ec6-023de09123e1 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0948754217fc4ff2ba0241fa35feaf90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1aaf20f480a423ea5feca81585aeeed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:02:09.720782 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-039ede2a-2f79-4be7-9ec6-023de09123e1 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] 10.222.0.50 "GET /compute/v2.1/servers/08fb826b-e891-46c4-990d-ca03cf3f4222" status: 200 len: 1404 microversion: 2.20 time: 0.208912 Sep 24 05:02:09.721334 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 122/273] 10.222.0.50 () {60 vars in 1277 bytes} [Sat Sep 24 05:02:09 2022] GET /compute/v2.1/servers/08fb826b-e891-46c4-990d-ca03cf3f4222 => generated 1404 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 24 05:02:09.736249 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-9e3d53b5-eecd-4e04-97be-fc0abf511cdf tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 05:02:09.738580 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.compute.api [None req-9e3d53b5-eecd-4e04-97be-fc0abf511cdf tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] [instance: 50eed27b-6da2-4dda-94cc-02fc5cfec071] Fetching instance by UUID {{(pid=120594) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:02:09.744491 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-9e3d53b5-eecd-4e04-97be-fc0abf511cdf tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:02:09.744970 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-9e3d53b5-eecd-4e04-97be-fc0abf511cdf tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:02:09.745399 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-9e3d53b5-eecd-4e04-97be-fc0abf511cdf tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:02:09.746125 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-9e3d53b5-eecd-4e04-97be-fc0abf511cdf tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:02:09.746597 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-9e3d53b5-eecd-4e04-97be-fc0abf511cdf tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:02:09.747014 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-9e3d53b5-eecd-4e04-97be-fc0abf511cdf tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:02:09.807123 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.objects.instance [None req-9e3d53b5-eecd-4e04-97be-fc0abf511cdf tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Lazy-loading 'flavor' on Instance uuid 50eed27b-6da2-4dda-94cc-02fc5cfec071 {{(pid=120594) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 24 05:02:09.931363 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [None req-9e3d53b5-eecd-4e04-97be-fc0abf511cdf tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] 10.222.0.50 "POST /compute/v2.1/servers/50eed27b-6da2-4dda-94cc-02fc5cfec071/action" status: 200 len: 32 microversion: 2.1 time: 0.199162 Sep 24 05:02:09.932172 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 152/274] 10.222.0.50 () {60 vars in 1278 bytes} [Sat Sep 24 05:02:09 2022] POST /compute/v2.1/servers/50eed27b-6da2-4dda-94cc-02fc5cfec071/action => generated 32 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 24 05:02:09.941465 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-892c67e3-2953-4968-bc73-68706a920d7b tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Calling method '>' {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:02:09.942228 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.compute.api [None req-892c67e3-2953-4968-bc73-68706a920d7b tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] [instance: 50eed27b-6da2-4dda-94cc-02fc5cfec071] Fetching instance by UUID {{(pid=120593) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:02:09.948119 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-892c67e3-2953-4968-bc73-68706a920d7b tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:02:09.948675 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-892c67e3-2953-4968-bc73-68706a920d7b tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:02:09.949731 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-892c67e3-2953-4968-bc73-68706a920d7b tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:02:09.949916 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-892c67e3-2953-4968-bc73-68706a920d7b tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:02:09.950473 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-892c67e3-2953-4968-bc73-68706a920d7b tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:02:09.950977 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-892c67e3-2953-4968-bc73-68706a920d7b tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:02:10.108293 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-892c67e3-2953-4968-bc73-68706a920d7b tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cdd0da2c7bc4139bcd48ef36a2ee183', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a18a3756ba2b460d977f738a115ebfe0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:02:10.116110 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-892c67e3-2953-4968-bc73-68706a920d7b tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] 10.222.0.50 "GET /compute/v2.1/servers/50eed27b-6da2-4dda-94cc-02fc5cfec071" status: 200 len: 1522 microversion: 2.1 time: 0.178536 Sep 24 05:02:10.116756 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 123/275] 10.222.0.50 () {58 vars in 1236 bytes} [Sat Sep 24 05:02:09 2022] GET /compute/v2.1/servers/50eed27b-6da2-4dda-94cc-02fc5cfec071 => generated 1522 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 05:02:10.296974 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-e92c9d93-e8ae-4c1f-8134-1838dfb94bca tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Calling method '>' {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:02:10.297583 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.compute.api [None req-e92c9d93-e8ae-4c1f-8134-1838dfb94bca tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] [instance: b2daebb8-dfea-4ab9-8253-008a21f906e1] Fetching instance by UUID {{(pid=120593) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:02:10.297712 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-66349b84-29af-4700-853b-3583a3c5ef5b tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Calling method '>' {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:02:10.298322 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.compute.api [None req-66349b84-29af-4700-853b-3583a3c5ef5b tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] [instance: 201433d5-db4e-4e57-a800-42fe5cfc95ca] Fetching instance by UUID {{(pid=120594) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:02:10.303787 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-e92c9d93-e8ae-4c1f-8134-1838dfb94bca tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:02:10.304286 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-e92c9d93-e8ae-4c1f-8134-1838dfb94bca tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:02:10.304703 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-e92c9d93-e8ae-4c1f-8134-1838dfb94bca tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:02:10.304808 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-66349b84-29af-4700-853b-3583a3c5ef5b tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:02:10.305183 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-66349b84-29af-4700-853b-3583a3c5ef5b tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:02:10.305489 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-e92c9d93-e8ae-4c1f-8134-1838dfb94bca tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:02:10.305616 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-66349b84-29af-4700-853b-3583a3c5ef5b tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:02:10.305839 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-e92c9d93-e8ae-4c1f-8134-1838dfb94bca tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:02:10.306286 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-e92c9d93-e8ae-4c1f-8134-1838dfb94bca tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:02:10.306514 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-66349b84-29af-4700-853b-3583a3c5ef5b tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:02:10.307126 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-66349b84-29af-4700-853b-3583a3c5ef5b tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:02:10.307603 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-66349b84-29af-4700-853b-3583a3c5ef5b tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:02:10.521984 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.policy [None req-66349b84-29af-4700-853b-3583a3c5ef5b tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74a8cc19ab204424ab23c62915ac2bab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87d5229e39fe4817b5187068d8acecc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:02:10.530236 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [None req-66349b84-29af-4700-853b-3583a3c5ef5b tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] 10.222.0.50 "GET /compute/v2.1/servers/201433d5-db4e-4e57-a800-42fe5cfc95ca" status: 200 len: 1367 microversion: 2.1 time: 0.236901 Sep 24 05:02:10.531370 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 153/276] 10.222.0.50 () {58 vars in 1236 bytes} [Sat Sep 24 05:02:10 2022] GET /compute/v2.1/servers/201433d5-db4e-4e57-a800-42fe5cfc95ca => generated 1367 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 05:02:10.533047 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-e92c9d93-e8ae-4c1f-8134-1838dfb94bca tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b1b0448e7f54e3aaae49e411699269e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66ec8bde739145dda504995dbea0914a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:02:10.540836 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-e92c9d93-e8ae-4c1f-8134-1838dfb94bca tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] 10.222.0.50 "GET /compute/v2.1/servers/b2daebb8-dfea-4ab9-8253-008a21f906e1" status: 200 len: 1363 microversion: 2.1 time: 0.247718 Sep 24 05:02:10.541385 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 124/277] 10.222.0.50 () {58 vars in 1236 bytes} [Sat Sep 24 05:02:10 2022] GET /compute/v2.1/servers/b2daebb8-dfea-4ab9-8253-008a21f906e1 => generated 1363 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 05:02:10.747601 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-bf4a6f90-52fc-459f-8c02-f5693ac8b1e4 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Calling method '>' {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:02:10.748197 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.compute.api [None req-bf4a6f90-52fc-459f-8c02-f5693ac8b1e4 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] [instance: 08fb826b-e891-46c4-990d-ca03cf3f4222] Fetching instance by UUID {{(pid=120594) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:02:10.754780 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-bf4a6f90-52fc-459f-8c02-f5693ac8b1e4 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:02:10.755252 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-bf4a6f90-52fc-459f-8c02-f5693ac8b1e4 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:02:10.755676 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-bf4a6f90-52fc-459f-8c02-f5693ac8b1e4 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:02:10.756347 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-bf4a6f90-52fc-459f-8c02-f5693ac8b1e4 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:02:10.756796 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-bf4a6f90-52fc-459f-8c02-f5693ac8b1e4 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:02:10.757208 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-bf4a6f90-52fc-459f-8c02-f5693ac8b1e4 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:02:10.881840 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.policy [None req-bf4a6f90-52fc-459f-8c02-f5693ac8b1e4 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0948754217fc4ff2ba0241fa35feaf90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1aaf20f480a423ea5feca81585aeeed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:02:10.890714 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.policy [None req-bf4a6f90-52fc-459f-8c02-f5693ac8b1e4 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0948754217fc4ff2ba0241fa35feaf90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1aaf20f480a423ea5feca81585aeeed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:02:10.892160 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.policy [None req-bf4a6f90-52fc-459f-8c02-f5693ac8b1e4 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0948754217fc4ff2ba0241fa35feaf90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1aaf20f480a423ea5feca81585aeeed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:02:10.893238 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [None req-bf4a6f90-52fc-459f-8c02-f5693ac8b1e4 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] 10.222.0.50 "GET /compute/v2.1/servers/08fb826b-e891-46c4-990d-ca03cf3f4222" status: 200 len: 1404 microversion: 2.20 time: 0.149611 Sep 24 05:02:10.893792 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 154/278] 10.222.0.50 () {60 vars in 1277 bytes} [Sat Sep 24 05:02:10 2022] GET /compute/v2.1/servers/08fb826b-e891-46c4-990d-ca03cf3f4222 => generated 1404 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 05:02:11.141190 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-5ed2650f-4dd5-4870-b22a-76aa93bff21e tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Calling method '>' {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:02:11.141793 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.compute.api [None req-5ed2650f-4dd5-4870-b22a-76aa93bff21e tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] [instance: 50eed27b-6da2-4dda-94cc-02fc5cfec071] Fetching instance by UUID {{(pid=120593) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:02:11.148154 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-5ed2650f-4dd5-4870-b22a-76aa93bff21e tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:02:11.148630 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-5ed2650f-4dd5-4870-b22a-76aa93bff21e tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:02:11.149058 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-5ed2650f-4dd5-4870-b22a-76aa93bff21e tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:02:11.149738 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-5ed2650f-4dd5-4870-b22a-76aa93bff21e tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:02:11.150223 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-5ed2650f-4dd5-4870-b22a-76aa93bff21e tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:02:11.150640 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-5ed2650f-4dd5-4870-b22a-76aa93bff21e tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:02:11.277481 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-5ed2650f-4dd5-4870-b22a-76aa93bff21e tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cdd0da2c7bc4139bcd48ef36a2ee183', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a18a3756ba2b460d977f738a115ebfe0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:02:11.285054 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-5ed2650f-4dd5-4870-b22a-76aa93bff21e tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] 10.222.0.50 "GET /compute/v2.1/servers/50eed27b-6da2-4dda-94cc-02fc5cfec071" status: 200 len: 1522 microversion: 2.1 time: 0.148580 Sep 24 05:02:11.285613 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 125/279] 10.222.0.50 () {58 vars in 1236 bytes} [Sat Sep 24 05:02:11 2022] GET /compute/v2.1/servers/50eed27b-6da2-4dda-94cc-02fc5cfec071 => generated 1522 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 05:02:11.553273 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-b262ea31-2046-4a43-9b22-3851c749cdc9 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Calling method '>' {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:02:11.553912 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.compute.api [None req-b262ea31-2046-4a43-9b22-3851c749cdc9 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] [instance: 201433d5-db4e-4e57-a800-42fe5cfc95ca] Fetching instance by UUID {{(pid=120594) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:02:11.560157 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-b262ea31-2046-4a43-9b22-3851c749cdc9 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:02:11.560855 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-b262ea31-2046-4a43-9b22-3851c749cdc9 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:02:11.561284 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-b262ea31-2046-4a43-9b22-3851c749cdc9 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:02:11.562583 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-b262ea31-2046-4a43-9b22-3851c749cdc9 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:02:11.563027 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-b262ea31-2046-4a43-9b22-3851c749cdc9 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:02:11.563441 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-b262ea31-2046-4a43-9b22-3851c749cdc9 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:02:11.572589 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-a017b515-d446-473c-8fd3-e8bdd05f4cfc tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Calling method '>' {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:02:11.573724 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.compute.api [None req-a017b515-d446-473c-8fd3-e8bdd05f4cfc tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] [instance: b2daebb8-dfea-4ab9-8253-008a21f906e1] Fetching instance by UUID {{(pid=120593) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:02:11.580500 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-a017b515-d446-473c-8fd3-e8bdd05f4cfc tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:02:11.581179 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-a017b515-d446-473c-8fd3-e8bdd05f4cfc tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:02:11.581695 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-a017b515-d446-473c-8fd3-e8bdd05f4cfc tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:02:11.582500 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-a017b515-d446-473c-8fd3-e8bdd05f4cfc tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:02:11.583148 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-a017b515-d446-473c-8fd3-e8bdd05f4cfc tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:02:11.583639 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-a017b515-d446-473c-8fd3-e8bdd05f4cfc tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:02:11.749334 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.policy [None req-b262ea31-2046-4a43-9b22-3851c749cdc9 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74a8cc19ab204424ab23c62915ac2bab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87d5229e39fe4817b5187068d8acecc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:02:11.756856 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [None req-b262ea31-2046-4a43-9b22-3851c749cdc9 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] 10.222.0.50 "GET /compute/v2.1/servers/201433d5-db4e-4e57-a800-42fe5cfc95ca" status: 200 len: 1367 microversion: 2.1 time: 0.207929 Sep 24 05:02:11.757435 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 155/280] 10.222.0.50 () {58 vars in 1236 bytes} [Sat Sep 24 05:02:11 2022] GET /compute/v2.1/servers/201433d5-db4e-4e57-a800-42fe5cfc95ca => generated 1367 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 05:02:11.766388 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-a017b515-d446-473c-8fd3-e8bdd05f4cfc tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b1b0448e7f54e3aaae49e411699269e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66ec8bde739145dda504995dbea0914a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:02:11.774015 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-a017b515-d446-473c-8fd3-e8bdd05f4cfc tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] 10.222.0.50 "GET /compute/v2.1/servers/b2daebb8-dfea-4ab9-8253-008a21f906e1" status: 200 len: 1363 microversion: 2.1 time: 0.214011 Sep 24 05:02:11.774576 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 126/281] 10.222.0.50 () {58 vars in 1236 bytes} [Sat Sep 24 05:02:11 2022] GET /compute/v2.1/servers/b2daebb8-dfea-4ab9-8253-008a21f906e1 => generated 1363 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 24 05:02:11.917384 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-41880f6c-f037-43ea-b8ec-85d75ba5db19 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Calling method '>' {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:02:11.917916 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.compute.api [None req-41880f6c-f037-43ea-b8ec-85d75ba5db19 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] [instance: 08fb826b-e891-46c4-990d-ca03cf3f4222] Fetching instance by UUID {{(pid=120594) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:02:11.924184 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-41880f6c-f037-43ea-b8ec-85d75ba5db19 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:02:11.924668 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-41880f6c-f037-43ea-b8ec-85d75ba5db19 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:02:11.925103 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-41880f6c-f037-43ea-b8ec-85d75ba5db19 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:02:11.925789 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-41880f6c-f037-43ea-b8ec-85d75ba5db19 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:02:11.926279 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-41880f6c-f037-43ea-b8ec-85d75ba5db19 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:02:11.926699 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-41880f6c-f037-43ea-b8ec-85d75ba5db19 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:02:12.061050 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.policy [None req-41880f6c-f037-43ea-b8ec-85d75ba5db19 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0948754217fc4ff2ba0241fa35feaf90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1aaf20f480a423ea5feca81585aeeed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:02:12.070726 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.policy [None req-41880f6c-f037-43ea-b8ec-85d75ba5db19 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0948754217fc4ff2ba0241fa35feaf90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1aaf20f480a423ea5feca81585aeeed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:02:12.073019 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.policy [None req-41880f6c-f037-43ea-b8ec-85d75ba5db19 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0948754217fc4ff2ba0241fa35feaf90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1aaf20f480a423ea5feca81585aeeed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:02:12.074587 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [None req-41880f6c-f037-43ea-b8ec-85d75ba5db19 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] 10.222.0.50 "GET /compute/v2.1/servers/08fb826b-e891-46c4-990d-ca03cf3f4222" status: 200 len: 1404 microversion: 2.20 time: 0.161032 Sep 24 05:02:12.075273 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 156/282] 10.222.0.50 () {60 vars in 1277 bytes} [Sat Sep 24 05:02:11 2022] GET /compute/v2.1/servers/08fb826b-e891-46c4-990d-ca03cf3f4222 => generated 1404 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 05:02:12.307995 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-b80ff665-965c-4ba1-bdec-6a1d97bf92b8 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Calling method '>' {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:02:12.308619 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.compute.api [None req-b80ff665-965c-4ba1-bdec-6a1d97bf92b8 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] [instance: 50eed27b-6da2-4dda-94cc-02fc5cfec071] Fetching instance by UUID {{(pid=120593) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:02:12.315912 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-b80ff665-965c-4ba1-bdec-6a1d97bf92b8 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:02:12.316052 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-b80ff665-965c-4ba1-bdec-6a1d97bf92b8 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:02:12.316656 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-b80ff665-965c-4ba1-bdec-6a1d97bf92b8 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:02:12.317131 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-b80ff665-965c-4ba1-bdec-6a1d97bf92b8 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:02:12.317579 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-b80ff665-965c-4ba1-bdec-6a1d97bf92b8 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:02:12.318020 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-b80ff665-965c-4ba1-bdec-6a1d97bf92b8 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:02:12.457608 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-b80ff665-965c-4ba1-bdec-6a1d97bf92b8 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cdd0da2c7bc4139bcd48ef36a2ee183', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a18a3756ba2b460d977f738a115ebfe0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:02:12.465469 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-b80ff665-965c-4ba1-bdec-6a1d97bf92b8 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] 10.222.0.50 "GET /compute/v2.1/servers/50eed27b-6da2-4dda-94cc-02fc5cfec071" status: 200 len: 1522 microversion: 2.1 time: 0.161266 Sep 24 05:02:12.466057 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 127/283] 10.222.0.50 () {58 vars in 1236 bytes} [Sat Sep 24 05:02:12 2022] GET /compute/v2.1/servers/50eed27b-6da2-4dda-94cc-02fc5cfec071 => generated 1522 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 05:02:12.779350 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-ad6044af-a50e-45df-904b-1ed5fdc35a24 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Calling method '>' {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:02:12.779951 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.compute.api [None req-ad6044af-a50e-45df-904b-1ed5fdc35a24 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] [instance: 201433d5-db4e-4e57-a800-42fe5cfc95ca] Fetching instance by UUID {{(pid=120594) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:02:12.786429 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-ad6044af-a50e-45df-904b-1ed5fdc35a24 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:02:12.786903 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-ad6044af-a50e-45df-904b-1ed5fdc35a24 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:02:12.787335 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-ad6044af-a50e-45df-904b-1ed5fdc35a24 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:02:12.788013 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-ad6044af-a50e-45df-904b-1ed5fdc35a24 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:02:12.788460 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-ad6044af-a50e-45df-904b-1ed5fdc35a24 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:02:12.788886 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-ad6044af-a50e-45df-904b-1ed5fdc35a24 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:02:12.797002 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-ae4d3799-611f-424c-82b1-0686ed9f8d86 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Calling method '>' {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:02:12.797605 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.compute.api [None req-ae4d3799-611f-424c-82b1-0686ed9f8d86 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] [instance: b2daebb8-dfea-4ab9-8253-008a21f906e1] Fetching instance by UUID {{(pid=120593) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:02:12.803507 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-ae4d3799-611f-424c-82b1-0686ed9f8d86 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:02:12.803988 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-ae4d3799-611f-424c-82b1-0686ed9f8d86 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:02:12.804419 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-ae4d3799-611f-424c-82b1-0686ed9f8d86 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:02:12.805099 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-ae4d3799-611f-424c-82b1-0686ed9f8d86 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:02:12.805545 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-ae4d3799-611f-424c-82b1-0686ed9f8d86 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:02:12.805973 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-ae4d3799-611f-424c-82b1-0686ed9f8d86 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:02:12.980816 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.policy [None req-ad6044af-a50e-45df-904b-1ed5fdc35a24 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74a8cc19ab204424ab23c62915ac2bab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87d5229e39fe4817b5187068d8acecc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:02:12.984787 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-ae4d3799-611f-424c-82b1-0686ed9f8d86 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b1b0448e7f54e3aaae49e411699269e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66ec8bde739145dda504995dbea0914a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:02:12.988386 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [None req-ad6044af-a50e-45df-904b-1ed5fdc35a24 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] 10.222.0.50 "GET /compute/v2.1/servers/201433d5-db4e-4e57-a800-42fe5cfc95ca" status: 200 len: 1367 microversion: 2.1 time: 0.212872 Sep 24 05:02:12.988948 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 157/284] 10.222.0.50 () {58 vars in 1236 bytes} [Sat Sep 24 05:02:12 2022] GET /compute/v2.1/servers/201433d5-db4e-4e57-a800-42fe5cfc95ca => generated 1367 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 05:02:12.992684 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-ae4d3799-611f-424c-82b1-0686ed9f8d86 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] 10.222.0.50 "GET /compute/v2.1/servers/b2daebb8-dfea-4ab9-8253-008a21f906e1" status: 200 len: 1363 microversion: 2.1 time: 0.199490 Sep 24 05:02:12.993327 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 128/285] 10.222.0.50 () {58 vars in 1236 bytes} [Sat Sep 24 05:02:12 2022] GET /compute/v2.1/servers/b2daebb8-dfea-4ab9-8253-008a21f906e1 => generated 1363 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 24 05:02:13.099885 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-4dc998db-e08e-4c4d-9172-0c63ead9b405 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Calling method '>' {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:02:13.100480 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.compute.api [None req-4dc998db-e08e-4c4d-9172-0c63ead9b405 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] [instance: 08fb826b-e891-46c4-990d-ca03cf3f4222] Fetching instance by UUID {{(pid=120594) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:02:13.106325 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-4dc998db-e08e-4c4d-9172-0c63ead9b405 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:02:13.106795 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-4dc998db-e08e-4c4d-9172-0c63ead9b405 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:02:13.107223 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-4dc998db-e08e-4c4d-9172-0c63ead9b405 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:02:13.107931 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-4dc998db-e08e-4c4d-9172-0c63ead9b405 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:02:13.108370 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-4dc998db-e08e-4c4d-9172-0c63ead9b405 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:02:13.109407 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-4dc998db-e08e-4c4d-9172-0c63ead9b405 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:02:13.232395 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.policy [None req-4dc998db-e08e-4c4d-9172-0c63ead9b405 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0948754217fc4ff2ba0241fa35feaf90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1aaf20f480a423ea5feca81585aeeed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:02:13.241030 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.policy [None req-4dc998db-e08e-4c4d-9172-0c63ead9b405 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0948754217fc4ff2ba0241fa35feaf90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1aaf20f480a423ea5feca81585aeeed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:02:13.242517 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.policy [None req-4dc998db-e08e-4c4d-9172-0c63ead9b405 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0948754217fc4ff2ba0241fa35feaf90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1aaf20f480a423ea5feca81585aeeed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:02:13.243586 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [None req-4dc998db-e08e-4c4d-9172-0c63ead9b405 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] 10.222.0.50 "GET /compute/v2.1/servers/08fb826b-e891-46c4-990d-ca03cf3f4222" status: 200 len: 1404 microversion: 2.20 time: 0.147622 Sep 24 05:02:13.244133 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 158/286] 10.222.0.50 () {60 vars in 1277 bytes} [Sat Sep 24 05:02:13 2022] GET /compute/v2.1/servers/08fb826b-e891-46c4-990d-ca03cf3f4222 => generated 1404 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 05:02:13.488135 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-e8e4d78b-9e8f-4666-88ea-4269f9172857 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Calling method '>' {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:02:13.488745 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.compute.api [None req-e8e4d78b-9e8f-4666-88ea-4269f9172857 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] [instance: 50eed27b-6da2-4dda-94cc-02fc5cfec071] Fetching instance by UUID {{(pid=120593) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:02:13.495084 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-e8e4d78b-9e8f-4666-88ea-4269f9172857 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:02:13.495562 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-e8e4d78b-9e8f-4666-88ea-4269f9172857 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:02:13.495993 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-e8e4d78b-9e8f-4666-88ea-4269f9172857 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:02:13.496669 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-e8e4d78b-9e8f-4666-88ea-4269f9172857 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:02:13.497136 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-e8e4d78b-9e8f-4666-88ea-4269f9172857 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:02:13.497558 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-e8e4d78b-9e8f-4666-88ea-4269f9172857 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:02:13.628917 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-e8e4d78b-9e8f-4666-88ea-4269f9172857 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cdd0da2c7bc4139bcd48ef36a2ee183', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a18a3756ba2b460d977f738a115ebfe0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:02:13.636667 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-e8e4d78b-9e8f-4666-88ea-4269f9172857 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] 10.222.0.50 "GET /compute/v2.1/servers/50eed27b-6da2-4dda-94cc-02fc5cfec071" status: 200 len: 1522 microversion: 2.1 time: 0.152308 Sep 24 05:02:13.637242 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 129/287] 10.222.0.50 () {58 vars in 1236 bytes} [Sat Sep 24 05:02:13 2022] GET /compute/v2.1/servers/50eed27b-6da2-4dda-94cc-02fc5cfec071 => generated 1522 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 05:02:14.010673 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-5b85ba30-7d08-4b40-85c9-aea84a4ab301 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Calling method '>' {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:02:14.011273 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.compute.api [None req-5b85ba30-7d08-4b40-85c9-aea84a4ab301 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] [instance: 201433d5-db4e-4e57-a800-42fe5cfc95ca] Fetching instance by UUID {{(pid=120594) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:02:14.014509 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-cd0d2d95-5e27-46f7-806a-2ac1bf0a44f7 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Calling method '>' {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:02:14.015949 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.compute.api [None req-cd0d2d95-5e27-46f7-806a-2ac1bf0a44f7 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] [instance: b2daebb8-dfea-4ab9-8253-008a21f906e1] Fetching instance by UUID {{(pid=120593) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:02:14.017983 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-5b85ba30-7d08-4b40-85c9-aea84a4ab301 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:02:14.018487 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-5b85ba30-7d08-4b40-85c9-aea84a4ab301 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:02:14.018919 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-5b85ba30-7d08-4b40-85c9-aea84a4ab301 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:02:14.019600 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-5b85ba30-7d08-4b40-85c9-aea84a4ab301 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:02:14.020040 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-5b85ba30-7d08-4b40-85c9-aea84a4ab301 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:02:14.020452 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-5b85ba30-7d08-4b40-85c9-aea84a4ab301 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:02:14.021729 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-cd0d2d95-5e27-46f7-806a-2ac1bf0a44f7 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:02:14.022234 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-cd0d2d95-5e27-46f7-806a-2ac1bf0a44f7 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:02:14.022671 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-cd0d2d95-5e27-46f7-806a-2ac1bf0a44f7 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:02:14.023353 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-cd0d2d95-5e27-46f7-806a-2ac1bf0a44f7 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:02:14.023801 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-cd0d2d95-5e27-46f7-806a-2ac1bf0a44f7 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:02:14.024223 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-cd0d2d95-5e27-46f7-806a-2ac1bf0a44f7 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:02:14.037961 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG dbcounter [-] [120594] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 05:02:14.209795 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-cd0d2d95-5e27-46f7-806a-2ac1bf0a44f7 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b1b0448e7f54e3aaae49e411699269e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66ec8bde739145dda504995dbea0914a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:02:14.216678 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.policy [None req-5b85ba30-7d08-4b40-85c9-aea84a4ab301 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74a8cc19ab204424ab23c62915ac2bab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87d5229e39fe4817b5187068d8acecc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:02:14.217687 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-cd0d2d95-5e27-46f7-806a-2ac1bf0a44f7 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] 10.222.0.50 "GET /compute/v2.1/servers/b2daebb8-dfea-4ab9-8253-008a21f906e1" status: 200 len: 1363 microversion: 2.1 time: 0.206988 Sep 24 05:02:14.218289 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 130/288] 10.222.0.50 () {58 vars in 1236 bytes} [Sat Sep 24 05:02:14 2022] GET /compute/v2.1/servers/b2daebb8-dfea-4ab9-8253-008a21f906e1 => generated 1363 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 24 05:02:14.224505 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [None req-5b85ba30-7d08-4b40-85c9-aea84a4ab301 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] 10.222.0.50 "GET /compute/v2.1/servers/201433d5-db4e-4e57-a800-42fe5cfc95ca" status: 200 len: 1367 microversion: 2.1 time: 0.217706 Sep 24 05:02:14.225137 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 159/289] 10.222.0.50 () {58 vars in 1236 bytes} [Sat Sep 24 05:02:14 2022] GET /compute/v2.1/servers/201433d5-db4e-4e57-a800-42fe5cfc95ca => generated 1367 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 05:02:14.268266 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-70226024-4eba-4ae7-9dac-4775b6db82d9 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Calling method '>' {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:02:14.268796 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.compute.api [None req-70226024-4eba-4ae7-9dac-4775b6db82d9 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] [instance: 08fb826b-e891-46c4-990d-ca03cf3f4222] Fetching instance by UUID {{(pid=120593) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:02:14.274705 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-70226024-4eba-4ae7-9dac-4775b6db82d9 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:02:14.275178 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-70226024-4eba-4ae7-9dac-4775b6db82d9 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:02:14.275606 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-70226024-4eba-4ae7-9dac-4775b6db82d9 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:02:14.276279 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-70226024-4eba-4ae7-9dac-4775b6db82d9 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:02:14.276725 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-70226024-4eba-4ae7-9dac-4775b6db82d9 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:02:14.277139 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-70226024-4eba-4ae7-9dac-4775b6db82d9 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:02:14.402134 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-70226024-4eba-4ae7-9dac-4775b6db82d9 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0948754217fc4ff2ba0241fa35feaf90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1aaf20f480a423ea5feca81585aeeed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:02:14.410383 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-70226024-4eba-4ae7-9dac-4775b6db82d9 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0948754217fc4ff2ba0241fa35feaf90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1aaf20f480a423ea5feca81585aeeed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:02:14.412081 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-70226024-4eba-4ae7-9dac-4775b6db82d9 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0948754217fc4ff2ba0241fa35feaf90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1aaf20f480a423ea5feca81585aeeed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:02:14.413243 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-70226024-4eba-4ae7-9dac-4775b6db82d9 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] 10.222.0.50 "GET /compute/v2.1/servers/08fb826b-e891-46c4-990d-ca03cf3f4222" status: 200 len: 1404 microversion: 2.20 time: 0.149258 Sep 24 05:02:14.413800 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 131/290] 10.222.0.50 () {60 vars in 1277 bytes} [Sat Sep 24 05:02:14 2022] GET /compute/v2.1/servers/08fb826b-e891-46c4-990d-ca03cf3f4222 => generated 1404 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 05:02:14.660185 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-b409eac8-933a-4bd0-8d91-99f1f0121500 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Calling method '>' {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:02:14.660874 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.compute.api [None req-b409eac8-933a-4bd0-8d91-99f1f0121500 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] [instance: 50eed27b-6da2-4dda-94cc-02fc5cfec071] Fetching instance by UUID {{(pid=120594) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:02:14.666853 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-b409eac8-933a-4bd0-8d91-99f1f0121500 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:02:14.667331 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-b409eac8-933a-4bd0-8d91-99f1f0121500 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:02:14.667769 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-b409eac8-933a-4bd0-8d91-99f1f0121500 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:02:14.668447 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-b409eac8-933a-4bd0-8d91-99f1f0121500 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:02:14.668896 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-b409eac8-933a-4bd0-8d91-99f1f0121500 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:02:14.669319 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-b409eac8-933a-4bd0-8d91-99f1f0121500 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:02:14.812194 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.policy [None req-b409eac8-933a-4bd0-8d91-99f1f0121500 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cdd0da2c7bc4139bcd48ef36a2ee183', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a18a3756ba2b460d977f738a115ebfe0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:02:14.819735 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [None req-b409eac8-933a-4bd0-8d91-99f1f0121500 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] 10.222.0.50 "GET /compute/v2.1/servers/50eed27b-6da2-4dda-94cc-02fc5cfec071" status: 200 len: 1522 microversion: 2.1 time: 0.163448 Sep 24 05:02:14.820298 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 160/291] 10.222.0.50 () {58 vars in 1236 bytes} [Sat Sep 24 05:02:14 2022] GET /compute/v2.1/servers/50eed27b-6da2-4dda-94cc-02fc5cfec071 => generated 1522 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 05:02:15.239805 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-b907169f-897c-4cb5-9a8d-98b330d2e10c tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Calling method '>' {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:02:15.240409 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.compute.api [None req-b907169f-897c-4cb5-9a8d-98b330d2e10c tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] [instance: b2daebb8-dfea-4ab9-8253-008a21f906e1] Fetching instance by UUID {{(pid=120593) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:02:15.246591 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-b907169f-897c-4cb5-9a8d-98b330d2e10c tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:02:15.246988 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-ce658c37-27f7-4562-a6cf-0ec91996df20 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Calling method '>' {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:02:15.247376 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-b907169f-897c-4cb5-9a8d-98b330d2e10c tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:02:15.247483 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-b907169f-897c-4cb5-9a8d-98b330d2e10c tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:02:15.247601 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.compute.api [None req-ce658c37-27f7-4562-a6cf-0ec91996df20 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] [instance: 201433d5-db4e-4e57-a800-42fe5cfc95ca] Fetching instance by UUID {{(pid=120594) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:02:15.248161 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-b907169f-897c-4cb5-9a8d-98b330d2e10c tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:02:15.248608 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-b907169f-897c-4cb5-9a8d-98b330d2e10c tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:02:15.249027 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-b907169f-897c-4cb5-9a8d-98b330d2e10c tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:02:15.253351 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-ce658c37-27f7-4562-a6cf-0ec91996df20 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:02:15.253832 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-ce658c37-27f7-4562-a6cf-0ec91996df20 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:02:15.254313 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-ce658c37-27f7-4562-a6cf-0ec91996df20 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:02:15.254998 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-ce658c37-27f7-4562-a6cf-0ec91996df20 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:02:15.255447 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-ce658c37-27f7-4562-a6cf-0ec91996df20 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:02:15.255869 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-ce658c37-27f7-4562-a6cf-0ec91996df20 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:02:15.441217 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-b907169f-897c-4cb5-9a8d-98b330d2e10c tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b1b0448e7f54e3aaae49e411699269e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66ec8bde739145dda504995dbea0914a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:02:15.444249 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.policy [None req-ce658c37-27f7-4562-a6cf-0ec91996df20 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74a8cc19ab204424ab23c62915ac2bab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87d5229e39fe4817b5187068d8acecc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:02:15.449115 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-b907169f-897c-4cb5-9a8d-98b330d2e10c tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] 10.222.0.50 "GET /compute/v2.1/servers/b2daebb8-dfea-4ab9-8253-008a21f906e1" status: 200 len: 1363 microversion: 2.1 time: 0.213171 Sep 24 05:02:15.449753 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 132/292] 10.222.0.50 () {58 vars in 1236 bytes} [Sat Sep 24 05:02:15 2022] GET /compute/v2.1/servers/b2daebb8-dfea-4ab9-8253-008a21f906e1 => generated 1363 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 05:02:15.454729 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-4ea10d32-77be-43b9-9d9b-af4b37b3ab9c tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Calling method '>' {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:02:15.455323 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.compute.api [None req-4ea10d32-77be-43b9-9d9b-af4b37b3ab9c tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] [instance: 08fb826b-e891-46c4-990d-ca03cf3f4222] Fetching instance by UUID {{(pid=120593) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:02:15.455911 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [None req-ce658c37-27f7-4562-a6cf-0ec91996df20 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] 10.222.0.50 "GET /compute/v2.1/servers/201433d5-db4e-4e57-a800-42fe5cfc95ca" status: 200 len: 1367 microversion: 2.1 time: 0.212671 Sep 24 05:02:15.456972 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 161/293] 10.222.0.50 () {58 vars in 1236 bytes} [Sat Sep 24 05:02:15 2022] GET /compute/v2.1/servers/201433d5-db4e-4e57-a800-42fe5cfc95ca => generated 1367 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 24 05:02:15.460895 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-4ea10d32-77be-43b9-9d9b-af4b37b3ab9c tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:02:15.461439 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-4ea10d32-77be-43b9-9d9b-af4b37b3ab9c tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:02:15.461868 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-4ea10d32-77be-43b9-9d9b-af4b37b3ab9c tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:02:15.462579 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-4ea10d32-77be-43b9-9d9b-af4b37b3ab9c tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:02:15.463027 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-4ea10d32-77be-43b9-9d9b-af4b37b3ab9c tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:02:15.463446 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-4ea10d32-77be-43b9-9d9b-af4b37b3ab9c tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:02:15.586202 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-4ea10d32-77be-43b9-9d9b-af4b37b3ab9c tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0948754217fc4ff2ba0241fa35feaf90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1aaf20f480a423ea5feca81585aeeed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:02:15.594829 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-4ea10d32-77be-43b9-9d9b-af4b37b3ab9c tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0948754217fc4ff2ba0241fa35feaf90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1aaf20f480a423ea5feca81585aeeed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:02:15.596255 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-4ea10d32-77be-43b9-9d9b-af4b37b3ab9c tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0948754217fc4ff2ba0241fa35feaf90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1aaf20f480a423ea5feca81585aeeed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:02:15.597341 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-4ea10d32-77be-43b9-9d9b-af4b37b3ab9c tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] 10.222.0.50 "GET /compute/v2.1/servers/08fb826b-e891-46c4-990d-ca03cf3f4222" status: 200 len: 1404 microversion: 2.20 time: 0.146647 Sep 24 05:02:15.598036 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 133/294] 10.222.0.50 () {60 vars in 1277 bytes} [Sat Sep 24 05:02:15 2022] GET /compute/v2.1/servers/08fb826b-e891-46c4-990d-ca03cf3f4222 => generated 1404 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 05:02:15.842612 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-617c9e83-e64c-45eb-9524-fb52238af2d7 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Calling method '>' {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:02:15.843295 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.compute.api [None req-617c9e83-e64c-45eb-9524-fb52238af2d7 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] [instance: 50eed27b-6da2-4dda-94cc-02fc5cfec071] Fetching instance by UUID {{(pid=120594) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:02:15.849103 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-617c9e83-e64c-45eb-9524-fb52238af2d7 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:02:15.849576 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-617c9e83-e64c-45eb-9524-fb52238af2d7 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:02:15.850024 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-617c9e83-e64c-45eb-9524-fb52238af2d7 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:02:15.850711 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-617c9e83-e64c-45eb-9524-fb52238af2d7 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:02:15.851157 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-617c9e83-e64c-45eb-9524-fb52238af2d7 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:02:15.851573 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-617c9e83-e64c-45eb-9524-fb52238af2d7 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:02:15.977285 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.policy [None req-617c9e83-e64c-45eb-9524-fb52238af2d7 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cdd0da2c7bc4139bcd48ef36a2ee183', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a18a3756ba2b460d977f738a115ebfe0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:02:15.985399 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [None req-617c9e83-e64c-45eb-9524-fb52238af2d7 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] 10.222.0.50 "GET /compute/v2.1/servers/50eed27b-6da2-4dda-94cc-02fc5cfec071" status: 200 len: 1522 microversion: 2.1 time: 0.146559 Sep 24 05:02:15.985900 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 162/295] 10.222.0.50 () {58 vars in 1236 bytes} [Sat Sep 24 05:02:15 2022] GET /compute/v2.1/servers/50eed27b-6da2-4dda-94cc-02fc5cfec071 => generated 1522 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 05:02:16.472001 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-af0496ff-8f77-433c-a7a4-ed189d00f94d tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Calling method '>' {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:02:16.472610 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.compute.api [None req-af0496ff-8f77-433c-a7a4-ed189d00f94d tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] [instance: b2daebb8-dfea-4ab9-8253-008a21f906e1] Fetching instance by UUID {{(pid=120593) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:02:16.478782 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-27585d2f-d519-4b15-a7bc-4fe9111a8dc2 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Calling method '>' {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:02:16.479226 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-af0496ff-8f77-433c-a7a4-ed189d00f94d tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:02:16.479378 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.compute.api [None req-27585d2f-d519-4b15-a7bc-4fe9111a8dc2 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] [instance: 201433d5-db4e-4e57-a800-42fe5cfc95ca] Fetching instance by UUID {{(pid=120594) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:02:16.479601 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-af0496ff-8f77-433c-a7a4-ed189d00f94d tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:02:16.480037 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-af0496ff-8f77-433c-a7a4-ed189d00f94d tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:02:16.480728 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-af0496ff-8f77-433c-a7a4-ed189d00f94d tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:02:16.481178 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-af0496ff-8f77-433c-a7a4-ed189d00f94d tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:02:16.481599 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-af0496ff-8f77-433c-a7a4-ed189d00f94d tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:02:16.485599 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-27585d2f-d519-4b15-a7bc-4fe9111a8dc2 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:02:16.486101 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-27585d2f-d519-4b15-a7bc-4fe9111a8dc2 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:02:16.486536 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-27585d2f-d519-4b15-a7bc-4fe9111a8dc2 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:02:16.487215 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-27585d2f-d519-4b15-a7bc-4fe9111a8dc2 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:02:16.487775 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-27585d2f-d519-4b15-a7bc-4fe9111a8dc2 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:02:16.488199 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-27585d2f-d519-4b15-a7bc-4fe9111a8dc2 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:02:16.671779 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-af0496ff-8f77-433c-a7a4-ed189d00f94d tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b1b0448e7f54e3aaae49e411699269e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66ec8bde739145dda504995dbea0914a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:02:16.675737 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.policy [None req-27585d2f-d519-4b15-a7bc-4fe9111a8dc2 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74a8cc19ab204424ab23c62915ac2bab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87d5229e39fe4817b5187068d8acecc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:02:16.680629 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-af0496ff-8f77-433c-a7a4-ed189d00f94d tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] 10.222.0.50 "GET /compute/v2.1/servers/b2daebb8-dfea-4ab9-8253-008a21f906e1" status: 200 len: 1363 microversion: 2.1 time: 0.212629 Sep 24 05:02:16.681432 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 134/296] 10.222.0.50 () {58 vars in 1236 bytes} [Sat Sep 24 05:02:16 2022] GET /compute/v2.1/servers/b2daebb8-dfea-4ab9-8253-008a21f906e1 => generated 1363 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 05:02:16.684427 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [None req-27585d2f-d519-4b15-a7bc-4fe9111a8dc2 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] 10.222.0.50 "GET /compute/v2.1/servers/201433d5-db4e-4e57-a800-42fe5cfc95ca" status: 200 len: 1367 microversion: 2.1 time: 0.209590 Sep 24 05:02:16.684977 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 163/297] 10.222.0.50 () {58 vars in 1236 bytes} [Sat Sep 24 05:02:16 2022] GET /compute/v2.1/servers/201433d5-db4e-4e57-a800-42fe5cfc95ca => generated 1367 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 24 05:02:16.693881 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-99d8b861-2bc9-44e4-8732-263407e8d510 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Calling method '>' {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:02:16.694591 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.compute.api [None req-99d8b861-2bc9-44e4-8732-263407e8d510 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] [instance: 08fb826b-e891-46c4-990d-ca03cf3f4222] Fetching instance by UUID {{(pid=120593) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:02:16.701351 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-99d8b861-2bc9-44e4-8732-263407e8d510 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:02:16.701980 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-99d8b861-2bc9-44e4-8732-263407e8d510 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:02:16.702823 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-99d8b861-2bc9-44e4-8732-263407e8d510 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:02:16.703506 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-99d8b861-2bc9-44e4-8732-263407e8d510 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:02:16.703946 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-99d8b861-2bc9-44e4-8732-263407e8d510 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:02:16.704360 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-99d8b861-2bc9-44e4-8732-263407e8d510 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:02:16.835664 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-99d8b861-2bc9-44e4-8732-263407e8d510 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0948754217fc4ff2ba0241fa35feaf90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1aaf20f480a423ea5feca81585aeeed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:02:16.843781 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-99d8b861-2bc9-44e4-8732-263407e8d510 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0948754217fc4ff2ba0241fa35feaf90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1aaf20f480a423ea5feca81585aeeed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:02:16.845216 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-99d8b861-2bc9-44e4-8732-263407e8d510 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0948754217fc4ff2ba0241fa35feaf90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1aaf20f480a423ea5feca81585aeeed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:02:16.846348 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-99d8b861-2bc9-44e4-8732-263407e8d510 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] 10.222.0.50 "GET /compute/v2.1/servers/08fb826b-e891-46c4-990d-ca03cf3f4222" status: 200 len: 1404 microversion: 2.20 time: 0.156470 Sep 24 05:02:16.846913 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 135/298] 10.222.0.50 () {60 vars in 1277 bytes} [Sat Sep 24 05:02:16 2022] GET /compute/v2.1/servers/08fb826b-e891-46c4-990d-ca03cf3f4222 => generated 1404 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 05:02:17.007871 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-16ebf7b5-dabb-4e68-a308-9680fdbd8f6b tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Calling method '>' {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:02:17.008467 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.compute.api [None req-16ebf7b5-dabb-4e68-a308-9680fdbd8f6b tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] [instance: 50eed27b-6da2-4dda-94cc-02fc5cfec071] Fetching instance by UUID {{(pid=120594) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:02:17.014290 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-16ebf7b5-dabb-4e68-a308-9680fdbd8f6b tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:02:17.015415 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-16ebf7b5-dabb-4e68-a308-9680fdbd8f6b tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:02:17.016110 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-16ebf7b5-dabb-4e68-a308-9680fdbd8f6b tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:02:17.016787 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-16ebf7b5-dabb-4e68-a308-9680fdbd8f6b tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:02:17.017229 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-16ebf7b5-dabb-4e68-a308-9680fdbd8f6b tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:02:17.017643 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-16ebf7b5-dabb-4e68-a308-9680fdbd8f6b tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:02:17.139417 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.policy [None req-16ebf7b5-dabb-4e68-a308-9680fdbd8f6b tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cdd0da2c7bc4139bcd48ef36a2ee183', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a18a3756ba2b460d977f738a115ebfe0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:02:17.147731 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [None req-16ebf7b5-dabb-4e68-a308-9680fdbd8f6b tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] 10.222.0.50 "GET /compute/v2.1/servers/50eed27b-6da2-4dda-94cc-02fc5cfec071" status: 200 len: 1522 microversion: 2.1 time: 0.143633 Sep 24 05:02:17.148296 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 164/299] 10.222.0.50 () {58 vars in 1236 bytes} [Sat Sep 24 05:02:17 2022] GET /compute/v2.1/servers/50eed27b-6da2-4dda-94cc-02fc5cfec071 => generated 1522 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 05:02:17.704101 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-9d55616a-0920-4f64-9fe7-a67065b386ca tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Calling method '>' {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:02:17.704702 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.compute.api [None req-9d55616a-0920-4f64-9fe7-a67065b386ca tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] [instance: b2daebb8-dfea-4ab9-8253-008a21f906e1] Fetching instance by UUID {{(pid=120593) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:02:17.708425 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-b96e07ee-5e68-4f95-9fba-2caafc13b283 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Calling method '>' {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:02:17.708425 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.compute.api [None req-b96e07ee-5e68-4f95-9fba-2caafc13b283 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] [instance: 201433d5-db4e-4e57-a800-42fe5cfc95ca] Fetching instance by UUID {{(pid=120594) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:02:17.712373 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-9d55616a-0920-4f64-9fe7-a67065b386ca tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:02:17.712878 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-9d55616a-0920-4f64-9fe7-a67065b386ca tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:02:17.713316 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-9d55616a-0920-4f64-9fe7-a67065b386ca tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:02:17.714033 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-9d55616a-0920-4f64-9fe7-a67065b386ca tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:02:17.714489 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-9d55616a-0920-4f64-9fe7-a67065b386ca tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:02:17.714923 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-9d55616a-0920-4f64-9fe7-a67065b386ca tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:02:17.715726 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-b96e07ee-5e68-4f95-9fba-2caafc13b283 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:02:17.716582 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-b96e07ee-5e68-4f95-9fba-2caafc13b283 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:02:17.717426 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-b96e07ee-5e68-4f95-9fba-2caafc13b283 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:02:17.718473 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-b96e07ee-5e68-4f95-9fba-2caafc13b283 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:02:17.718972 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-b96e07ee-5e68-4f95-9fba-2caafc13b283 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:02:17.719436 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-b96e07ee-5e68-4f95-9fba-2caafc13b283 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:02:17.735880 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG dbcounter [-] [120593] Writing DB stats nova_cell1:SELECT=100 {{(pid=120593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 05:02:18.084759 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-9d55616a-0920-4f64-9fe7-a67065b386ca tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b1b0448e7f54e3aaae49e411699269e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66ec8bde739145dda504995dbea0914a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:02:18.093770 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-9d55616a-0920-4f64-9fe7-a67065b386ca tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] 10.222.0.50 "GET /compute/v2.1/servers/b2daebb8-dfea-4ab9-8253-008a21f906e1" status: 200 len: 1363 microversion: 2.1 time: 0.393761 Sep 24 05:02:18.099653 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.policy [None req-b96e07ee-5e68-4f95-9fba-2caafc13b283 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74a8cc19ab204424ab23c62915ac2bab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87d5229e39fe4817b5187068d8acecc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:02:18.102608 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 136/300] 10.222.0.50 () {58 vars in 1236 bytes} [Sat Sep 24 05:02:17 2022] GET /compute/v2.1/servers/b2daebb8-dfea-4ab9-8253-008a21f906e1 => generated 1363 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 05:02:18.108553 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [None req-b96e07ee-5e68-4f95-9fba-2caafc13b283 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] 10.222.0.50 "GET /compute/v2.1/servers/201433d5-db4e-4e57-a800-42fe5cfc95ca" status: 200 len: 1367 microversion: 2.1 time: 0.404799 Sep 24 05:02:18.108706 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-ca9fb643-13b6-4b28-a94e-4c1228f13464 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Calling method '>' {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:02:18.109347 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.compute.api [None req-ca9fb643-13b6-4b28-a94e-4c1228f13464 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] [instance: 08fb826b-e891-46c4-990d-ca03cf3f4222] Fetching instance by UUID {{(pid=120593) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:02:18.109755 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 165/301] 10.222.0.50 () {58 vars in 1236 bytes} [Sat Sep 24 05:02:17 2022] GET /compute/v2.1/servers/201433d5-db4e-4e57-a800-42fe5cfc95ca => generated 1367 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 24 05:02:18.115643 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-ca9fb643-13b6-4b28-a94e-4c1228f13464 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:02:18.116069 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-ca9fb643-13b6-4b28-a94e-4c1228f13464 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:02:18.116569 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-ca9fb643-13b6-4b28-a94e-4c1228f13464 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:02:18.117270 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-ca9fb643-13b6-4b28-a94e-4c1228f13464 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:02:18.117724 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-ca9fb643-13b6-4b28-a94e-4c1228f13464 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:02:18.118174 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-ca9fb643-13b6-4b28-a94e-4c1228f13464 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:02:18.171454 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-4e55987c-59fd-4a9b-b407-df81e2c9a85d tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Calling method '>' {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:02:18.172154 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.compute.api [None req-4e55987c-59fd-4a9b-b407-df81e2c9a85d tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] [instance: 50eed27b-6da2-4dda-94cc-02fc5cfec071] Fetching instance by UUID {{(pid=120594) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:02:18.178112 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-4e55987c-59fd-4a9b-b407-df81e2c9a85d tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:02:18.179210 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-4e55987c-59fd-4a9b-b407-df81e2c9a85d tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:02:18.179704 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-4e55987c-59fd-4a9b-b407-df81e2c9a85d tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:02:18.180464 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-4e55987c-59fd-4a9b-b407-df81e2c9a85d tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:02:18.180921 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-4e55987c-59fd-4a9b-b407-df81e2c9a85d tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:02:18.181366 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-4e55987c-59fd-4a9b-b407-df81e2c9a85d tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:02:18.293047 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-ca9fb643-13b6-4b28-a94e-4c1228f13464 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0948754217fc4ff2ba0241fa35feaf90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1aaf20f480a423ea5feca81585aeeed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:02:18.304177 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-ca9fb643-13b6-4b28-a94e-4c1228f13464 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0948754217fc4ff2ba0241fa35feaf90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1aaf20f480a423ea5feca81585aeeed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:02:18.305652 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-ca9fb643-13b6-4b28-a94e-4c1228f13464 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0948754217fc4ff2ba0241fa35feaf90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1aaf20f480a423ea5feca81585aeeed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:02:18.307770 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-ca9fb643-13b6-4b28-a94e-4c1228f13464 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] 10.222.0.50 "GET /compute/v2.1/servers/08fb826b-e891-46c4-990d-ca03cf3f4222" status: 200 len: 1404 microversion: 2.20 time: 0.202765 Sep 24 05:02:18.309259 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 137/302] 10.222.0.50 () {60 vars in 1277 bytes} [Sat Sep 24 05:02:18 2022] GET /compute/v2.1/servers/08fb826b-e891-46c4-990d-ca03cf3f4222 => generated 1404 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 05:02:18.362607 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.policy [None req-4e55987c-59fd-4a9b-b407-df81e2c9a85d tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cdd0da2c7bc4139bcd48ef36a2ee183', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a18a3756ba2b460d977f738a115ebfe0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:02:18.371126 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [None req-4e55987c-59fd-4a9b-b407-df81e2c9a85d tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] 10.222.0.50 "GET /compute/v2.1/servers/50eed27b-6da2-4dda-94cc-02fc5cfec071" status: 200 len: 1522 microversion: 2.1 time: 0.204419 Sep 24 05:02:18.371633 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 166/303] 10.222.0.50 () {58 vars in 1236 bytes} [Sat Sep 24 05:02:18 2022] GET /compute/v2.1/servers/50eed27b-6da2-4dda-94cc-02fc5cfec071 => generated 1522 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 24 05:02:19.116613 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-00bf8911-f191-4c49-8005-23f51367f0ee tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Calling method '>' {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:02:19.117291 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.compute.api [None req-00bf8911-f191-4c49-8005-23f51367f0ee tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] [instance: b2daebb8-dfea-4ab9-8253-008a21f906e1] Fetching instance by UUID {{(pid=120593) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:02:19.123292 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-00bf8911-f191-4c49-8005-23f51367f0ee tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:02:19.123890 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-00bf8911-f191-4c49-8005-23f51367f0ee tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:02:19.125219 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-00bf8911-f191-4c49-8005-23f51367f0ee tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:02:19.126345 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-00bf8911-f191-4c49-8005-23f51367f0ee tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:02:19.127127 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-00bf8911-f191-4c49-8005-23f51367f0ee tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:02:19.127593 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-00bf8911-f191-4c49-8005-23f51367f0ee tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:02:19.132198 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-0860f18d-9ec2-4633-bc69-ad40d9034f38 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Calling method '>' {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:02:19.132834 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.compute.api [None req-0860f18d-9ec2-4633-bc69-ad40d9034f38 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] [instance: 201433d5-db4e-4e57-a800-42fe5cfc95ca] Fetching instance by UUID {{(pid=120594) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:02:19.138789 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-0860f18d-9ec2-4633-bc69-ad40d9034f38 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:02:19.139358 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-0860f18d-9ec2-4633-bc69-ad40d9034f38 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:02:19.140793 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-0860f18d-9ec2-4633-bc69-ad40d9034f38 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:02:19.141669 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-0860f18d-9ec2-4633-bc69-ad40d9034f38 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:02:19.142253 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-0860f18d-9ec2-4633-bc69-ad40d9034f38 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:02:19.142866 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-0860f18d-9ec2-4633-bc69-ad40d9034f38 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:02:19.330374 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-00bf8911-f191-4c49-8005-23f51367f0ee tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b1b0448e7f54e3aaae49e411699269e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66ec8bde739145dda504995dbea0914a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:02:19.339011 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-00bf8911-f191-4c49-8005-23f51367f0ee tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] 10.222.0.50 "GET /compute/v2.1/servers/b2daebb8-dfea-4ab9-8253-008a21f906e1" status: 200 len: 1363 microversion: 2.1 time: 0.226174 Sep 24 05:02:19.339416 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.policy [None req-0860f18d-9ec2-4633-bc69-ad40d9034f38 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74a8cc19ab204424ab23c62915ac2bab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87d5229e39fe4817b5187068d8acecc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:02:19.342036 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 138/304] 10.222.0.50 () {58 vars in 1236 bytes} [Sat Sep 24 05:02:19 2022] GET /compute/v2.1/servers/b2daebb8-dfea-4ab9-8253-008a21f906e1 => generated 1363 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 05:02:19.344964 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-6f8a0380-58d5-4b0f-84c6-78ceb499ea6d tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Calling method '>' {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:02:19.345560 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.compute.api [None req-6f8a0380-58d5-4b0f-84c6-78ceb499ea6d tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] [instance: 08fb826b-e891-46c4-990d-ca03cf3f4222] Fetching instance by UUID {{(pid=120593) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:02:19.349186 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [None req-0860f18d-9ec2-4633-bc69-ad40d9034f38 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] 10.222.0.50 "GET /compute/v2.1/servers/201433d5-db4e-4e57-a800-42fe5cfc95ca" status: 200 len: 1367 microversion: 2.1 time: 0.221135 Sep 24 05:02:19.350586 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 167/305] 10.222.0.50 () {58 vars in 1236 bytes} [Sat Sep 24 05:02:19 2022] GET /compute/v2.1/servers/201433d5-db4e-4e57-a800-42fe5cfc95ca => generated 1367 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 24 05:02:19.351492 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-6f8a0380-58d5-4b0f-84c6-78ceb499ea6d tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:02:19.351971 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-6f8a0380-58d5-4b0f-84c6-78ceb499ea6d tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:02:19.352399 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-6f8a0380-58d5-4b0f-84c6-78ceb499ea6d tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:02:19.353087 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-6f8a0380-58d5-4b0f-84c6-78ceb499ea6d tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:02:19.353528 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-6f8a0380-58d5-4b0f-84c6-78ceb499ea6d tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:02:19.353933 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-6f8a0380-58d5-4b0f-84c6-78ceb499ea6d tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:02:19.397049 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-b7af6b27-6f7b-4bc0-9c4b-60dcee54c9de tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Calling method '>' {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:02:19.397635 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.compute.api [None req-b7af6b27-6f7b-4bc0-9c4b-60dcee54c9de tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] [instance: 50eed27b-6da2-4dda-94cc-02fc5cfec071] Fetching instance by UUID {{(pid=120594) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:02:19.404995 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-b7af6b27-6f7b-4bc0-9c4b-60dcee54c9de tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:02:19.406090 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-b7af6b27-6f7b-4bc0-9c4b-60dcee54c9de tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:02:19.406531 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-b7af6b27-6f7b-4bc0-9c4b-60dcee54c9de tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:02:19.407220 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-b7af6b27-6f7b-4bc0-9c4b-60dcee54c9de tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:02:19.407667 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-b7af6b27-6f7b-4bc0-9c4b-60dcee54c9de tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:02:19.408146 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-b7af6b27-6f7b-4bc0-9c4b-60dcee54c9de tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:02:19.533004 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-6f8a0380-58d5-4b0f-84c6-78ceb499ea6d tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0948754217fc4ff2ba0241fa35feaf90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1aaf20f480a423ea5feca81585aeeed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:02:19.544737 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-6f8a0380-58d5-4b0f-84c6-78ceb499ea6d tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0948754217fc4ff2ba0241fa35feaf90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1aaf20f480a423ea5feca81585aeeed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:02:19.547099 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-6f8a0380-58d5-4b0f-84c6-78ceb499ea6d tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0948754217fc4ff2ba0241fa35feaf90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1aaf20f480a423ea5feca81585aeeed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:02:19.548440 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-6f8a0380-58d5-4b0f-84c6-78ceb499ea6d tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] 10.222.0.50 "GET /compute/v2.1/servers/08fb826b-e891-46c4-990d-ca03cf3f4222" status: 200 len: 1404 microversion: 2.20 time: 0.207639 Sep 24 05:02:19.549428 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 139/306] 10.222.0.50 () {60 vars in 1277 bytes} [Sat Sep 24 05:02:19 2022] GET /compute/v2.1/servers/08fb826b-e891-46c4-990d-ca03cf3f4222 => generated 1404 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 05:02:19.592163 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.policy [None req-b7af6b27-6f7b-4bc0-9c4b-60dcee54c9de tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cdd0da2c7bc4139bcd48ef36a2ee183', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a18a3756ba2b460d977f738a115ebfe0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:02:19.600143 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [None req-b7af6b27-6f7b-4bc0-9c4b-60dcee54c9de tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] 10.222.0.50 "GET /compute/v2.1/servers/50eed27b-6da2-4dda-94cc-02fc5cfec071" status: 200 len: 1522 microversion: 2.1 time: 0.208041 Sep 24 05:02:19.600719 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 168/307] 10.222.0.50 () {58 vars in 1236 bytes} [Sat Sep 24 05:02:19 2022] GET /compute/v2.1/servers/50eed27b-6da2-4dda-94cc-02fc5cfec071 => generated 1522 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 24 05:02:20.362297 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-cd5f8211-d8e4-474b-bc9d-db77c0525aa9 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Calling method '>' {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:02:20.362890 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.compute.api [None req-cd5f8211-d8e4-474b-bc9d-db77c0525aa9 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] [instance: b2daebb8-dfea-4ab9-8253-008a21f906e1] Fetching instance by UUID {{(pid=120593) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:02:20.372604 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-cd5f8211-d8e4-474b-bc9d-db77c0525aa9 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:02:20.373089 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-cd5f8211-d8e4-474b-bc9d-db77c0525aa9 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:02:20.373472 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-fd405fae-5037-4aac-bd8c-9280d96cbecf tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Calling method '>' {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:02:20.373943 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-cd5f8211-d8e4-474b-bc9d-db77c0525aa9 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:02:20.374674 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.compute.api [None req-fd405fae-5037-4aac-bd8c-9280d96cbecf tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] [instance: 201433d5-db4e-4e57-a800-42fe5cfc95ca] Fetching instance by UUID {{(pid=120594) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:02:20.374909 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-cd5f8211-d8e4-474b-bc9d-db77c0525aa9 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:02:20.375368 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-cd5f8211-d8e4-474b-bc9d-db77c0525aa9 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:02:20.375991 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-cd5f8211-d8e4-474b-bc9d-db77c0525aa9 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:02:20.389143 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-fd405fae-5037-4aac-bd8c-9280d96cbecf tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:02:20.390945 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-fd405fae-5037-4aac-bd8c-9280d96cbecf tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:02:20.391521 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-fd405fae-5037-4aac-bd8c-9280d96cbecf tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:02:20.392739 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-fd405fae-5037-4aac-bd8c-9280d96cbecf tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:02:20.392739 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-fd405fae-5037-4aac-bd8c-9280d96cbecf tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:02:20.393187 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-fd405fae-5037-4aac-bd8c-9280d96cbecf tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:02:20.599812 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-cd5f8211-d8e4-474b-bc9d-db77c0525aa9 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b1b0448e7f54e3aaae49e411699269e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66ec8bde739145dda504995dbea0914a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:02:20.602033 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.policy [None req-fd405fae-5037-4aac-bd8c-9280d96cbecf tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74a8cc19ab204424ab23c62915ac2bab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87d5229e39fe4817b5187068d8acecc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:02:20.607981 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-cd5f8211-d8e4-474b-bc9d-db77c0525aa9 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] 10.222.0.50 "GET /compute/v2.1/servers/b2daebb8-dfea-4ab9-8253-008a21f906e1" status: 200 len: 1363 microversion: 2.1 time: 0.250715 Sep 24 05:02:20.608647 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 140/308] 10.222.0.50 () {58 vars in 1236 bytes} [Sat Sep 24 05:02:20 2022] GET /compute/v2.1/servers/b2daebb8-dfea-4ab9-8253-008a21f906e1 => generated 1363 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 05:02:20.610775 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [None req-fd405fae-5037-4aac-bd8c-9280d96cbecf tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] 10.222.0.50 "GET /compute/v2.1/servers/201433d5-db4e-4e57-a800-42fe5cfc95ca" status: 200 len: 1367 microversion: 2.1 time: 0.241723 Sep 24 05:02:20.611499 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 169/309] 10.222.0.50 () {58 vars in 1236 bytes} [Sat Sep 24 05:02:20 2022] GET /compute/v2.1/servers/201433d5-db4e-4e57-a800-42fe5cfc95ca => generated 1367 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 24 05:02:20.624858 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-15775ebe-39b3-405f-bf82-6fc04d2beed3 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Calling method '>' {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:02:20.624858 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.compute.api [None req-15775ebe-39b3-405f-bf82-6fc04d2beed3 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] [instance: 08fb826b-e891-46c4-990d-ca03cf3f4222] Fetching instance by UUID {{(pid=120593) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:02:20.624858 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-15775ebe-39b3-405f-bf82-6fc04d2beed3 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:02:20.624858 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-15775ebe-39b3-405f-bf82-6fc04d2beed3 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:02:20.625184 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-15775ebe-39b3-405f-bf82-6fc04d2beed3 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:02:20.625184 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-15775ebe-39b3-405f-bf82-6fc04d2beed3 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:02:20.625184 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-15775ebe-39b3-405f-bf82-6fc04d2beed3 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:02:20.625184 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-15775ebe-39b3-405f-bf82-6fc04d2beed3 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:02:20.634836 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-b29d2691-54f2-4caf-ae7f-a8606b16b17d tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Calling method '>' {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:02:20.635417 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.compute.api [None req-b29d2691-54f2-4caf-ae7f-a8606b16b17d tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] [instance: 50eed27b-6da2-4dda-94cc-02fc5cfec071] Fetching instance by UUID {{(pid=120594) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:02:20.642315 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-b29d2691-54f2-4caf-ae7f-a8606b16b17d tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:02:20.642800 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-b29d2691-54f2-4caf-ae7f-a8606b16b17d tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:02:20.643234 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-b29d2691-54f2-4caf-ae7f-a8606b16b17d tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:02:20.643926 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-b29d2691-54f2-4caf-ae7f-a8606b16b17d tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:02:20.644378 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-b29d2691-54f2-4caf-ae7f-a8606b16b17d tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:02:20.644796 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-b29d2691-54f2-4caf-ae7f-a8606b16b17d tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:02:20.828248 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-15775ebe-39b3-405f-bf82-6fc04d2beed3 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0948754217fc4ff2ba0241fa35feaf90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1aaf20f480a423ea5feca81585aeeed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:02:20.836495 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-15775ebe-39b3-405f-bf82-6fc04d2beed3 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0948754217fc4ff2ba0241fa35feaf90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1aaf20f480a423ea5feca81585aeeed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:02:20.837881 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-15775ebe-39b3-405f-bf82-6fc04d2beed3 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0948754217fc4ff2ba0241fa35feaf90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1aaf20f480a423ea5feca81585aeeed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:02:20.839048 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-15775ebe-39b3-405f-bf82-6fc04d2beed3 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] 10.222.0.50 "GET /compute/v2.1/servers/08fb826b-e891-46c4-990d-ca03cf3f4222" status: 200 len: 1596 microversion: 2.20 time: 0.229301 Sep 24 05:02:20.839981 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 141/310] 10.222.0.50 () {60 vars in 1277 bytes} [Sat Sep 24 05:02:20 2022] GET /compute/v2.1/servers/08fb826b-e891-46c4-990d-ca03cf3f4222 => generated 1596 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 05:02:20.844016 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.policy [None req-b29d2691-54f2-4caf-ae7f-a8606b16b17d tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cdd0da2c7bc4139bcd48ef36a2ee183', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a18a3756ba2b460d977f738a115ebfe0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:02:20.854662 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [None req-b29d2691-54f2-4caf-ae7f-a8606b16b17d tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] 10.222.0.50 "GET /compute/v2.1/servers/50eed27b-6da2-4dda-94cc-02fc5cfec071" status: 200 len: 1522 microversion: 2.1 time: 0.223492 Sep 24 05:02:20.855788 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 170/311] 10.222.0.50 () {58 vars in 1236 bytes} [Sat Sep 24 05:02:20 2022] GET /compute/v2.1/servers/50eed27b-6da2-4dda-94cc-02fc5cfec071 => generated 1522 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 05:02:20.868204 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-647efaa1-995c-4c56-b922-bd3e362ace59 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Calling method '>' {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:02:20.868949 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.compute.api [None req-647efaa1-995c-4c56-b922-bd3e362ace59 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] [instance: 08fb826b-e891-46c4-990d-ca03cf3f4222] Fetching instance by UUID {{(pid=120593) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:02:20.877113 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-647efaa1-995c-4c56-b922-bd3e362ace59 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:02:20.877599 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-647efaa1-995c-4c56-b922-bd3e362ace59 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:02:20.878079 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-647efaa1-995c-4c56-b922-bd3e362ace59 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:02:20.879335 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-647efaa1-995c-4c56-b922-bd3e362ace59 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:02:20.879896 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-647efaa1-995c-4c56-b922-bd3e362ace59 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:02:20.880316 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-647efaa1-995c-4c56-b922-bd3e362ace59 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:02:20.970549 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-647efaa1-995c-4c56-b922-bd3e362ace59 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] 10.222.0.50 "GET /compute/v2.1/servers/08fb826b-e891-46c4-990d-ca03cf3f4222/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.108822 Sep 24 05:02:20.971146 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 142/312] 10.222.0.50 () {60 vars in 1316 bytes} [Sat Sep 24 05:02:20 2022] GET /compute/v2.1/servers/08fb826b-e891-46c4-990d-ca03cf3f4222/os-interface => generated 284 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 24 05:02:21.631725 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-f41d6167-8b46-48f9-8e95-e4c117c3be33 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Calling method '>' {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:02:21.632453 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.compute.api [None req-f41d6167-8b46-48f9-8e95-e4c117c3be33 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] [instance: b2daebb8-dfea-4ab9-8253-008a21f906e1] Fetching instance by UUID {{(pid=120594) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:02:21.637214 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-ff60ae4b-362a-4e80-9593-95929fa3b694 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Calling method '>' {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:02:21.637640 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.compute.api [None req-ff60ae4b-362a-4e80-9593-95929fa3b694 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] [instance: 201433d5-db4e-4e57-a800-42fe5cfc95ca] Fetching instance by UUID {{(pid=120593) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:02:21.638629 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-f41d6167-8b46-48f9-8e95-e4c117c3be33 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:02:21.639111 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-f41d6167-8b46-48f9-8e95-e4c117c3be33 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:02:21.640356 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-f41d6167-8b46-48f9-8e95-e4c117c3be33 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:02:21.641305 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-f41d6167-8b46-48f9-8e95-e4c117c3be33 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:02:21.641750 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-f41d6167-8b46-48f9-8e95-e4c117c3be33 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:02:21.642246 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-f41d6167-8b46-48f9-8e95-e4c117c3be33 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:02:21.644230 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-ff60ae4b-362a-4e80-9593-95929fa3b694 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:02:21.644884 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-ff60ae4b-362a-4e80-9593-95929fa3b694 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:02:21.645324 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-ff60ae4b-362a-4e80-9593-95929fa3b694 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:02:21.648025 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-ff60ae4b-362a-4e80-9593-95929fa3b694 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:02:21.648529 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-ff60ae4b-362a-4e80-9593-95929fa3b694 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:02:21.648958 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-ff60ae4b-362a-4e80-9593-95929fa3b694 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:02:21.846046 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.policy [None req-f41d6167-8b46-48f9-8e95-e4c117c3be33 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b1b0448e7f54e3aaae49e411699269e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66ec8bde739145dda504995dbea0914a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:02:21.849826 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-ff60ae4b-362a-4e80-9593-95929fa3b694 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74a8cc19ab204424ab23c62915ac2bab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87d5229e39fe4817b5187068d8acecc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:02:21.854029 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [None req-f41d6167-8b46-48f9-8e95-e4c117c3be33 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] 10.222.0.50 "GET /compute/v2.1/servers/b2daebb8-dfea-4ab9-8253-008a21f906e1" status: 200 len: 1363 microversion: 2.1 time: 0.226655 Sep 24 05:02:21.854611 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 171/313] 10.222.0.50 () {58 vars in 1236 bytes} [Sat Sep 24 05:02:21 2022] GET /compute/v2.1/servers/b2daebb8-dfea-4ab9-8253-008a21f906e1 => generated 1363 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 05:02:21.857958 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-ff60ae4b-362a-4e80-9593-95929fa3b694 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] 10.222.0.50 "GET /compute/v2.1/servers/201433d5-db4e-4e57-a800-42fe5cfc95ca" status: 200 len: 1367 microversion: 2.1 time: 0.225530 Sep 24 05:02:21.859083 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 143/314] 10.222.0.50 () {58 vars in 1236 bytes} [Sat Sep 24 05:02:21 2022] GET /compute/v2.1/servers/201433d5-db4e-4e57-a800-42fe5cfc95ca => generated 1367 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 24 05:02:21.878921 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-803aff7e-efdc-40a9-9256-38f4333a6b97 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Calling method '>' {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:02:21.879527 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.compute.api [None req-803aff7e-efdc-40a9-9256-38f4333a6b97 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] [instance: 50eed27b-6da2-4dda-94cc-02fc5cfec071] Fetching instance by UUID {{(pid=120594) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:02:21.885385 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-803aff7e-efdc-40a9-9256-38f4333a6b97 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:02:21.885862 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-803aff7e-efdc-40a9-9256-38f4333a6b97 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:02:21.886353 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-803aff7e-efdc-40a9-9256-38f4333a6b97 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:02:21.887027 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-803aff7e-efdc-40a9-9256-38f4333a6b97 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:02:21.887475 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-803aff7e-efdc-40a9-9256-38f4333a6b97 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:02:21.887887 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-803aff7e-efdc-40a9-9256-38f4333a6b97 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:02:22.014796 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.policy [None req-803aff7e-efdc-40a9-9256-38f4333a6b97 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cdd0da2c7bc4139bcd48ef36a2ee183', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a18a3756ba2b460d977f738a115ebfe0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:02:22.022689 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [None req-803aff7e-efdc-40a9-9256-38f4333a6b97 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] 10.222.0.50 "GET /compute/v2.1/servers/50eed27b-6da2-4dda-94cc-02fc5cfec071" status: 200 len: 1522 microversion: 2.1 time: 0.148398 Sep 24 05:02:22.023245 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 172/315] 10.222.0.50 () {58 vars in 1236 bytes} [Sat Sep 24 05:02:21 2022] GET /compute/v2.1/servers/50eed27b-6da2-4dda-94cc-02fc5cfec071 => generated 1522 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 05:02:22.343588 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [req-42bc15af-6381-48b4-b7cd-a600f65b3c03 req-28fe1c17-2c80-45ff-bf8a-6e196b676945 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "08fb826b-e891-46c4-990d-ca03cf3f4222", "tag": "4de1eabe-932e-4cda-804d-49eeff37c34c"}]} {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 05:02:22.353058 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [req-42bc15af-6381-48b4-b7cd-a600f65b3c03 req-28fe1c17-2c80-45ff-bf8a-6e196b676945 service nova] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:02:22.353620 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [req-42bc15af-6381-48b4-b7cd-a600f65b3c03 req-28fe1c17-2c80-45ff-bf8a-6e196b676945 service nova] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:02:22.354145 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [req-42bc15af-6381-48b4-b7cd-a600f65b3c03 req-28fe1c17-2c80-45ff-bf8a-6e196b676945 service nova] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:02:22.365600 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.compute.server_external_events [req-42bc15af-6381-48b4-b7cd-a600f65b3c03 req-28fe1c17-2c80-45ff-bf8a-6e196b676945 service nova] Creating event network-changed:4de1eabe-932e-4cda-804d-49eeff37c34c for instance 08fb826b-e891-46c4-990d-ca03cf3f4222 on hv-cinder-85918 Sep 24 05:02:22.371089 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [req-42bc15af-6381-48b4-b7cd-a600f65b3c03 req-28fe1c17-2c80-45ff-bf8a-6e196b676945 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031831 Sep 24 05:02:22.371680 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 144/316] 10.222.0.50 () {64 vars in 1317 bytes} [Sat Sep 24 05:02:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 05:02:22.877142 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-5b333274-bf82-4cac-ac12-ec36e4e5115d tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Calling method '>' {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:02:22.878548 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.compute.api [None req-5b333274-bf82-4cac-ac12-ec36e4e5115d tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] [instance: b2daebb8-dfea-4ab9-8253-008a21f906e1] Fetching instance by UUID {{(pid=120594) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:02:22.881398 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-8d11ce46-1dd1-451c-814a-69f925a62ea0 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Calling method '>' {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:02:22.882124 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.compute.api [None req-8d11ce46-1dd1-451c-814a-69f925a62ea0 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] [instance: 201433d5-db4e-4e57-a800-42fe5cfc95ca] Fetching instance by UUID {{(pid=120593) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:02:22.884849 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-5b333274-bf82-4cac-ac12-ec36e4e5115d tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:02:22.885329 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-5b333274-bf82-4cac-ac12-ec36e4e5115d tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:02:22.885763 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-5b333274-bf82-4cac-ac12-ec36e4e5115d tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:02:22.886468 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-5b333274-bf82-4cac-ac12-ec36e4e5115d tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:02:22.886911 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-5b333274-bf82-4cac-ac12-ec36e4e5115d tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:02:22.887416 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-5b333274-bf82-4cac-ac12-ec36e4e5115d tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:02:22.889025 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-8d11ce46-1dd1-451c-814a-69f925a62ea0 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:02:22.889503 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-8d11ce46-1dd1-451c-814a-69f925a62ea0 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:02:22.890149 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-8d11ce46-1dd1-451c-814a-69f925a62ea0 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:02:22.891096 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-8d11ce46-1dd1-451c-814a-69f925a62ea0 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:02:22.891553 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-8d11ce46-1dd1-451c-814a-69f925a62ea0 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:02:22.891976 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-8d11ce46-1dd1-451c-814a-69f925a62ea0 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:02:23.077788 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.policy [None req-5b333274-bf82-4cac-ac12-ec36e4e5115d tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b1b0448e7f54e3aaae49e411699269e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66ec8bde739145dda504995dbea0914a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:02:23.085892 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [None req-5b333274-bf82-4cac-ac12-ec36e4e5115d tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] 10.222.0.50 "GET /compute/v2.1/servers/b2daebb8-dfea-4ab9-8253-008a21f906e1" status: 200 len: 1363 microversion: 2.1 time: 0.212487 Sep 24 05:02:23.091173 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 173/317] 10.222.0.50 () {58 vars in 1236 bytes} [Sat Sep 24 05:02:22 2022] GET /compute/v2.1/servers/b2daebb8-dfea-4ab9-8253-008a21f906e1 => generated 1363 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 05:02:23.096843 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-d611886f-02ba-4d27-af96-b7d3a651dc97 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Calling method '>' {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:02:23.097576 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.compute.api [None req-d611886f-02ba-4d27-af96-b7d3a651dc97 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] [instance: 50eed27b-6da2-4dda-94cc-02fc5cfec071] Fetching instance by UUID {{(pid=120594) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:02:23.100429 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-8d11ce46-1dd1-451c-814a-69f925a62ea0 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74a8cc19ab204424ab23c62915ac2bab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87d5229e39fe4817b5187068d8acecc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:02:23.103680 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-d611886f-02ba-4d27-af96-b7d3a651dc97 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:02:23.104429 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-d611886f-02ba-4d27-af96-b7d3a651dc97 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:02:23.105081 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-d611886f-02ba-4d27-af96-b7d3a651dc97 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:02:23.106052 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-d611886f-02ba-4d27-af96-b7d3a651dc97 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:02:23.107083 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-d611886f-02ba-4d27-af96-b7d3a651dc97 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:02:23.108143 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-d611886f-02ba-4d27-af96-b7d3a651dc97 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:02:23.110764 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-8d11ce46-1dd1-451c-814a-69f925a62ea0 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] 10.222.0.50 "GET /compute/v2.1/servers/201433d5-db4e-4e57-a800-42fe5cfc95ca" status: 200 len: 1367 microversion: 2.1 time: 0.233418 Sep 24 05:02:23.111906 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 145/318] 10.222.0.50 () {58 vars in 1236 bytes} [Sat Sep 24 05:02:22 2022] GET /compute/v2.1/servers/201433d5-db4e-4e57-a800-42fe5cfc95ca => generated 1367 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 24 05:02:23.253184 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.policy [None req-d611886f-02ba-4d27-af96-b7d3a651dc97 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cdd0da2c7bc4139bcd48ef36a2ee183', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a18a3756ba2b460d977f738a115ebfe0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:02:23.261008 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [None req-d611886f-02ba-4d27-af96-b7d3a651dc97 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] 10.222.0.50 "GET /compute/v2.1/servers/50eed27b-6da2-4dda-94cc-02fc5cfec071" status: 200 len: 1522 microversion: 2.1 time: 0.168494 Sep 24 05:02:23.261592 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 174/319] 10.222.0.50 () {58 vars in 1236 bytes} [Sat Sep 24 05:02:23 2022] GET /compute/v2.1/servers/50eed27b-6da2-4dda-94cc-02fc5cfec071 => generated 1522 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 05:02:24.108938 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-26d8358a-31bc-4281-9591-d514cfd60b8f tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Calling method '>' {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:02:24.109542 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.compute.api [None req-26d8358a-31bc-4281-9591-d514cfd60b8f tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] [instance: b2daebb8-dfea-4ab9-8253-008a21f906e1] Fetching instance by UUID {{(pid=120593) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:02:24.116224 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-26d8358a-31bc-4281-9591-d514cfd60b8f tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:02:24.116703 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-26d8358a-31bc-4281-9591-d514cfd60b8f tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:02:24.117134 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-26d8358a-31bc-4281-9591-d514cfd60b8f tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:02:24.117824 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-26d8358a-31bc-4281-9591-d514cfd60b8f tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:02:24.118295 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-26d8358a-31bc-4281-9591-d514cfd60b8f tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:02:24.118718 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-26d8358a-31bc-4281-9591-d514cfd60b8f tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:02:24.132900 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-f1f6281c-cdbc-4464-8ba1-3110640eedac tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Calling method '>' {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:02:24.133604 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.compute.api [None req-f1f6281c-cdbc-4464-8ba1-3110640eedac tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] [instance: 201433d5-db4e-4e57-a800-42fe5cfc95ca] Fetching instance by UUID {{(pid=120594) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:02:24.140096 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-f1f6281c-cdbc-4464-8ba1-3110640eedac tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:02:24.140587 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-f1f6281c-cdbc-4464-8ba1-3110640eedac tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:02:24.141265 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-f1f6281c-cdbc-4464-8ba1-3110640eedac tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:02:24.141957 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-f1f6281c-cdbc-4464-8ba1-3110640eedac tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:02:24.142435 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-f1f6281c-cdbc-4464-8ba1-3110640eedac tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:02:24.142856 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-f1f6281c-cdbc-4464-8ba1-3110640eedac tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:02:24.332977 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.policy [None req-f1f6281c-cdbc-4464-8ba1-3110640eedac tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74a8cc19ab204424ab23c62915ac2bab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87d5229e39fe4817b5187068d8acecc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:02:24.336152 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-26d8358a-31bc-4281-9591-d514cfd60b8f tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b1b0448e7f54e3aaae49e411699269e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66ec8bde739145dda504995dbea0914a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:02:24.340706 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [None req-f1f6281c-cdbc-4464-8ba1-3110640eedac tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] 10.222.0.50 "GET /compute/v2.1/servers/201433d5-db4e-4e57-a800-42fe5cfc95ca" status: 200 len: 1367 microversion: 2.1 time: 0.211690 Sep 24 05:02:24.341214 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 175/320] 10.222.0.50 () {58 vars in 1236 bytes} [Sat Sep 24 05:02:24 2022] GET /compute/v2.1/servers/201433d5-db4e-4e57-a800-42fe5cfc95ca => generated 1367 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 24 05:02:24.344455 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-26d8358a-31bc-4281-9591-d514cfd60b8f tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] 10.222.0.50 "GET /compute/v2.1/servers/b2daebb8-dfea-4ab9-8253-008a21f906e1" status: 200 len: 1363 microversion: 2.1 time: 0.239578 Sep 24 05:02:24.345004 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 146/321] 10.222.0.50 () {58 vars in 1236 bytes} [Sat Sep 24 05:02:24 2022] GET /compute/v2.1/servers/b2daebb8-dfea-4ab9-8253-008a21f906e1 => generated 1363 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 05:02:24.346228 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-5552bdf1-5112-40fc-ab3b-924552f5d2e9 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Calling method '>' {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:02:24.346830 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.compute.api [None req-5552bdf1-5112-40fc-ab3b-924552f5d2e9 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] [instance: 50eed27b-6da2-4dda-94cc-02fc5cfec071] Fetching instance by UUID {{(pid=120594) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:02:24.352484 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-5552bdf1-5112-40fc-ab3b-924552f5d2e9 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:02:24.353034 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-5552bdf1-5112-40fc-ab3b-924552f5d2e9 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:02:24.353553 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-5552bdf1-5112-40fc-ab3b-924552f5d2e9 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:02:24.354346 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-5552bdf1-5112-40fc-ab3b-924552f5d2e9 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:02:24.355000 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-5552bdf1-5112-40fc-ab3b-924552f5d2e9 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:02:24.355524 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-5552bdf1-5112-40fc-ab3b-924552f5d2e9 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:02:24.360121 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG dbcounter [-] [120594] Writing DB stats nova_cell1:SELECT=100 {{(pid=120594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 05:02:24.484767 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.policy [None req-5552bdf1-5112-40fc-ab3b-924552f5d2e9 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cdd0da2c7bc4139bcd48ef36a2ee183', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a18a3756ba2b460d977f738a115ebfe0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:02:24.492320 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [None req-5552bdf1-5112-40fc-ab3b-924552f5d2e9 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] 10.222.0.50 "GET /compute/v2.1/servers/50eed27b-6da2-4dda-94cc-02fc5cfec071" status: 200 len: 1522 microversion: 2.1 time: 0.150165 Sep 24 05:02:24.492883 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 176/322] 10.222.0.50 () {58 vars in 1236 bytes} [Sat Sep 24 05:02:24 2022] GET /compute/v2.1/servers/50eed27b-6da2-4dda-94cc-02fc5cfec071 => generated 1522 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 05:02:25.364436 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-ee5d1dab-c4d3-4571-aed9-9d5a8f10f555 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Calling method '>' {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:02:25.365033 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.compute.api [None req-ee5d1dab-c4d3-4571-aed9-9d5a8f10f555 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] [instance: 201433d5-db4e-4e57-a800-42fe5cfc95ca] Fetching instance by UUID {{(pid=120593) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:02:25.367157 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-534bedfd-687f-4c92-9766-e92f4624458a tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Calling method '>' {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:02:25.367894 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.compute.api [None req-534bedfd-687f-4c92-9766-e92f4624458a tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] [instance: b2daebb8-dfea-4ab9-8253-008a21f906e1] Fetching instance by UUID {{(pid=120594) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:02:25.371517 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-ee5d1dab-c4d3-4571-aed9-9d5a8f10f555 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:02:25.371997 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-ee5d1dab-c4d3-4571-aed9-9d5a8f10f555 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:02:25.372428 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-ee5d1dab-c4d3-4571-aed9-9d5a8f10f555 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:02:25.373113 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-ee5d1dab-c4d3-4571-aed9-9d5a8f10f555 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:02:25.373564 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-ee5d1dab-c4d3-4571-aed9-9d5a8f10f555 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:02:25.374005 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-ee5d1dab-c4d3-4571-aed9-9d5a8f10f555 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:02:25.374113 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-534bedfd-687f-4c92-9766-e92f4624458a tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:02:25.374593 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-534bedfd-687f-4c92-9766-e92f4624458a tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:02:25.375027 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-534bedfd-687f-4c92-9766-e92f4624458a tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:02:25.375707 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-534bedfd-687f-4c92-9766-e92f4624458a tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:02:25.376155 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-534bedfd-687f-4c92-9766-e92f4624458a tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:02:25.376576 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-534bedfd-687f-4c92-9766-e92f4624458a tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:02:25.570546 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.policy [None req-534bedfd-687f-4c92-9766-e92f4624458a tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b1b0448e7f54e3aaae49e411699269e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66ec8bde739145dda504995dbea0914a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:02:25.573482 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-ee5d1dab-c4d3-4571-aed9-9d5a8f10f555 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74a8cc19ab204424ab23c62915ac2bab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87d5229e39fe4817b5187068d8acecc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:02:25.578437 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [None req-534bedfd-687f-4c92-9766-e92f4624458a tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] 10.222.0.50 "GET /compute/v2.1/servers/b2daebb8-dfea-4ab9-8253-008a21f906e1" status: 200 len: 1363 microversion: 2.1 time: 0.215087 Sep 24 05:02:25.579115 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 177/323] 10.222.0.50 () {58 vars in 1236 bytes} [Sat Sep 24 05:02:25 2022] GET /compute/v2.1/servers/b2daebb8-dfea-4ab9-8253-008a21f906e1 => generated 1363 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 24 05:02:25.581046 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-ee5d1dab-c4d3-4571-aed9-9d5a8f10f555 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] 10.222.0.50 "GET /compute/v2.1/servers/201433d5-db4e-4e57-a800-42fe5cfc95ca" status: 200 len: 1367 microversion: 2.1 time: 0.220418 Sep 24 05:02:25.581599 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 147/324] 10.222.0.50 () {58 vars in 1236 bytes} [Sat Sep 24 05:02:25 2022] GET /compute/v2.1/servers/201433d5-db4e-4e57-a800-42fe5cfc95ca => generated 1367 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 05:02:25.583686 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-553b39b3-a543-4ac1-b777-edd6bb4d29b6 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Calling method '>' {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:02:25.584387 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.compute.api [None req-553b39b3-a543-4ac1-b777-edd6bb4d29b6 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] [instance: 50eed27b-6da2-4dda-94cc-02fc5cfec071] Fetching instance by UUID {{(pid=120594) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:02:25.590108 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-553b39b3-a543-4ac1-b777-edd6bb4d29b6 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:02:25.590776 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-553b39b3-a543-4ac1-b777-edd6bb4d29b6 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:02:25.591277 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-553b39b3-a543-4ac1-b777-edd6bb4d29b6 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:02:25.592045 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-553b39b3-a543-4ac1-b777-edd6bb4d29b6 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:02:25.592562 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-553b39b3-a543-4ac1-b777-edd6bb4d29b6 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:02:25.593053 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-553b39b3-a543-4ac1-b777-edd6bb4d29b6 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:02:25.718794 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.policy [None req-553b39b3-a543-4ac1-b777-edd6bb4d29b6 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cdd0da2c7bc4139bcd48ef36a2ee183', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a18a3756ba2b460d977f738a115ebfe0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:02:25.726224 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [None req-553b39b3-a543-4ac1-b777-edd6bb4d29b6 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] 10.222.0.50 "GET /compute/v2.1/servers/50eed27b-6da2-4dda-94cc-02fc5cfec071" status: 200 len: 1522 microversion: 2.1 time: 0.146090 Sep 24 05:02:25.726775 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 178/325] 10.222.0.50 () {58 vars in 1236 bytes} [Sat Sep 24 05:02:25 2022] GET /compute/v2.1/servers/50eed27b-6da2-4dda-94cc-02fc5cfec071 => generated 1522 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 05:02:26.601330 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-ed23bcc4-31f8-4493-ae98-89d8634783a4 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Calling method '>' {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:02:26.601941 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.compute.api [None req-ed23bcc4-31f8-4493-ae98-89d8634783a4 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] [instance: b2daebb8-dfea-4ab9-8253-008a21f906e1] Fetching instance by UUID {{(pid=120593) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:02:26.603172 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-2bf35c7c-32dd-4e17-8cff-6b5da9f87072 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Calling method '>' {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:02:26.603991 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.compute.api [None req-2bf35c7c-32dd-4e17-8cff-6b5da9f87072 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] [instance: 201433d5-db4e-4e57-a800-42fe5cfc95ca] Fetching instance by UUID {{(pid=120594) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:02:26.608085 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-ed23bcc4-31f8-4493-ae98-89d8634783a4 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:02:26.608612 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-ed23bcc4-31f8-4493-ae98-89d8634783a4 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:02:26.609042 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-ed23bcc4-31f8-4493-ae98-89d8634783a4 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:02:26.609722 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-ed23bcc4-31f8-4493-ae98-89d8634783a4 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:02:26.609934 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-2bf35c7c-32dd-4e17-8cff-6b5da9f87072 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:02:26.610196 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-ed23bcc4-31f8-4493-ae98-89d8634783a4 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:02:26.610458 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-2bf35c7c-32dd-4e17-8cff-6b5da9f87072 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:02:26.610613 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-ed23bcc4-31f8-4493-ae98-89d8634783a4 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:02:26.610937 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-2bf35c7c-32dd-4e17-8cff-6b5da9f87072 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:02:26.611628 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-2bf35c7c-32dd-4e17-8cff-6b5da9f87072 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:02:26.612080 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-2bf35c7c-32dd-4e17-8cff-6b5da9f87072 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:02:26.612500 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-2bf35c7c-32dd-4e17-8cff-6b5da9f87072 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:02:26.849258 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-ed23bcc4-31f8-4493-ae98-89d8634783a4 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b1b0448e7f54e3aaae49e411699269e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66ec8bde739145dda504995dbea0914a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:02:26.859086 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.policy [None req-2bf35c7c-32dd-4e17-8cff-6b5da9f87072 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74a8cc19ab204424ab23c62915ac2bab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87d5229e39fe4817b5187068d8acecc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:02:26.861546 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-ed23bcc4-31f8-4493-ae98-89d8634783a4 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] 10.222.0.50 "GET /compute/v2.1/servers/b2daebb8-dfea-4ab9-8253-008a21f906e1" status: 200 len: 1363 microversion: 2.1 time: 0.263977 Sep 24 05:02:26.862574 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 148/326] 10.222.0.50 () {58 vars in 1236 bytes} [Sat Sep 24 05:02:26 2022] GET /compute/v2.1/servers/b2daebb8-dfea-4ab9-8253-008a21f906e1 => generated 1363 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 24 05:02:26.867359 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-9067aaca-f291-42a9-a01c-416eb186296d tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Calling method '>' {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:02:26.872307 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.compute.api [None req-9067aaca-f291-42a9-a01c-416eb186296d tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] [instance: 50eed27b-6da2-4dda-94cc-02fc5cfec071] Fetching instance by UUID {{(pid=120593) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:02:26.875308 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [None req-2bf35c7c-32dd-4e17-8cff-6b5da9f87072 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] 10.222.0.50 "GET /compute/v2.1/servers/201433d5-db4e-4e57-a800-42fe5cfc95ca" status: 200 len: 1367 microversion: 2.1 time: 0.274688 Sep 24 05:02:26.881307 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-9067aaca-f291-42a9-a01c-416eb186296d tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:02:26.881797 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-9067aaca-f291-42a9-a01c-416eb186296d tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:02:26.882263 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-9067aaca-f291-42a9-a01c-416eb186296d tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:02:26.882960 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-9067aaca-f291-42a9-a01c-416eb186296d tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:02:26.883415 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-9067aaca-f291-42a9-a01c-416eb186296d tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:02:26.883835 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-9067aaca-f291-42a9-a01c-416eb186296d tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:02:26.888352 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 179/327] 10.222.0.50 () {58 vars in 1236 bytes} [Sat Sep 24 05:02:26 2022] GET /compute/v2.1/servers/201433d5-db4e-4e57-a800-42fe5cfc95ca => generated 1367 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 24 05:02:27.015184 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-9067aaca-f291-42a9-a01c-416eb186296d tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cdd0da2c7bc4139bcd48ef36a2ee183', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a18a3756ba2b460d977f738a115ebfe0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:02:27.023254 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-9067aaca-f291-42a9-a01c-416eb186296d tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] 10.222.0.50 "GET /compute/v2.1/servers/50eed27b-6da2-4dda-94cc-02fc5cfec071" status: 200 len: 1522 microversion: 2.1 time: 0.159730 Sep 24 05:02:27.023805 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 149/328] 10.222.0.50 () {58 vars in 1236 bytes} [Sat Sep 24 05:02:26 2022] GET /compute/v2.1/servers/50eed27b-6da2-4dda-94cc-02fc5cfec071 => generated 1522 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 05:02:27.563280 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [req-9b3f37bb-ff31-4f02-a57c-5b22ce8c6c39 req-23fa3a18-2599-462f-a68d-15b566473709 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "201433d5-db4e-4e57-a800-42fe5cfc95ca", "name": "network-vif-plugged", "status": "completed", "tag": "7efb703e-b766-4972-b442-eaba81c854e8"}]} {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 05:02:27.572769 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [req-9b3f37bb-ff31-4f02-a57c-5b22ce8c6c39 req-23fa3a18-2599-462f-a68d-15b566473709 service nova] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:02:27.573247 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [req-9b3f37bb-ff31-4f02-a57c-5b22ce8c6c39 req-23fa3a18-2599-462f-a68d-15b566473709 service nova] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:02:27.573675 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [req-9b3f37bb-ff31-4f02-a57c-5b22ce8c6c39 req-23fa3a18-2599-462f-a68d-15b566473709 service nova] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:02:27.720483 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: INFO nova.api.openstack.compute.server_external_events [req-9b3f37bb-ff31-4f02-a57c-5b22ce8c6c39 req-23fa3a18-2599-462f-a68d-15b566473709 service nova] Creating event network-vif-plugged:7efb703e-b766-4972-b442-eaba81c854e8 for instance 201433d5-db4e-4e57-a800-42fe5cfc95ca on hv-cinder-85918 Sep 24 05:02:27.725454 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [req-9b3f37bb-ff31-4f02-a57c-5b22ce8c6c39 req-23fa3a18-2599-462f-a68d-15b566473709 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.166382 Sep 24 05:02:27.726078 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 180/329] 10.222.0.50 () {64 vars in 1317 bytes} [Sat Sep 24 05:02:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 05:02:27.886393 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-958b8e81-12f2-4cf6-9abf-e5d483018880 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Calling method '>' {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:02:27.886935 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.compute.api [None req-958b8e81-12f2-4cf6-9abf-e5d483018880 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] [instance: b2daebb8-dfea-4ab9-8253-008a21f906e1] Fetching instance by UUID {{(pid=120593) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:02:27.895661 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-958b8e81-12f2-4cf6-9abf-e5d483018880 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:02:27.896393 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-958b8e81-12f2-4cf6-9abf-e5d483018880 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:02:27.897000 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-958b8e81-12f2-4cf6-9abf-e5d483018880 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:02:27.897864 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-958b8e81-12f2-4cf6-9abf-e5d483018880 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:02:27.898494 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-958b8e81-12f2-4cf6-9abf-e5d483018880 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:02:27.899065 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-958b8e81-12f2-4cf6-9abf-e5d483018880 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:02:27.912642 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-84501a82-d68a-4280-98e3-4bf448b95423 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Calling method '>' {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:02:27.917122 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.compute.api [None req-84501a82-d68a-4280-98e3-4bf448b95423 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] [instance: 201433d5-db4e-4e57-a800-42fe5cfc95ca] Fetching instance by UUID {{(pid=120594) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:02:27.932633 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-84501a82-d68a-4280-98e3-4bf448b95423 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:02:27.933579 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-84501a82-d68a-4280-98e3-4bf448b95423 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:02:27.934118 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-84501a82-d68a-4280-98e3-4bf448b95423 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:02:27.936253 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-84501a82-d68a-4280-98e3-4bf448b95423 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:02:27.936809 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-84501a82-d68a-4280-98e3-4bf448b95423 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:02:27.938619 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-84501a82-d68a-4280-98e3-4bf448b95423 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:02:28.273370 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-958b8e81-12f2-4cf6-9abf-e5d483018880 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b1b0448e7f54e3aaae49e411699269e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66ec8bde739145dda504995dbea0914a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:02:28.281834 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-958b8e81-12f2-4cf6-9abf-e5d483018880 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] 10.222.0.50 "GET /compute/v2.1/servers/b2daebb8-dfea-4ab9-8253-008a21f906e1" status: 200 len: 1363 microversion: 2.1 time: 0.399436 Sep 24 05:02:28.286803 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 150/330] 10.222.0.50 () {58 vars in 1236 bytes} [Sat Sep 24 05:02:27 2022] GET /compute/v2.1/servers/b2daebb8-dfea-4ab9-8253-008a21f906e1 => generated 1363 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 05:02:28.289987 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.policy [None req-84501a82-d68a-4280-98e3-4bf448b95423 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74a8cc19ab204424ab23c62915ac2bab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87d5229e39fe4817b5187068d8acecc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:02:28.297853 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-fedeed1b-409d-4250-a2d1-e635cc320018 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Calling method '>' {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:02:28.298721 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.compute.api [None req-fedeed1b-409d-4250-a2d1-e635cc320018 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] [instance: 50eed27b-6da2-4dda-94cc-02fc5cfec071] Fetching instance by UUID {{(pid=120593) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:02:28.299067 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [None req-84501a82-d68a-4280-98e3-4bf448b95423 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] 10.222.0.50 "GET /compute/v2.1/servers/201433d5-db4e-4e57-a800-42fe5cfc95ca" status: 200 len: 1367 microversion: 2.1 time: 0.393404 Sep 24 05:02:28.300113 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 181/331] 10.222.0.50 () {58 vars in 1236 bytes} [Sat Sep 24 05:02:27 2022] GET /compute/v2.1/servers/201433d5-db4e-4e57-a800-42fe5cfc95ca => generated 1367 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 05:02:28.305849 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-fedeed1b-409d-4250-a2d1-e635cc320018 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:02:28.306382 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-fedeed1b-409d-4250-a2d1-e635cc320018 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:02:28.306954 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-fedeed1b-409d-4250-a2d1-e635cc320018 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:02:28.307647 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-fedeed1b-409d-4250-a2d1-e635cc320018 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:02:28.308096 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-fedeed1b-409d-4250-a2d1-e635cc320018 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:02:28.308516 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-fedeed1b-409d-4250-a2d1-e635cc320018 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:02:28.600596 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-fedeed1b-409d-4250-a2d1-e635cc320018 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cdd0da2c7bc4139bcd48ef36a2ee183', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a18a3756ba2b460d977f738a115ebfe0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:02:28.612160 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-fedeed1b-409d-4250-a2d1-e635cc320018 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] 10.222.0.50 "GET /compute/v2.1/servers/50eed27b-6da2-4dda-94cc-02fc5cfec071" status: 200 len: 1522 microversion: 2.1 time: 0.324186 Sep 24 05:02:28.614605 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 151/332] 10.222.0.50 () {58 vars in 1236 bytes} [Sat Sep 24 05:02:28 2022] GET /compute/v2.1/servers/50eed27b-6da2-4dda-94cc-02fc5cfec071 => generated 1522 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 05:02:29.305924 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-afb05b09-2d5f-43ee-be93-c6c81af67347 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Calling method '>' {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:02:29.306612 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.compute.api [None req-afb05b09-2d5f-43ee-be93-c6c81af67347 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] [instance: b2daebb8-dfea-4ab9-8253-008a21f906e1] Fetching instance by UUID {{(pid=120594) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:02:29.313027 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-afb05b09-2d5f-43ee-be93-c6c81af67347 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:02:29.313511 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-afb05b09-2d5f-43ee-be93-c6c81af67347 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:02:29.313943 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-afb05b09-2d5f-43ee-be93-c6c81af67347 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:02:29.314646 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-afb05b09-2d5f-43ee-be93-c6c81af67347 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:02:29.315093 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-afb05b09-2d5f-43ee-be93-c6c81af67347 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:02:29.315517 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-afb05b09-2d5f-43ee-be93-c6c81af67347 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:02:29.325938 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-7e471bff-3bde-4117-b8c1-c9f51065742d tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Calling method '>' {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:02:29.326611 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.compute.api [None req-7e471bff-3bde-4117-b8c1-c9f51065742d tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] [instance: 201433d5-db4e-4e57-a800-42fe5cfc95ca] Fetching instance by UUID {{(pid=120593) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:02:29.332950 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-7e471bff-3bde-4117-b8c1-c9f51065742d tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:02:29.333428 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-7e471bff-3bde-4117-b8c1-c9f51065742d tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:02:29.333855 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-7e471bff-3bde-4117-b8c1-c9f51065742d tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:02:29.334586 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-7e471bff-3bde-4117-b8c1-c9f51065742d tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:02:29.335036 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-7e471bff-3bde-4117-b8c1-c9f51065742d tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:02:29.335455 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-7e471bff-3bde-4117-b8c1-c9f51065742d tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:02:29.453477 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.policy [None req-afb05b09-2d5f-43ee-be93-c6c81af67347 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b1b0448e7f54e3aaae49e411699269e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66ec8bde739145dda504995dbea0914a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:02:29.461409 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [None req-afb05b09-2d5f-43ee-be93-c6c81af67347 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] 10.222.0.50 "GET /compute/v2.1/servers/b2daebb8-dfea-4ab9-8253-008a21f906e1" status: 200 len: 1363 microversion: 2.1 time: 0.159235 Sep 24 05:02:29.462094 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 182/333] 10.222.0.50 () {58 vars in 1236 bytes} [Sat Sep 24 05:02:29 2022] GET /compute/v2.1/servers/b2daebb8-dfea-4ab9-8253-008a21f906e1 => generated 1363 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 05:02:29.602087 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-7e471bff-3bde-4117-b8c1-c9f51065742d tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74a8cc19ab204424ab23c62915ac2bab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87d5229e39fe4817b5187068d8acecc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:02:29.610210 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-7e471bff-3bde-4117-b8c1-c9f51065742d tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] 10.222.0.50 "GET /compute/v2.1/servers/201433d5-db4e-4e57-a800-42fe5cfc95ca" status: 200 len: 1367 microversion: 2.1 time: 0.288040 Sep 24 05:02:29.610756 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 152/334] 10.222.0.50 () {58 vars in 1236 bytes} [Sat Sep 24 05:02:29 2022] GET /compute/v2.1/servers/201433d5-db4e-4e57-a800-42fe5cfc95ca => generated 1367 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 24 05:02:29.638910 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-bab22d07-e268-4352-8ae5-ecf10d1da04f tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Calling method '>' {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:02:29.639506 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.compute.api [None req-bab22d07-e268-4352-8ae5-ecf10d1da04f tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] [instance: 50eed27b-6da2-4dda-94cc-02fc5cfec071] Fetching instance by UUID {{(pid=120594) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:02:29.645560 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-bab22d07-e268-4352-8ae5-ecf10d1da04f tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:02:29.646061 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-bab22d07-e268-4352-8ae5-ecf10d1da04f tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:02:29.646493 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-bab22d07-e268-4352-8ae5-ecf10d1da04f tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:02:29.647168 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-bab22d07-e268-4352-8ae5-ecf10d1da04f tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:02:29.647616 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-bab22d07-e268-4352-8ae5-ecf10d1da04f tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:02:29.648033 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-bab22d07-e268-4352-8ae5-ecf10d1da04f tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:02:29.773738 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.policy [None req-bab22d07-e268-4352-8ae5-ecf10d1da04f tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cdd0da2c7bc4139bcd48ef36a2ee183', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a18a3756ba2b460d977f738a115ebfe0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:02:29.781466 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [None req-bab22d07-e268-4352-8ae5-ecf10d1da04f tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] 10.222.0.50 "GET /compute/v2.1/servers/50eed27b-6da2-4dda-94cc-02fc5cfec071" status: 200 len: 1522 microversion: 2.1 time: 0.146307 Sep 24 05:02:29.782053 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 183/335] 10.222.0.50 () {58 vars in 1236 bytes} [Sat Sep 24 05:02:29 2022] GET /compute/v2.1/servers/50eed27b-6da2-4dda-94cc-02fc5cfec071 => generated 1522 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 05:02:30.483165 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-103642a5-a4f7-4ccf-ab8d-2f69a2f32983 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Calling method '>' {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:02:30.484331 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.compute.api [None req-103642a5-a4f7-4ccf-ab8d-2f69a2f32983 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] [instance: b2daebb8-dfea-4ab9-8253-008a21f906e1] Fetching instance by UUID {{(pid=120593) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:02:30.490968 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-103642a5-a4f7-4ccf-ab8d-2f69a2f32983 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:02:30.491443 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-103642a5-a4f7-4ccf-ab8d-2f69a2f32983 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:02:30.491876 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-103642a5-a4f7-4ccf-ab8d-2f69a2f32983 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:02:30.492553 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-103642a5-a4f7-4ccf-ab8d-2f69a2f32983 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:02:30.493000 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-103642a5-a4f7-4ccf-ab8d-2f69a2f32983 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:02:30.493418 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-103642a5-a4f7-4ccf-ab8d-2f69a2f32983 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:02:30.623698 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-103642a5-a4f7-4ccf-ab8d-2f69a2f32983 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b1b0448e7f54e3aaae49e411699269e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66ec8bde739145dda504995dbea0914a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:02:30.631341 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-103642a5-a4f7-4ccf-ab8d-2f69a2f32983 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] 10.222.0.50 "GET /compute/v2.1/servers/b2daebb8-dfea-4ab9-8253-008a21f906e1" status: 200 len: 1363 microversion: 2.1 time: 0.151956 Sep 24 05:02:30.631893 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 153/336] 10.222.0.50 () {58 vars in 1236 bytes} [Sat Sep 24 05:02:30 2022] GET /compute/v2.1/servers/b2daebb8-dfea-4ab9-8253-008a21f906e1 => generated 1363 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 05:02:30.632504 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-0e2d5cca-2f8b-4894-8613-cd48f52f8f2c tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Calling method '>' {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:02:30.633107 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.compute.api [None req-0e2d5cca-2f8b-4894-8613-cd48f52f8f2c tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] [instance: 201433d5-db4e-4e57-a800-42fe5cfc95ca] Fetching instance by UUID {{(pid=120594) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:02:30.639138 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-0e2d5cca-2f8b-4894-8613-cd48f52f8f2c tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:02:30.639604 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-0e2d5cca-2f8b-4894-8613-cd48f52f8f2c tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:02:30.640060 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-0e2d5cca-2f8b-4894-8613-cd48f52f8f2c tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:02:30.640735 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-0e2d5cca-2f8b-4894-8613-cd48f52f8f2c tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:02:30.641430 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-0e2d5cca-2f8b-4894-8613-cd48f52f8f2c tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:02:30.641843 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-0e2d5cca-2f8b-4894-8613-cd48f52f8f2c tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:02:30.772187 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.policy [None req-0e2d5cca-2f8b-4894-8613-cd48f52f8f2c tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74a8cc19ab204424ab23c62915ac2bab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87d5229e39fe4817b5187068d8acecc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:02:30.779721 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [None req-0e2d5cca-2f8b-4894-8613-cd48f52f8f2c tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] 10.222.0.50 "GET /compute/v2.1/servers/201433d5-db4e-4e57-a800-42fe5cfc95ca" status: 200 len: 1367 microversion: 2.1 time: 0.151001 Sep 24 05:02:30.780824 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 184/337] 10.222.0.50 () {58 vars in 1236 bytes} [Sat Sep 24 05:02:30 2022] GET /compute/v2.1/servers/201433d5-db4e-4e57-a800-42fe5cfc95ca => generated 1367 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 24 05:02:30.804039 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-c617bc19-a43f-4428-a377-e2917753ea9f tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Calling method '>' {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:02:30.804651 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.compute.api [None req-c617bc19-a43f-4428-a377-e2917753ea9f tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] [instance: 50eed27b-6da2-4dda-94cc-02fc5cfec071] Fetching instance by UUID {{(pid=120593) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:02:30.810573 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-c617bc19-a43f-4428-a377-e2917753ea9f tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:02:30.811094 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-c617bc19-a43f-4428-a377-e2917753ea9f tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:02:30.811510 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-c617bc19-a43f-4428-a377-e2917753ea9f tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:02:30.812193 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-c617bc19-a43f-4428-a377-e2917753ea9f tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:02:30.812667 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-c617bc19-a43f-4428-a377-e2917753ea9f tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:02:30.813090 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-c617bc19-a43f-4428-a377-e2917753ea9f tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:02:30.817044 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG dbcounter [-] [120593] Writing DB stats nova_cell1:SELECT=100 {{(pid=120593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 05:02:30.937555 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-c617bc19-a43f-4428-a377-e2917753ea9f tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cdd0da2c7bc4139bcd48ef36a2ee183', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a18a3756ba2b460d977f738a115ebfe0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:02:30.945141 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-c617bc19-a43f-4428-a377-e2917753ea9f tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] 10.222.0.50 "GET /compute/v2.1/servers/50eed27b-6da2-4dda-94cc-02fc5cfec071" status: 200 len: 1522 microversion: 2.1 time: 0.144883 Sep 24 05:02:30.945691 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 154/338] 10.222.0.50 () {58 vars in 1236 bytes} [Sat Sep 24 05:02:30 2022] GET /compute/v2.1/servers/50eed27b-6da2-4dda-94cc-02fc5cfec071 => generated 1522 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 05:02:31.658771 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-33807d5b-0923-4062-9eec-8545887d507c tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Calling method '>' {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:02:31.658771 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.compute.api [None req-33807d5b-0923-4062-9eec-8545887d507c tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] [instance: b2daebb8-dfea-4ab9-8253-008a21f906e1] Fetching instance by UUID {{(pid=120594) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:02:31.661873 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-33807d5b-0923-4062-9eec-8545887d507c tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:02:31.662426 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-33807d5b-0923-4062-9eec-8545887d507c tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:02:31.662889 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-33807d5b-0923-4062-9eec-8545887d507c tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:02:31.663627 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-33807d5b-0923-4062-9eec-8545887d507c tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:02:31.664101 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-33807d5b-0923-4062-9eec-8545887d507c tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:02:31.664528 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-33807d5b-0923-4062-9eec-8545887d507c tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:02:31.793261 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.policy [None req-33807d5b-0923-4062-9eec-8545887d507c tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b1b0448e7f54e3aaae49e411699269e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66ec8bde739145dda504995dbea0914a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:02:31.801353 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [None req-33807d5b-0923-4062-9eec-8545887d507c tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] 10.222.0.50 "GET /compute/v2.1/servers/b2daebb8-dfea-4ab9-8253-008a21f906e1" status: 200 len: 1363 microversion: 2.1 time: 0.151149 Sep 24 05:02:31.801912 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 185/339] 10.222.0.50 () {58 vars in 1236 bytes} [Sat Sep 24 05:02:31 2022] GET /compute/v2.1/servers/b2daebb8-dfea-4ab9-8253-008a21f906e1 => generated 1363 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 05:02:31.802083 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-3140cba9-4bbe-45e2-9c63-08949d3b7ffd tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Calling method '>' {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:02:31.802720 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.compute.api [None req-3140cba9-4bbe-45e2-9c63-08949d3b7ffd tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] [instance: 201433d5-db4e-4e57-a800-42fe5cfc95ca] Fetching instance by UUID {{(pid=120593) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:02:31.808934 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-3140cba9-4bbe-45e2-9c63-08949d3b7ffd tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:02:31.809408 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-3140cba9-4bbe-45e2-9c63-08949d3b7ffd tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:02:31.809839 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-3140cba9-4bbe-45e2-9c63-08949d3b7ffd tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:02:31.810568 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-3140cba9-4bbe-45e2-9c63-08949d3b7ffd tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:02:31.811016 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-3140cba9-4bbe-45e2-9c63-08949d3b7ffd tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:02:31.811982 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-3140cba9-4bbe-45e2-9c63-08949d3b7ffd tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:02:31.937177 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-3140cba9-4bbe-45e2-9c63-08949d3b7ffd tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74a8cc19ab204424ab23c62915ac2bab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87d5229e39fe4817b5187068d8acecc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:02:31.944651 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-3140cba9-4bbe-45e2-9c63-08949d3b7ffd tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] 10.222.0.50 "GET /compute/v2.1/servers/201433d5-db4e-4e57-a800-42fe5cfc95ca" status: 200 len: 1367 microversion: 2.1 time: 0.146389 Sep 24 05:02:31.945200 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 155/340] 10.222.0.50 () {58 vars in 1236 bytes} [Sat Sep 24 05:02:31 2022] GET /compute/v2.1/servers/201433d5-db4e-4e57-a800-42fe5cfc95ca => generated 1367 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 24 05:02:31.967971 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-41c4b12a-e89c-4f01-a32b-813bdee0a150 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Calling method '>' {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:02:31.968574 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.compute.api [None req-41c4b12a-e89c-4f01-a32b-813bdee0a150 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] [instance: 50eed27b-6da2-4dda-94cc-02fc5cfec071] Fetching instance by UUID {{(pid=120594) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:02:31.974427 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-41c4b12a-e89c-4f01-a32b-813bdee0a150 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:02:31.974898 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-41c4b12a-e89c-4f01-a32b-813bdee0a150 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:02:31.975328 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-41c4b12a-e89c-4f01-a32b-813bdee0a150 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:02:31.976000 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-41c4b12a-e89c-4f01-a32b-813bdee0a150 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:02:31.976452 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-41c4b12a-e89c-4f01-a32b-813bdee0a150 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:02:31.976870 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-41c4b12a-e89c-4f01-a32b-813bdee0a150 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:02:32.107511 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.policy [None req-41c4b12a-e89c-4f01-a32b-813bdee0a150 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cdd0da2c7bc4139bcd48ef36a2ee183', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a18a3756ba2b460d977f738a115ebfe0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:02:32.115264 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [None req-41c4b12a-e89c-4f01-a32b-813bdee0a150 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] 10.222.0.50 "GET /compute/v2.1/servers/50eed27b-6da2-4dda-94cc-02fc5cfec071" status: 200 len: 1522 microversion: 2.1 time: 0.151143 Sep 24 05:02:32.115894 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 186/341] 10.222.0.50 () {58 vars in 1236 bytes} [Sat Sep 24 05:02:31 2022] GET /compute/v2.1/servers/50eed27b-6da2-4dda-94cc-02fc5cfec071 => generated 1522 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 05:02:32.824065 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-cd3591c4-a88a-4b8a-a565-b435f4660492 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Calling method '>' {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:02:32.824665 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.compute.api [None req-cd3591c4-a88a-4b8a-a565-b435f4660492 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] [instance: b2daebb8-dfea-4ab9-8253-008a21f906e1] Fetching instance by UUID {{(pid=120593) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:02:32.831631 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-cd3591c4-a88a-4b8a-a565-b435f4660492 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:02:32.832108 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-cd3591c4-a88a-4b8a-a565-b435f4660492 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:02:32.832542 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-cd3591c4-a88a-4b8a-a565-b435f4660492 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:02:32.833221 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-cd3591c4-a88a-4b8a-a565-b435f4660492 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:02:32.833671 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-cd3591c4-a88a-4b8a-a565-b435f4660492 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:02:32.834141 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-cd3591c4-a88a-4b8a-a565-b435f4660492 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:02:32.964722 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-cd3591c4-a88a-4b8a-a565-b435f4660492 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b1b0448e7f54e3aaae49e411699269e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66ec8bde739145dda504995dbea0914a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:02:32.967925 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-203eb1b0-5032-4ae3-bfc7-d62d0bba4208 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Calling method '>' {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:02:32.968647 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.compute.api [None req-203eb1b0-5032-4ae3-bfc7-d62d0bba4208 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] [instance: 201433d5-db4e-4e57-a800-42fe5cfc95ca] Fetching instance by UUID {{(pid=120594) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:02:32.972274 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-cd3591c4-a88a-4b8a-a565-b435f4660492 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] 10.222.0.50 "GET /compute/v2.1/servers/b2daebb8-dfea-4ab9-8253-008a21f906e1" status: 200 len: 1363 microversion: 2.1 time: 0.152016 Sep 24 05:02:32.972822 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 156/342] 10.222.0.50 () {58 vars in 1236 bytes} [Sat Sep 24 05:02:32 2022] GET /compute/v2.1/servers/b2daebb8-dfea-4ab9-8253-008a21f906e1 => generated 1363 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 05:02:32.974875 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-203eb1b0-5032-4ae3-bfc7-d62d0bba4208 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:02:32.975528 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-203eb1b0-5032-4ae3-bfc7-d62d0bba4208 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:02:32.976034 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-203eb1b0-5032-4ae3-bfc7-d62d0bba4208 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:02:32.976850 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-203eb1b0-5032-4ae3-bfc7-d62d0bba4208 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:02:32.977414 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-203eb1b0-5032-4ae3-bfc7-d62d0bba4208 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:02:32.977908 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-203eb1b0-5032-4ae3-bfc7-d62d0bba4208 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:02:33.104714 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.policy [None req-203eb1b0-5032-4ae3-bfc7-d62d0bba4208 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74a8cc19ab204424ab23c62915ac2bab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87d5229e39fe4817b5187068d8acecc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:02:33.112843 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [None req-203eb1b0-5032-4ae3-bfc7-d62d0bba4208 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] 10.222.0.50 "GET /compute/v2.1/servers/201433d5-db4e-4e57-a800-42fe5cfc95ca" status: 200 len: 1367 microversion: 2.1 time: 0.149102 Sep 24 05:02:33.113409 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 187/343] 10.222.0.50 () {58 vars in 1236 bytes} [Sat Sep 24 05:02:32 2022] GET /compute/v2.1/servers/201433d5-db4e-4e57-a800-42fe5cfc95ca => generated 1367 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 24 05:02:33.139103 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-10aded9e-2e46-497f-ae3a-3867974d0775 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Calling method '>' {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:02:33.139766 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.compute.api [None req-10aded9e-2e46-497f-ae3a-3867974d0775 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] [instance: 50eed27b-6da2-4dda-94cc-02fc5cfec071] Fetching instance by UUID {{(pid=120593) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:02:33.145905 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-10aded9e-2e46-497f-ae3a-3867974d0775 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:02:33.146416 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-10aded9e-2e46-497f-ae3a-3867974d0775 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:02:33.146843 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-10aded9e-2e46-497f-ae3a-3867974d0775 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:02:33.147523 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-10aded9e-2e46-497f-ae3a-3867974d0775 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:02:33.147971 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-10aded9e-2e46-497f-ae3a-3867974d0775 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:02:33.148387 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-10aded9e-2e46-497f-ae3a-3867974d0775 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:02:33.286621 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-10aded9e-2e46-497f-ae3a-3867974d0775 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cdd0da2c7bc4139bcd48ef36a2ee183', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a18a3756ba2b460d977f738a115ebfe0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:02:33.294085 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-10aded9e-2e46-497f-ae3a-3867974d0775 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] 10.222.0.50 "GET /compute/v2.1/servers/50eed27b-6da2-4dda-94cc-02fc5cfec071" status: 200 len: 1522 microversion: 2.1 time: 0.158793 Sep 24 05:02:33.294633 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 157/344] 10.222.0.50 () {58 vars in 1236 bytes} [Sat Sep 24 05:02:33 2022] GET /compute/v2.1/servers/50eed27b-6da2-4dda-94cc-02fc5cfec071 => generated 1522 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 05:02:33.995114 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-f6325581-0a88-4e45-a95d-085db186a731 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Calling method '>' {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:02:33.995725 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.compute.api [None req-f6325581-0a88-4e45-a95d-085db186a731 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] [instance: b2daebb8-dfea-4ab9-8253-008a21f906e1] Fetching instance by UUID {{(pid=120594) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:02:34.002278 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-f6325581-0a88-4e45-a95d-085db186a731 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:02:34.002760 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-f6325581-0a88-4e45-a95d-085db186a731 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:02:34.003193 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-f6325581-0a88-4e45-a95d-085db186a731 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:02:34.003876 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-f6325581-0a88-4e45-a95d-085db186a731 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:02:34.004325 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-f6325581-0a88-4e45-a95d-085db186a731 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:02:34.004745 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-f6325581-0a88-4e45-a95d-085db186a731 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:02:34.130985 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.policy [None req-f6325581-0a88-4e45-a95d-085db186a731 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b1b0448e7f54e3aaae49e411699269e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66ec8bde739145dda504995dbea0914a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:02:34.135858 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-5e7e45a0-5ae1-46b3-b50e-5b057a476a6c tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Calling method '>' {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:02:34.136516 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.compute.api [None req-5e7e45a0-5ae1-46b3-b50e-5b057a476a6c tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] [instance: 201433d5-db4e-4e57-a800-42fe5cfc95ca] Fetching instance by UUID {{(pid=120593) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:02:34.138597 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [None req-f6325581-0a88-4e45-a95d-085db186a731 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] 10.222.0.50 "GET /compute/v2.1/servers/b2daebb8-dfea-4ab9-8253-008a21f906e1" status: 200 len: 1363 microversion: 2.1 time: 0.147315 Sep 24 05:02:34.138846 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG dbcounter [-] [120593] Writing DB stats nova_api:SELECT=90 {{(pid=120593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 05:02:34.139141 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 188/345] 10.222.0.50 () {58 vars in 1236 bytes} [Sat Sep 24 05:02:33 2022] GET /compute/v2.1/servers/b2daebb8-dfea-4ab9-8253-008a21f906e1 => generated 1363 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 05:02:34.144372 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-5e7e45a0-5ae1-46b3-b50e-5b057a476a6c tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:02:34.144858 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-5e7e45a0-5ae1-46b3-b50e-5b057a476a6c tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:02:34.145297 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-5e7e45a0-5ae1-46b3-b50e-5b057a476a6c tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:02:34.145989 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-5e7e45a0-5ae1-46b3-b50e-5b057a476a6c tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:02:34.146468 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-5e7e45a0-5ae1-46b3-b50e-5b057a476a6c tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:02:34.146891 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-5e7e45a0-5ae1-46b3-b50e-5b057a476a6c tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:02:34.280556 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-5e7e45a0-5ae1-46b3-b50e-5b057a476a6c tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74a8cc19ab204424ab23c62915ac2bab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87d5229e39fe4817b5187068d8acecc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:02:34.288055 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-5e7e45a0-5ae1-46b3-b50e-5b057a476a6c tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] 10.222.0.50 "GET /compute/v2.1/servers/201433d5-db4e-4e57-a800-42fe5cfc95ca" status: 200 len: 1367 microversion: 2.1 time: 0.156102 Sep 24 05:02:34.288602 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 158/346] 10.222.0.50 () {58 vars in 1236 bytes} [Sat Sep 24 05:02:34 2022] GET /compute/v2.1/servers/201433d5-db4e-4e57-a800-42fe5cfc95ca => generated 1367 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 24 05:02:34.316455 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-6cc1591d-ce32-4ab4-8d13-cc017f1d3f85 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Calling method '>' {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:02:34.317063 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.compute.api [None req-6cc1591d-ce32-4ab4-8d13-cc017f1d3f85 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] [instance: 50eed27b-6da2-4dda-94cc-02fc5cfec071] Fetching instance by UUID {{(pid=120594) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:02:34.322900 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-6cc1591d-ce32-4ab4-8d13-cc017f1d3f85 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:02:34.323381 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-6cc1591d-ce32-4ab4-8d13-cc017f1d3f85 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:02:34.323811 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-6cc1591d-ce32-4ab4-8d13-cc017f1d3f85 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:02:34.324494 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-6cc1591d-ce32-4ab4-8d13-cc017f1d3f85 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:02:34.324942 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-6cc1591d-ce32-4ab4-8d13-cc017f1d3f85 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:02:34.325360 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-6cc1591d-ce32-4ab4-8d13-cc017f1d3f85 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:02:34.454053 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.policy [None req-6cc1591d-ce32-4ab4-8d13-cc017f1d3f85 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cdd0da2c7bc4139bcd48ef36a2ee183', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a18a3756ba2b460d977f738a115ebfe0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:02:34.461638 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [None req-6cc1591d-ce32-4ab4-8d13-cc017f1d3f85 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] 10.222.0.50 "GET /compute/v2.1/servers/50eed27b-6da2-4dda-94cc-02fc5cfec071" status: 200 len: 1522 microversion: 2.1 time: 0.148983 Sep 24 05:02:34.462230 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 189/347] 10.222.0.50 () {58 vars in 1236 bytes} [Sat Sep 24 05:02:34 2022] GET /compute/v2.1/servers/50eed27b-6da2-4dda-94cc-02fc5cfec071 => generated 1522 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 05:02:35.160594 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-ef89a2b8-e0d3-45a5-a0c8-6017fd4a12a0 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Calling method '>' {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:02:35.161194 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.compute.api [None req-ef89a2b8-e0d3-45a5-a0c8-6017fd4a12a0 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] [instance: b2daebb8-dfea-4ab9-8253-008a21f906e1] Fetching instance by UUID {{(pid=120593) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:02:35.167649 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-ef89a2b8-e0d3-45a5-a0c8-6017fd4a12a0 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:02:35.168120 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-ef89a2b8-e0d3-45a5-a0c8-6017fd4a12a0 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:02:35.168548 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-ef89a2b8-e0d3-45a5-a0c8-6017fd4a12a0 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:02:35.169254 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-ef89a2b8-e0d3-45a5-a0c8-6017fd4a12a0 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:02:35.169700 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-ef89a2b8-e0d3-45a5-a0c8-6017fd4a12a0 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:02:35.170151 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-ef89a2b8-e0d3-45a5-a0c8-6017fd4a12a0 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:02:35.303520 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-ef89a2b8-e0d3-45a5-a0c8-6017fd4a12a0 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b1b0448e7f54e3aaae49e411699269e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66ec8bde739145dda504995dbea0914a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:02:35.310822 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-ae9f3782-8a8c-4bc2-bef4-d6a264b9ae0f tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Calling method '>' {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:02:35.311968 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.compute.api [None req-ae9f3782-8a8c-4bc2-bef4-d6a264b9ae0f tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] [instance: 201433d5-db4e-4e57-a800-42fe5cfc95ca] Fetching instance by UUID {{(pid=120594) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:02:35.312076 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-ef89a2b8-e0d3-45a5-a0c8-6017fd4a12a0 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] 10.222.0.50 "GET /compute/v2.1/servers/b2daebb8-dfea-4ab9-8253-008a21f906e1" status: 200 len: 1363 microversion: 2.1 time: 0.154663 Sep 24 05:02:35.312581 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 159/348] 10.222.0.50 () {58 vars in 1236 bytes} [Sat Sep 24 05:02:35 2022] GET /compute/v2.1/servers/b2daebb8-dfea-4ab9-8253-008a21f906e1 => generated 1363 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 05:02:35.314144 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG dbcounter [-] [120594] Writing DB stats nova_api:SELECT=93 {{(pid=120594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 05:02:35.319202 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-ae9f3782-8a8c-4bc2-bef4-d6a264b9ae0f tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:02:35.319703 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-ae9f3782-8a8c-4bc2-bef4-d6a264b9ae0f tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:02:35.320122 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-ae9f3782-8a8c-4bc2-bef4-d6a264b9ae0f tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:02:35.320807 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-ae9f3782-8a8c-4bc2-bef4-d6a264b9ae0f tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:02:35.321254 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-ae9f3782-8a8c-4bc2-bef4-d6a264b9ae0f tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:02:35.321673 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-ae9f3782-8a8c-4bc2-bef4-d6a264b9ae0f tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:02:35.466804 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.policy [None req-ae9f3782-8a8c-4bc2-bef4-d6a264b9ae0f tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74a8cc19ab204424ab23c62915ac2bab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87d5229e39fe4817b5187068d8acecc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:02:35.478124 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [None req-ae9f3782-8a8c-4bc2-bef4-d6a264b9ae0f tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] 10.222.0.50 "GET /compute/v2.1/servers/201433d5-db4e-4e57-a800-42fe5cfc95ca" status: 200 len: 1367 microversion: 2.1 time: 0.170939 Sep 24 05:02:35.495677 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-a776a4e5-229e-4e17-bd3b-b20c9177554c tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Calling method '>' {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:02:35.495677 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.compute.api [None req-a776a4e5-229e-4e17-bd3b-b20c9177554c tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] [instance: 50eed27b-6da2-4dda-94cc-02fc5cfec071] Fetching instance by UUID {{(pid=120593) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:02:35.495677 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-a776a4e5-229e-4e17-bd3b-b20c9177554c tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:02:35.498078 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-a776a4e5-229e-4e17-bd3b-b20c9177554c tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:02:35.498649 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-a776a4e5-229e-4e17-bd3b-b20c9177554c tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:02:35.498892 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 190/349] 10.222.0.50 () {58 vars in 1236 bytes} [Sat Sep 24 05:02:35 2022] GET /compute/v2.1/servers/201433d5-db4e-4e57-a800-42fe5cfc95ca => generated 1367 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 24 05:02:35.499984 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-a776a4e5-229e-4e17-bd3b-b20c9177554c tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:02:35.500747 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-a776a4e5-229e-4e17-bd3b-b20c9177554c tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:02:35.501310 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-a776a4e5-229e-4e17-bd3b-b20c9177554c tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:02:35.650640 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-a776a4e5-229e-4e17-bd3b-b20c9177554c tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cdd0da2c7bc4139bcd48ef36a2ee183', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a18a3756ba2b460d977f738a115ebfe0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:02:35.655437 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-a776a4e5-229e-4e17-bd3b-b20c9177554c tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] 10.222.0.50 "GET /compute/v2.1/servers/50eed27b-6da2-4dda-94cc-02fc5cfec071" status: 200 len: 1522 microversion: 2.1 time: 0.174406 Sep 24 05:02:35.658209 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 160/350] 10.222.0.50 () {58 vars in 1236 bytes} [Sat Sep 24 05:02:35 2022] GET /compute/v2.1/servers/50eed27b-6da2-4dda-94cc-02fc5cfec071 => generated 1522 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 05:02:36.334028 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-a527a19d-51f5-4778-9994-719774897e7b tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Calling method '>' {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:02:36.334646 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.compute.api [None req-a527a19d-51f5-4778-9994-719774897e7b tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] [instance: b2daebb8-dfea-4ab9-8253-008a21f906e1] Fetching instance by UUID {{(pid=120594) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:02:36.340492 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-a527a19d-51f5-4778-9994-719774897e7b tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:02:36.340966 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-a527a19d-51f5-4778-9994-719774897e7b tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:02:36.341390 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-a527a19d-51f5-4778-9994-719774897e7b tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:02:36.342093 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-a527a19d-51f5-4778-9994-719774897e7b tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:02:36.342567 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-a527a19d-51f5-4778-9994-719774897e7b tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:02:36.343037 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-a527a19d-51f5-4778-9994-719774897e7b tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:02:36.472836 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.policy [None req-a527a19d-51f5-4778-9994-719774897e7b tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b1b0448e7f54e3aaae49e411699269e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66ec8bde739145dda504995dbea0914a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:02:36.480290 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [None req-a527a19d-51f5-4778-9994-719774897e7b tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] 10.222.0.50 "GET /compute/v2.1/servers/b2daebb8-dfea-4ab9-8253-008a21f906e1" status: 200 len: 1549 microversion: 2.1 time: 0.150024 Sep 24 05:02:36.480850 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 191/351] 10.222.0.50 () {58 vars in 1236 bytes} [Sat Sep 24 05:02:36 2022] GET /compute/v2.1/servers/b2daebb8-dfea-4ab9-8253-008a21f906e1 => generated 1549 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 05:02:36.502867 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-7808a6a7-ef63-4ec2-9ddd-aa94b9497f83 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Calling method '>' {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:02:36.503347 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-3c2a169b-6d7c-484e-a7df-e62c7ebb4701 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Calling method '>' {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:02:36.503537 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.compute.api [None req-7808a6a7-ef63-4ec2-9ddd-aa94b9497f83 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] [instance: b2daebb8-dfea-4ab9-8253-008a21f906e1] Fetching instance by UUID {{(pid=120593) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:02:36.503718 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.compute.api [None req-3c2a169b-6d7c-484e-a7df-e62c7ebb4701 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] [instance: 201433d5-db4e-4e57-a800-42fe5cfc95ca] Fetching instance by UUID {{(pid=120594) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:02:36.509485 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-3c2a169b-6d7c-484e-a7df-e62c7ebb4701 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:02:36.509658 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-7808a6a7-ef63-4ec2-9ddd-aa94b9497f83 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:02:36.509961 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-3c2a169b-6d7c-484e-a7df-e62c7ebb4701 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:02:36.510088 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-7808a6a7-ef63-4ec2-9ddd-aa94b9497f83 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:02:36.510424 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-3c2a169b-6d7c-484e-a7df-e62c7ebb4701 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:02:36.510561 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-7808a6a7-ef63-4ec2-9ddd-aa94b9497f83 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:02:36.511106 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-7808a6a7-ef63-4ec2-9ddd-aa94b9497f83 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:02:36.511214 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-3c2a169b-6d7c-484e-a7df-e62c7ebb4701 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:02:36.511551 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-7808a6a7-ef63-4ec2-9ddd-aa94b9497f83 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:02:36.511672 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-3c2a169b-6d7c-484e-a7df-e62c7ebb4701 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:02:36.511971 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-7808a6a7-ef63-4ec2-9ddd-aa94b9497f83 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:02:36.512074 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-3c2a169b-6d7c-484e-a7df-e62c7ebb4701 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:02:36.621047 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-7808a6a7-ef63-4ec2-9ddd-aa94b9497f83 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] 10.222.0.50 "GET /compute/v2.1/servers/b2daebb8-dfea-4ab9-8253-008a21f906e1/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.122443 Sep 24 05:02:36.622149 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 161/352] 10.222.0.50 () {58 vars in 1275 bytes} [Sat Sep 24 05:02:36 2022] GET /compute/v2.1/servers/b2daebb8-dfea-4ab9-8253-008a21f906e1/os-interface => generated 285 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 05:02:36.678118 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-4f53e62f-24db-4216-b2ed-3917b2b8bfa5 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Calling method '>' {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:02:36.678895 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.compute.api [None req-4f53e62f-24db-4216-b2ed-3917b2b8bfa5 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] [instance: 50eed27b-6da2-4dda-94cc-02fc5cfec071] Fetching instance by UUID {{(pid=120593) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:02:36.684958 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-4f53e62f-24db-4216-b2ed-3917b2b8bfa5 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:02:36.685594 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-4f53e62f-24db-4216-b2ed-3917b2b8bfa5 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:02:36.686198 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-4f53e62f-24db-4216-b2ed-3917b2b8bfa5 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:02:36.687788 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-4f53e62f-24db-4216-b2ed-3917b2b8bfa5 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:02:36.688468 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-4f53e62f-24db-4216-b2ed-3917b2b8bfa5 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:02:36.689083 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-4f53e62f-24db-4216-b2ed-3917b2b8bfa5 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:02:36.907373 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.policy [None req-3c2a169b-6d7c-484e-a7df-e62c7ebb4701 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74a8cc19ab204424ab23c62915ac2bab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87d5229e39fe4817b5187068d8acecc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:02:36.916627 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [None req-3c2a169b-6d7c-484e-a7df-e62c7ebb4701 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] 10.222.0.50 "GET /compute/v2.1/servers/201433d5-db4e-4e57-a800-42fe5cfc95ca" status: 200 len: 1367 microversion: 2.1 time: 0.417565 Sep 24 05:02:36.917196 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 192/353] 10.222.0.50 () {58 vars in 1236 bytes} [Sat Sep 24 05:02:36 2022] GET /compute/v2.1/servers/201433d5-db4e-4e57-a800-42fe5cfc95ca => generated 1367 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 24 05:02:37.046540 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-4f53e62f-24db-4216-b2ed-3917b2b8bfa5 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cdd0da2c7bc4139bcd48ef36a2ee183', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a18a3756ba2b460d977f738a115ebfe0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:02:37.054155 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-4f53e62f-24db-4216-b2ed-3917b2b8bfa5 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] 10.222.0.50 "GET /compute/v2.1/servers/50eed27b-6da2-4dda-94cc-02fc5cfec071" status: 200 len: 1522 microversion: 2.1 time: 0.379957 Sep 24 05:02:37.055109 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 162/354] 10.222.0.50 () {58 vars in 1236 bytes} [Sat Sep 24 05:02:36 2022] GET /compute/v2.1/servers/50eed27b-6da2-4dda-94cc-02fc5cfec071 => generated 1522 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 24 05:02:37.958607 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-5d51b003-fff4-4522-b6d6-207a8fd0c383 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Calling method '>' {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:02:37.959243 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.compute.api [None req-5d51b003-fff4-4522-b6d6-207a8fd0c383 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] [instance: 201433d5-db4e-4e57-a800-42fe5cfc95ca] Fetching instance by UUID {{(pid=120594) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:02:37.965787 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-5d51b003-fff4-4522-b6d6-207a8fd0c383 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:02:37.966577 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-5d51b003-fff4-4522-b6d6-207a8fd0c383 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:02:37.967229 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-5d51b003-fff4-4522-b6d6-207a8fd0c383 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:02:37.970768 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-5d51b003-fff4-4522-b6d6-207a8fd0c383 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:02:37.971358 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-5d51b003-fff4-4522-b6d6-207a8fd0c383 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:02:37.972129 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-5d51b003-fff4-4522-b6d6-207a8fd0c383 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:02:37.996520 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG dbcounter [-] [120594] Writing DB stats nova_cell1:SELECT=100 {{(pid=120594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 05:02:38.078697 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-150c06d3-8265-4afc-b059-9d9a1dc4506d tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Calling method '>' {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:02:38.080030 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.compute.api [None req-150c06d3-8265-4afc-b059-9d9a1dc4506d tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] [instance: 50eed27b-6da2-4dda-94cc-02fc5cfec071] Fetching instance by UUID {{(pid=120593) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:02:38.086447 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-150c06d3-8265-4afc-b059-9d9a1dc4506d tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:02:38.087242 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-150c06d3-8265-4afc-b059-9d9a1dc4506d tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:02:38.087773 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-150c06d3-8265-4afc-b059-9d9a1dc4506d tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:02:38.088670 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-150c06d3-8265-4afc-b059-9d9a1dc4506d tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:02:38.089126 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-150c06d3-8265-4afc-b059-9d9a1dc4506d tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:02:38.089539 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-150c06d3-8265-4afc-b059-9d9a1dc4506d tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:02:38.195496 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.policy [None req-5d51b003-fff4-4522-b6d6-207a8fd0c383 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74a8cc19ab204424ab23c62915ac2bab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87d5229e39fe4817b5187068d8acecc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:02:38.204109 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [None req-5d51b003-fff4-4522-b6d6-207a8fd0c383 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] 10.222.0.50 "GET /compute/v2.1/servers/201433d5-db4e-4e57-a800-42fe5cfc95ca" status: 200 len: 1367 microversion: 2.1 time: 0.250093 Sep 24 05:02:38.204677 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 193/355] 10.222.0.50 () {58 vars in 1236 bytes} [Sat Sep 24 05:02:37 2022] GET /compute/v2.1/servers/201433d5-db4e-4e57-a800-42fe5cfc95ca => generated 1367 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 05:02:38.209247 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [req-34dbc503-da2d-42c9-aca0-feae8c9dd9ce req-9d3fa3ec-6011-4e2f-ad46-fdeb75ca3816 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b2daebb8-dfea-4ab9-8253-008a21f906e1", "tag": "27e14393-9cd2-49fc-924d-ab63297b8de7"}]} {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 05:02:38.219225 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [req-34dbc503-da2d-42c9-aca0-feae8c9dd9ce req-9d3fa3ec-6011-4e2f-ad46-fdeb75ca3816 service nova] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:02:38.219909 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [req-34dbc503-da2d-42c9-aca0-feae8c9dd9ce req-9d3fa3ec-6011-4e2f-ad46-fdeb75ca3816 service nova] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:02:38.220405 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [req-34dbc503-da2d-42c9-aca0-feae8c9dd9ce req-9d3fa3ec-6011-4e2f-ad46-fdeb75ca3816 service nova] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:02:38.231781 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: INFO nova.api.openstack.compute.server_external_events [req-34dbc503-da2d-42c9-aca0-feae8c9dd9ce req-9d3fa3ec-6011-4e2f-ad46-fdeb75ca3816 service nova] Creating event network-changed:27e14393-9cd2-49fc-924d-ab63297b8de7 for instance b2daebb8-dfea-4ab9-8253-008a21f906e1 on hv-cinder-85918 Sep 24 05:02:38.236959 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [req-34dbc503-da2d-42c9-aca0-feae8c9dd9ce req-9d3fa3ec-6011-4e2f-ad46-fdeb75ca3816 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030996 Sep 24 05:02:38.237742 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 194/356] 10.222.0.50 () {64 vars in 1317 bytes} [Sat Sep 24 05:02:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 05:02:38.248208 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-150c06d3-8265-4afc-b059-9d9a1dc4506d tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cdd0da2c7bc4139bcd48ef36a2ee183', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a18a3756ba2b460d977f738a115ebfe0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:02:38.255734 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-150c06d3-8265-4afc-b059-9d9a1dc4506d tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] 10.222.0.50 "GET /compute/v2.1/servers/50eed27b-6da2-4dda-94cc-02fc5cfec071" status: 200 len: 1522 microversion: 2.1 time: 0.181354 Sep 24 05:02:38.256298 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 163/357] 10.222.0.50 () {58 vars in 1236 bytes} [Sat Sep 24 05:02:38 2022] GET /compute/v2.1/servers/50eed27b-6da2-4dda-94cc-02fc5cfec071 => generated 1522 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 24 05:02:39.227669 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-63aacf59-1ae2-4c12-9809-a0823f2adbc8 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Calling method '>' {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:02:39.228363 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.compute.api [None req-63aacf59-1ae2-4c12-9809-a0823f2adbc8 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] [instance: 201433d5-db4e-4e57-a800-42fe5cfc95ca] Fetching instance by UUID {{(pid=120594) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:02:39.235655 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-63aacf59-1ae2-4c12-9809-a0823f2adbc8 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:02:39.236129 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-63aacf59-1ae2-4c12-9809-a0823f2adbc8 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:02:39.236557 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-63aacf59-1ae2-4c12-9809-a0823f2adbc8 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:02:39.237241 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-63aacf59-1ae2-4c12-9809-a0823f2adbc8 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:02:39.237684 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-63aacf59-1ae2-4c12-9809-a0823f2adbc8 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:02:39.238166 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-63aacf59-1ae2-4c12-9809-a0823f2adbc8 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:02:39.279803 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-6b0ae090-da52-444d-aed4-589731fb8af5 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Calling method '>' {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:02:39.280312 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.compute.api [None req-6b0ae090-da52-444d-aed4-589731fb8af5 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] [instance: 50eed27b-6da2-4dda-94cc-02fc5cfec071] Fetching instance by UUID {{(pid=120593) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:02:39.286810 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-6b0ae090-da52-444d-aed4-589731fb8af5 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:02:39.287291 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-6b0ae090-da52-444d-aed4-589731fb8af5 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:02:39.287719 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-6b0ae090-da52-444d-aed4-589731fb8af5 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:02:39.288414 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-6b0ae090-da52-444d-aed4-589731fb8af5 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:02:39.288861 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-6b0ae090-da52-444d-aed4-589731fb8af5 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:02:39.289285 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-6b0ae090-da52-444d-aed4-589731fb8af5 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:02:39.425229 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.policy [None req-63aacf59-1ae2-4c12-9809-a0823f2adbc8 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74a8cc19ab204424ab23c62915ac2bab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87d5229e39fe4817b5187068d8acecc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:02:39.432823 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [None req-63aacf59-1ae2-4c12-9809-a0823f2adbc8 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] 10.222.0.50 "GET /compute/v2.1/servers/201433d5-db4e-4e57-a800-42fe5cfc95ca" status: 200 len: 1367 microversion: 2.1 time: 0.209841 Sep 24 05:02:39.433396 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 195/358] 10.222.0.50 () {58 vars in 1236 bytes} [Sat Sep 24 05:02:39 2022] GET /compute/v2.1/servers/201433d5-db4e-4e57-a800-42fe5cfc95ca => generated 1367 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 05:02:39.445936 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-6b0ae090-da52-444d-aed4-589731fb8af5 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cdd0da2c7bc4139bcd48ef36a2ee183', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a18a3756ba2b460d977f738a115ebfe0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:02:39.453607 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-6b0ae090-da52-444d-aed4-589731fb8af5 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] 10.222.0.50 "GET /compute/v2.1/servers/50eed27b-6da2-4dda-94cc-02fc5cfec071" status: 200 len: 1522 microversion: 2.1 time: 0.177749 Sep 24 05:02:39.454221 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 164/359] 10.222.0.50 () {58 vars in 1236 bytes} [Sat Sep 24 05:02:39 2022] GET /compute/v2.1/servers/50eed27b-6da2-4dda-94cc-02fc5cfec071 => generated 1522 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 24 05:02:40.455749 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-22f21f2f-4f2e-47b6-9b69-ac7d387352ed tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Calling method '>' {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:02:40.456278 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.compute.api [None req-22f21f2f-4f2e-47b6-9b69-ac7d387352ed tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] [instance: 201433d5-db4e-4e57-a800-42fe5cfc95ca] Fetching instance by UUID {{(pid=120594) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:02:40.462639 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-22f21f2f-4f2e-47b6-9b69-ac7d387352ed tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:02:40.463118 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-22f21f2f-4f2e-47b6-9b69-ac7d387352ed tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:02:40.463549 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-22f21f2f-4f2e-47b6-9b69-ac7d387352ed tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:02:40.464228 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-22f21f2f-4f2e-47b6-9b69-ac7d387352ed tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:02:40.464675 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-22f21f2f-4f2e-47b6-9b69-ac7d387352ed tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:02:40.465095 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-22f21f2f-4f2e-47b6-9b69-ac7d387352ed tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:02:40.476736 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-e284bb42-e53d-4910-be10-fdba5659c725 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Calling method '>' {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:02:40.477683 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.compute.api [None req-e284bb42-e53d-4910-be10-fdba5659c725 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] [instance: 50eed27b-6da2-4dda-94cc-02fc5cfec071] Fetching instance by UUID {{(pid=120593) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:02:40.484475 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-e284bb42-e53d-4910-be10-fdba5659c725 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:02:40.484958 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-e284bb42-e53d-4910-be10-fdba5659c725 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:02:40.485394 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-e284bb42-e53d-4910-be10-fdba5659c725 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:02:40.486168 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-e284bb42-e53d-4910-be10-fdba5659c725 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:02:40.486622 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-e284bb42-e53d-4910-be10-fdba5659c725 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:02:40.487050 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-e284bb42-e53d-4910-be10-fdba5659c725 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:02:40.668700 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.policy [None req-22f21f2f-4f2e-47b6-9b69-ac7d387352ed tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74a8cc19ab204424ab23c62915ac2bab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87d5229e39fe4817b5187068d8acecc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:02:40.671890 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-e284bb42-e53d-4910-be10-fdba5659c725 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cdd0da2c7bc4139bcd48ef36a2ee183', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a18a3756ba2b460d977f738a115ebfe0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:02:40.676363 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [None req-22f21f2f-4f2e-47b6-9b69-ac7d387352ed tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] 10.222.0.50 "GET /compute/v2.1/servers/201433d5-db4e-4e57-a800-42fe5cfc95ca" status: 200 len: 1367 microversion: 2.1 time: 0.225117 Sep 24 05:02:40.676928 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 196/360] 10.222.0.50 () {58 vars in 1236 bytes} [Sat Sep 24 05:02:40 2022] GET /compute/v2.1/servers/201433d5-db4e-4e57-a800-42fe5cfc95ca => generated 1367 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 05:02:40.679413 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-e284bb42-e53d-4910-be10-fdba5659c725 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] 10.222.0.50 "GET /compute/v2.1/servers/50eed27b-6da2-4dda-94cc-02fc5cfec071" status: 200 len: 1522 microversion: 2.1 time: 0.206609 Sep 24 05:02:40.680007 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 165/361] 10.222.0.50 () {58 vars in 1236 bytes} [Sat Sep 24 05:02:40 2022] GET /compute/v2.1/servers/50eed27b-6da2-4dda-94cc-02fc5cfec071 => generated 1522 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 24 05:02:41.698758 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-fc1b52b7-8e59-482a-8ad4-82f632d00386 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Calling method '>' {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:02:41.699392 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.compute.api [None req-fc1b52b7-8e59-482a-8ad4-82f632d00386 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] [instance: 201433d5-db4e-4e57-a800-42fe5cfc95ca] Fetching instance by UUID {{(pid=120594) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:02:41.702644 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-266aa5e1-3d8a-4c50-863d-81a4e3008a2b tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Calling method '>' {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:02:41.703174 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.compute.api [None req-266aa5e1-3d8a-4c50-863d-81a4e3008a2b tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] [instance: 50eed27b-6da2-4dda-94cc-02fc5cfec071] Fetching instance by UUID {{(pid=120593) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:02:41.706191 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-fc1b52b7-8e59-482a-8ad4-82f632d00386 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:02:41.706680 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-fc1b52b7-8e59-482a-8ad4-82f632d00386 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:02:41.707133 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-fc1b52b7-8e59-482a-8ad4-82f632d00386 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:02:41.707809 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-fc1b52b7-8e59-482a-8ad4-82f632d00386 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:02:41.708260 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-fc1b52b7-8e59-482a-8ad4-82f632d00386 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:02:41.708687 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-fc1b52b7-8e59-482a-8ad4-82f632d00386 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:02:41.709422 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-266aa5e1-3d8a-4c50-863d-81a4e3008a2b tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:02:41.709904 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-266aa5e1-3d8a-4c50-863d-81a4e3008a2b tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:02:41.710380 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-266aa5e1-3d8a-4c50-863d-81a4e3008a2b tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:02:41.711068 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-266aa5e1-3d8a-4c50-863d-81a4e3008a2b tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:02:41.711516 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-266aa5e1-3d8a-4c50-863d-81a4e3008a2b tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:02:41.711940 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-266aa5e1-3d8a-4c50-863d-81a4e3008a2b tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:02:41.905097 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.policy [None req-fc1b52b7-8e59-482a-8ad4-82f632d00386 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74a8cc19ab204424ab23c62915ac2bab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87d5229e39fe4817b5187068d8acecc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:02:41.910965 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-266aa5e1-3d8a-4c50-863d-81a4e3008a2b tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cdd0da2c7bc4139bcd48ef36a2ee183', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a18a3756ba2b460d977f738a115ebfe0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:02:41.912968 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [None req-fc1b52b7-8e59-482a-8ad4-82f632d00386 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] 10.222.0.50 "GET /compute/v2.1/servers/201433d5-db4e-4e57-a800-42fe5cfc95ca" status: 200 len: 1367 microversion: 2.1 time: 0.218102 Sep 24 05:02:41.913548 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 197/362] 10.222.0.50 () {58 vars in 1236 bytes} [Sat Sep 24 05:02:41 2022] GET /compute/v2.1/servers/201433d5-db4e-4e57-a800-42fe5cfc95ca => generated 1367 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 05:02:41.918850 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-266aa5e1-3d8a-4c50-863d-81a4e3008a2b tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] 10.222.0.50 "GET /compute/v2.1/servers/50eed27b-6da2-4dda-94cc-02fc5cfec071" status: 200 len: 1522 microversion: 2.1 time: 0.220712 Sep 24 05:02:41.919398 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 166/363] 10.222.0.50 () {58 vars in 1236 bytes} [Sat Sep 24 05:02:41 2022] GET /compute/v2.1/servers/50eed27b-6da2-4dda-94cc-02fc5cfec071 => generated 1522 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 24 05:02:42.935509 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-0fd3dde8-d78b-4950-bc1f-2440300675e6 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Calling method '>' {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:02:42.936059 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.compute.api [None req-0fd3dde8-d78b-4950-bc1f-2440300675e6 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] [instance: 201433d5-db4e-4e57-a800-42fe5cfc95ca] Fetching instance by UUID {{(pid=120594) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:02:42.941270 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-0b8e118e-bce6-48e1-a02c-1619d2aa1ae2 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Calling method '>' {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:02:42.941913 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.compute.api [None req-0b8e118e-bce6-48e1-a02c-1619d2aa1ae2 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] [instance: 50eed27b-6da2-4dda-94cc-02fc5cfec071] Fetching instance by UUID {{(pid=120593) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:02:42.942217 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-0fd3dde8-d78b-4950-bc1f-2440300675e6 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:02:42.942696 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-0fd3dde8-d78b-4950-bc1f-2440300675e6 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:02:42.943125 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-0fd3dde8-d78b-4950-bc1f-2440300675e6 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:02:42.943892 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-0fd3dde8-d78b-4950-bc1f-2440300675e6 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:02:42.944358 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-0fd3dde8-d78b-4950-bc1f-2440300675e6 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:02:42.944781 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-0fd3dde8-d78b-4950-bc1f-2440300675e6 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:02:42.948270 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-0b8e118e-bce6-48e1-a02c-1619d2aa1ae2 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:02:42.948757 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-0b8e118e-bce6-48e1-a02c-1619d2aa1ae2 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:02:42.949188 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-0b8e118e-bce6-48e1-a02c-1619d2aa1ae2 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:02:42.949882 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-0b8e118e-bce6-48e1-a02c-1619d2aa1ae2 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:02:42.950362 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-0b8e118e-bce6-48e1-a02c-1619d2aa1ae2 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:02:42.950788 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-0b8e118e-bce6-48e1-a02c-1619d2aa1ae2 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:02:43.141633 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.policy [None req-0fd3dde8-d78b-4950-bc1f-2440300675e6 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74a8cc19ab204424ab23c62915ac2bab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87d5229e39fe4817b5187068d8acecc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:02:43.144852 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-0b8e118e-bce6-48e1-a02c-1619d2aa1ae2 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cdd0da2c7bc4139bcd48ef36a2ee183', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a18a3756ba2b460d977f738a115ebfe0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:02:43.152543 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-0b8e118e-bce6-48e1-a02c-1619d2aa1ae2 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] 10.222.0.50 "GET /compute/v2.1/servers/50eed27b-6da2-4dda-94cc-02fc5cfec071" status: 200 len: 1522 microversion: 2.1 time: 0.215461 Sep 24 05:02:43.153107 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 167/364] 10.222.0.50 () {58 vars in 1236 bytes} [Sat Sep 24 05:02:42 2022] GET /compute/v2.1/servers/50eed27b-6da2-4dda-94cc-02fc5cfec071 => generated 1522 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 05:02:43.154064 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [None req-0fd3dde8-d78b-4950-bc1f-2440300675e6 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] 10.222.0.50 "GET /compute/v2.1/servers/201433d5-db4e-4e57-a800-42fe5cfc95ca" status: 200 len: 1558 microversion: 2.1 time: 0.222446 Sep 24 05:02:43.154819 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 198/365] 10.222.0.50 () {58 vars in 1236 bytes} [Sat Sep 24 05:02:42 2022] GET /compute/v2.1/servers/201433d5-db4e-4e57-a800-42fe5cfc95ca => generated 1558 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 24 05:02:43.186220 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-0ca87cd1-7ab2-43af-92ca-2687cfd3630c tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Calling method '>' {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:02:43.186666 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.compute.api [None req-0ca87cd1-7ab2-43af-92ca-2687cfd3630c tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] [instance: 201433d5-db4e-4e57-a800-42fe5cfc95ca] Fetching instance by UUID {{(pid=120593) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:02:43.192659 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-0ca87cd1-7ab2-43af-92ca-2687cfd3630c tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:02:43.193147 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-0ca87cd1-7ab2-43af-92ca-2687cfd3630c tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:02:43.193587 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-0ca87cd1-7ab2-43af-92ca-2687cfd3630c tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:02:43.194330 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-0ca87cd1-7ab2-43af-92ca-2687cfd3630c tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:02:43.194784 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-0ca87cd1-7ab2-43af-92ca-2687cfd3630c tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:02:43.195211 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-0ca87cd1-7ab2-43af-92ca-2687cfd3630c tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:02:43.277148 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-0ca87cd1-7ab2-43af-92ca-2687cfd3630c tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] 10.222.0.50 "GET /compute/v2.1/servers/201433d5-db4e-4e57-a800-42fe5cfc95ca/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.094835 Sep 24 05:02:43.277826 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 168/366] 10.222.0.50 () {58 vars in 1275 bytes} [Sat Sep 24 05:02:43 2022] GET /compute/v2.1/servers/201433d5-db4e-4e57-a800-42fe5cfc95ca/os-interface => generated 285 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 05:02:44.175852 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-368c7b0d-613c-4045-85bf-84b608dc1ce1 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Calling method '>' {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:02:44.176458 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.compute.api [None req-368c7b0d-613c-4045-85bf-84b608dc1ce1 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] [instance: 50eed27b-6da2-4dda-94cc-02fc5cfec071] Fetching instance by UUID {{(pid=120594) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:02:44.182355 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-368c7b0d-613c-4045-85bf-84b608dc1ce1 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:02:44.182835 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-368c7b0d-613c-4045-85bf-84b608dc1ce1 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:02:44.183271 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-368c7b0d-613c-4045-85bf-84b608dc1ce1 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:02:44.183958 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-368c7b0d-613c-4045-85bf-84b608dc1ce1 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:02:44.184438 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-368c7b0d-613c-4045-85bf-84b608dc1ce1 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:02:44.184862 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-368c7b0d-613c-4045-85bf-84b608dc1ce1 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:02:44.384214 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.policy [None req-368c7b0d-613c-4045-85bf-84b608dc1ce1 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cdd0da2c7bc4139bcd48ef36a2ee183', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a18a3756ba2b460d977f738a115ebfe0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:02:44.392836 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [None req-368c7b0d-613c-4045-85bf-84b608dc1ce1 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] 10.222.0.50 "GET /compute/v2.1/servers/50eed27b-6da2-4dda-94cc-02fc5cfec071" status: 200 len: 1522 microversion: 2.1 time: 0.220676 Sep 24 05:02:44.393581 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 199/367] 10.222.0.50 () {58 vars in 1236 bytes} [Sat Sep 24 05:02:44 2022] GET /compute/v2.1/servers/50eed27b-6da2-4dda-94cc-02fc5cfec071 => generated 1522 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 05:02:44.480217 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [req-95ae456c-a2fe-416a-b14a-60b6bbbbc678 req-fff9ba73-e796-4fd5-ab17-393d662a0eb6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "201433d5-db4e-4e57-a800-42fe5cfc95ca", "tag": "7efb703e-b766-4972-b442-eaba81c854e8"}]} {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 05:02:44.490134 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [req-95ae456c-a2fe-416a-b14a-60b6bbbbc678 req-fff9ba73-e796-4fd5-ab17-393d662a0eb6 service nova] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:02:44.490607 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [req-95ae456c-a2fe-416a-b14a-60b6bbbbc678 req-fff9ba73-e796-4fd5-ab17-393d662a0eb6 service nova] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:02:44.491029 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [req-95ae456c-a2fe-416a-b14a-60b6bbbbc678 req-fff9ba73-e796-4fd5-ab17-393d662a0eb6 service nova] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:02:44.501764 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.compute.server_external_events [req-95ae456c-a2fe-416a-b14a-60b6bbbbc678 req-fff9ba73-e796-4fd5-ab17-393d662a0eb6 service nova] Creating event network-changed:7efb703e-b766-4972-b442-eaba81c854e8 for instance 201433d5-db4e-4e57-a800-42fe5cfc95ca on hv-cinder-85918 Sep 24 05:02:44.506968 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [req-95ae456c-a2fe-416a-b14a-60b6bbbbc678 req-fff9ba73-e796-4fd5-ab17-393d662a0eb6 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031042 Sep 24 05:02:44.507560 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 169/368] 10.222.0.50 () {64 vars in 1317 bytes} [Sat Sep 24 05:02:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 05:02:45.416726 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-bac0628d-32a2-4d9a-a114-651eddf6d2c3 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Calling method '>' {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:02:45.417423 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.compute.api [None req-bac0628d-32a2-4d9a-a114-651eddf6d2c3 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] [instance: 50eed27b-6da2-4dda-94cc-02fc5cfec071] Fetching instance by UUID {{(pid=120594) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:02:45.424168 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-bac0628d-32a2-4d9a-a114-651eddf6d2c3 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:02:45.424520 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-bac0628d-32a2-4d9a-a114-651eddf6d2c3 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:02:45.425165 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-bac0628d-32a2-4d9a-a114-651eddf6d2c3 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:02:45.425942 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-bac0628d-32a2-4d9a-a114-651eddf6d2c3 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:02:45.426480 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-bac0628d-32a2-4d9a-a114-651eddf6d2c3 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:02:45.426965 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-bac0628d-32a2-4d9a-a114-651eddf6d2c3 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:02:45.632441 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.policy [None req-bac0628d-32a2-4d9a-a114-651eddf6d2c3 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cdd0da2c7bc4139bcd48ef36a2ee183', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a18a3756ba2b460d977f738a115ebfe0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:02:45.640883 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [None req-bac0628d-32a2-4d9a-a114-651eddf6d2c3 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] 10.222.0.50 "GET /compute/v2.1/servers/50eed27b-6da2-4dda-94cc-02fc5cfec071" status: 200 len: 1522 microversion: 2.1 time: 0.228152 Sep 24 05:02:45.641692 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 200/369] 10.222.0.50 () {58 vars in 1236 bytes} [Sat Sep 24 05:02:45 2022] GET /compute/v2.1/servers/50eed27b-6da2-4dda-94cc-02fc5cfec071 => generated 1522 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 05:02:46.666925 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-49816397-05cf-4d46-9ef6-08b682fe1439 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Calling method '>' {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:02:46.668270 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.compute.api [None req-49816397-05cf-4d46-9ef6-08b682fe1439 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] [instance: 50eed27b-6da2-4dda-94cc-02fc5cfec071] Fetching instance by UUID {{(pid=120593) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:02:46.676480 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-49816397-05cf-4d46-9ef6-08b682fe1439 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:02:46.677300 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-49816397-05cf-4d46-9ef6-08b682fe1439 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:02:46.678197 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-49816397-05cf-4d46-9ef6-08b682fe1439 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:02:46.679386 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-49816397-05cf-4d46-9ef6-08b682fe1439 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:02:46.679980 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-49816397-05cf-4d46-9ef6-08b682fe1439 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:02:46.680546 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-49816397-05cf-4d46-9ef6-08b682fe1439 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:02:46.708727 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-d966e6ef-fdfa-4f4e-a7ee-41ee17268f6a tempest-DeleteServersTestJSON-1630660203 tempest-DeleteServersTestJSON-1630660203-project] Calling method '>' {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:02:46.711541 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.compute.api [None req-d966e6ef-fdfa-4f4e-a7ee-41ee17268f6a tempest-DeleteServersTestJSON-1630660203 tempest-DeleteServersTestJSON-1630660203-project] [instance: ec88b440-40a0-459f-b94b-06c332e86094] Fetching instance by UUID {{(pid=120594) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:02:46.724779 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-d966e6ef-fdfa-4f4e-a7ee-41ee17268f6a tempest-DeleteServersTestJSON-1630660203 tempest-DeleteServersTestJSON-1630660203-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:02:46.725360 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-d966e6ef-fdfa-4f4e-a7ee-41ee17268f6a tempest-DeleteServersTestJSON-1630660203 tempest-DeleteServersTestJSON-1630660203-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:02:46.725870 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-d966e6ef-fdfa-4f4e-a7ee-41ee17268f6a tempest-DeleteServersTestJSON-1630660203 tempest-DeleteServersTestJSON-1630660203-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:02:46.727069 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-d966e6ef-fdfa-4f4e-a7ee-41ee17268f6a tempest-DeleteServersTestJSON-1630660203 tempest-DeleteServersTestJSON-1630660203-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:02:46.727736 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-d966e6ef-fdfa-4f4e-a7ee-41ee17268f6a tempest-DeleteServersTestJSON-1630660203 tempest-DeleteServersTestJSON-1630660203-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:02:46.728293 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-d966e6ef-fdfa-4f4e-a7ee-41ee17268f6a tempest-DeleteServersTestJSON-1630660203 tempest-DeleteServersTestJSON-1630660203-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:02:46.762598 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.compute.api [None req-d966e6ef-fdfa-4f4e-a7ee-41ee17268f6a tempest-DeleteServersTestJSON-1630660203 tempest-DeleteServersTestJSON-1630660203-project] [instance: ec88b440-40a0-459f-b94b-06c332e86094] Going to try to terminate instance {{(pid=120594) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 24 05:02:46.901026 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-49816397-05cf-4d46-9ef6-08b682fe1439 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cdd0da2c7bc4139bcd48ef36a2ee183', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a18a3756ba2b460d977f738a115ebfe0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:02:46.912430 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-49816397-05cf-4d46-9ef6-08b682fe1439 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] 10.222.0.50 "GET /compute/v2.1/servers/50eed27b-6da2-4dda-94cc-02fc5cfec071" status: 200 len: 1522 microversion: 2.1 time: 0.250191 Sep 24 05:02:46.912993 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 170/370] 10.222.0.50 () {58 vars in 1236 bytes} [Sat Sep 24 05:02:46 2022] GET /compute/v2.1/servers/50eed27b-6da2-4dda-94cc-02fc5cfec071 => generated 1522 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 05:02:46.947922 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [None req-d966e6ef-fdfa-4f4e-a7ee-41ee17268f6a tempest-DeleteServersTestJSON-1630660203 tempest-DeleteServersTestJSON-1630660203-project] 10.222.0.50 "DELETE /compute/v2.1/servers/ec88b440-40a0-459f-b94b-06c332e86094" status: 204 len: 0 microversion: 2.1 time: 0.250813 Sep 24 05:02:46.948503 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 201/371] 10.222.0.50 () {58 vars in 1239 bytes} [Sat Sep 24 05:02:46 2022] DELETE /compute/v2.1/servers/ec88b440-40a0-459f-b94b-06c332e86094 => generated 0 bytes in 254 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Sep 24 05:02:46.957214 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-b1497284-fabf-4883-bf65-1d9e98aee256 tempest-DeleteServersTestJSON-1630660203 tempest-DeleteServersTestJSON-1630660203-project] Calling method '>' {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:02:46.957824 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.compute.api [None req-b1497284-fabf-4883-bf65-1d9e98aee256 tempest-DeleteServersTestJSON-1630660203 tempest-DeleteServersTestJSON-1630660203-project] [instance: ec88b440-40a0-459f-b94b-06c332e86094] Fetching instance by UUID {{(pid=120593) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:02:46.963633 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-b1497284-fabf-4883-bf65-1d9e98aee256 tempest-DeleteServersTestJSON-1630660203 tempest-DeleteServersTestJSON-1630660203-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:02:46.964119 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-b1497284-fabf-4883-bf65-1d9e98aee256 tempest-DeleteServersTestJSON-1630660203 tempest-DeleteServersTestJSON-1630660203-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:02:46.964554 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-b1497284-fabf-4883-bf65-1d9e98aee256 tempest-DeleteServersTestJSON-1630660203 tempest-DeleteServersTestJSON-1630660203-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:02:46.965248 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-b1497284-fabf-4883-bf65-1d9e98aee256 tempest-DeleteServersTestJSON-1630660203 tempest-DeleteServersTestJSON-1630660203-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:02:46.965701 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-b1497284-fabf-4883-bf65-1d9e98aee256 tempest-DeleteServersTestJSON-1630660203 tempest-DeleteServersTestJSON-1630660203-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:02:46.966158 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-b1497284-fabf-4883-bf65-1d9e98aee256 tempest-DeleteServersTestJSON-1630660203 tempest-DeleteServersTestJSON-1630660203-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:02:47.100137 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-b1497284-fabf-4883-bf65-1d9e98aee256 tempest-DeleteServersTestJSON-1630660203 tempest-DeleteServersTestJSON-1630660203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27d1a24c9e15493195744bcbf598ac4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa84dfa1cc764dc99b6e804e778c3479', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:02:47.108593 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-b1497284-fabf-4883-bf65-1d9e98aee256 tempest-DeleteServersTestJSON-1630660203 tempest-DeleteServersTestJSON-1630660203-project] 10.222.0.50 "GET /compute/v2.1/servers/ec88b440-40a0-459f-b94b-06c332e86094" status: 200 len: 1554 microversion: 2.1 time: 0.155253 Sep 24 05:02:47.109151 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 171/372] 10.222.0.50 () {58 vars in 1236 bytes} [Sat Sep 24 05:02:46 2022] GET /compute/v2.1/servers/ec88b440-40a0-459f-b94b-06c332e86094 => generated 1554 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 05:02:47.937720 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-2e7abc2d-d485-474e-9008-508d7aaf2426 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Calling method '>' {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:02:47.938441 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.compute.api [None req-2e7abc2d-d485-474e-9008-508d7aaf2426 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] [instance: 50eed27b-6da2-4dda-94cc-02fc5cfec071] Fetching instance by UUID {{(pid=120594) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:02:47.944999 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-2e7abc2d-d485-474e-9008-508d7aaf2426 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:02:47.945338 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-2e7abc2d-d485-474e-9008-508d7aaf2426 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:02:47.945910 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-2e7abc2d-d485-474e-9008-508d7aaf2426 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:02:47.946707 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-2e7abc2d-d485-474e-9008-508d7aaf2426 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:02:47.947160 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-2e7abc2d-d485-474e-9008-508d7aaf2426 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:02:47.947584 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-2e7abc2d-d485-474e-9008-508d7aaf2426 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:02:48.072702 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.policy [None req-2e7abc2d-d485-474e-9008-508d7aaf2426 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cdd0da2c7bc4139bcd48ef36a2ee183', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a18a3756ba2b460d977f738a115ebfe0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:02:48.080780 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [None req-2e7abc2d-d485-474e-9008-508d7aaf2426 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] 10.222.0.50 "GET /compute/v2.1/servers/50eed27b-6da2-4dda-94cc-02fc5cfec071" status: 200 len: 1522 microversion: 2.1 time: 0.149081 Sep 24 05:02:48.081332 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 202/373] 10.222.0.50 () {58 vars in 1236 bytes} [Sat Sep 24 05:02:47 2022] GET /compute/v2.1/servers/50eed27b-6da2-4dda-94cc-02fc5cfec071 => generated 1522 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 05:02:48.131735 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-03d213bf-ca75-42d4-a591-dca47b571087 tempest-DeleteServersTestJSON-1630660203 tempest-DeleteServersTestJSON-1630660203-project] Calling method '>' {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:02:48.132334 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.compute.api [None req-03d213bf-ca75-42d4-a591-dca47b571087 tempest-DeleteServersTestJSON-1630660203 tempest-DeleteServersTestJSON-1630660203-project] [instance: ec88b440-40a0-459f-b94b-06c332e86094] Fetching instance by UUID {{(pid=120593) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:02:48.138624 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-03d213bf-ca75-42d4-a591-dca47b571087 tempest-DeleteServersTestJSON-1630660203 tempest-DeleteServersTestJSON-1630660203-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:02:48.139089 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-03d213bf-ca75-42d4-a591-dca47b571087 tempest-DeleteServersTestJSON-1630660203 tempest-DeleteServersTestJSON-1630660203-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:02:48.139539 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-03d213bf-ca75-42d4-a591-dca47b571087 tempest-DeleteServersTestJSON-1630660203 tempest-DeleteServersTestJSON-1630660203-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:02:48.140206 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-03d213bf-ca75-42d4-a591-dca47b571087 tempest-DeleteServersTestJSON-1630660203 tempest-DeleteServersTestJSON-1630660203-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:02:48.140652 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-03d213bf-ca75-42d4-a591-dca47b571087 tempest-DeleteServersTestJSON-1630660203 tempest-DeleteServersTestJSON-1630660203-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:02:48.141065 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-03d213bf-ca75-42d4-a591-dca47b571087 tempest-DeleteServersTestJSON-1630660203 tempest-DeleteServersTestJSON-1630660203-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:02:48.145353 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG dbcounter [-] [120593] Writing DB stats nova_cell1:SELECT=100 {{(pid=120593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 05:02:48.270547 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-03d213bf-ca75-42d4-a591-dca47b571087 tempest-DeleteServersTestJSON-1630660203 tempest-DeleteServersTestJSON-1630660203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27d1a24c9e15493195744bcbf598ac4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa84dfa1cc764dc99b6e804e778c3479', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:02:48.278968 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-03d213bf-ca75-42d4-a591-dca47b571087 tempest-DeleteServersTestJSON-1630660203 tempest-DeleteServersTestJSON-1630660203-project] 10.222.0.50 "GET /compute/v2.1/servers/ec88b440-40a0-459f-b94b-06c332e86094" status: 200 len: 1554 microversion: 2.1 time: 0.150896 Sep 24 05:02:48.279577 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 172/374] 10.222.0.50 () {58 vars in 1236 bytes} [Sat Sep 24 05:02:48 2022] GET /compute/v2.1/servers/ec88b440-40a0-459f-b94b-06c332e86094 => generated 1554 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 05:02:49.103017 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-f0acc690-3a4b-4894-bbc9-a3dba002303f tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Calling method '>' {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:02:49.103625 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.compute.api [None req-f0acc690-3a4b-4894-bbc9-a3dba002303f tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] [instance: 50eed27b-6da2-4dda-94cc-02fc5cfec071] Fetching instance by UUID {{(pid=120594) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:02:49.110054 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-f0acc690-3a4b-4894-bbc9-a3dba002303f tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:02:49.110567 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-f0acc690-3a4b-4894-bbc9-a3dba002303f tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:02:49.111007 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-f0acc690-3a4b-4894-bbc9-a3dba002303f tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:02:49.111879 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-f0acc690-3a4b-4894-bbc9-a3dba002303f tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:02:49.112338 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-f0acc690-3a4b-4894-bbc9-a3dba002303f tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:02:49.112763 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-f0acc690-3a4b-4894-bbc9-a3dba002303f tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:02:49.280526 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.policy [None req-f0acc690-3a4b-4894-bbc9-a3dba002303f tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cdd0da2c7bc4139bcd48ef36a2ee183', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a18a3756ba2b460d977f738a115ebfe0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:02:49.291463 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [None req-f0acc690-3a4b-4894-bbc9-a3dba002303f tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] 10.222.0.50 "GET /compute/v2.1/servers/50eed27b-6da2-4dda-94cc-02fc5cfec071" status: 200 len: 1522 microversion: 2.1 time: 0.192026 Sep 24 05:02:49.292567 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 203/375] 10.222.0.50 () {58 vars in 1236 bytes} [Sat Sep 24 05:02:49 2022] GET /compute/v2.1/servers/50eed27b-6da2-4dda-94cc-02fc5cfec071 => generated 1522 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 05:02:49.303061 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-f430976a-e501-4de2-ae31-8418169502e4 tempest-DeleteServersTestJSON-1630660203 tempest-DeleteServersTestJSON-1630660203-project] Calling method '>' {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:02:49.303793 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.compute.api [None req-f430976a-e501-4de2-ae31-8418169502e4 tempest-DeleteServersTestJSON-1630660203 tempest-DeleteServersTestJSON-1630660203-project] [instance: ec88b440-40a0-459f-b94b-06c332e86094] Fetching instance by UUID {{(pid=120593) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:02:49.311304 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-f430976a-e501-4de2-ae31-8418169502e4 tempest-DeleteServersTestJSON-1630660203 tempest-DeleteServersTestJSON-1630660203-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:02:49.312125 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-f430976a-e501-4de2-ae31-8418169502e4 tempest-DeleteServersTestJSON-1630660203 tempest-DeleteServersTestJSON-1630660203-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:02:49.312796 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-f430976a-e501-4de2-ae31-8418169502e4 tempest-DeleteServersTestJSON-1630660203 tempest-DeleteServersTestJSON-1630660203-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:02:49.313710 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-f430976a-e501-4de2-ae31-8418169502e4 tempest-DeleteServersTestJSON-1630660203 tempest-DeleteServersTestJSON-1630660203-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:02:49.314442 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-f430976a-e501-4de2-ae31-8418169502e4 tempest-DeleteServersTestJSON-1630660203 tempest-DeleteServersTestJSON-1630660203-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:02:49.315274 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-f430976a-e501-4de2-ae31-8418169502e4 tempest-DeleteServersTestJSON-1630660203 tempest-DeleteServersTestJSON-1630660203-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:02:49.522410 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-f430976a-e501-4de2-ae31-8418169502e4 tempest-DeleteServersTestJSON-1630660203 tempest-DeleteServersTestJSON-1630660203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27d1a24c9e15493195744bcbf598ac4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa84dfa1cc764dc99b6e804e778c3479', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:02:49.532017 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-f430976a-e501-4de2-ae31-8418169502e4 tempest-DeleteServersTestJSON-1630660203 tempest-DeleteServersTestJSON-1630660203-project] 10.222.0.50 "GET /compute/v2.1/servers/ec88b440-40a0-459f-b94b-06c332e86094" status: 200 len: 1554 microversion: 2.1 time: 0.233147 Sep 24 05:02:49.532605 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 173/376] 10.222.0.50 () {58 vars in 1236 bytes} [Sat Sep 24 05:02:49 2022] GET /compute/v2.1/servers/ec88b440-40a0-459f-b94b-06c332e86094 => generated 1554 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 05:02:50.316124 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-4af3d24e-84ff-4b19-9819-3b6144ae236f tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Calling method '>' {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:02:50.317309 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.compute.api [None req-4af3d24e-84ff-4b19-9819-3b6144ae236f tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] [instance: 50eed27b-6da2-4dda-94cc-02fc5cfec071] Fetching instance by UUID {{(pid=120594) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:02:50.323353 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-4af3d24e-84ff-4b19-9819-3b6144ae236f tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:02:50.323835 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-4af3d24e-84ff-4b19-9819-3b6144ae236f tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:02:50.324274 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-4af3d24e-84ff-4b19-9819-3b6144ae236f tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:02:50.324962 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-4af3d24e-84ff-4b19-9819-3b6144ae236f tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:02:50.325415 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-4af3d24e-84ff-4b19-9819-3b6144ae236f tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:02:50.325836 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-4af3d24e-84ff-4b19-9819-3b6144ae236f tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:02:50.468061 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.policy [None req-4af3d24e-84ff-4b19-9819-3b6144ae236f tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cdd0da2c7bc4139bcd48ef36a2ee183', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a18a3756ba2b460d977f738a115ebfe0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:02:50.478625 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [None req-4af3d24e-84ff-4b19-9819-3b6144ae236f tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] 10.222.0.50 "GET /compute/v2.1/servers/50eed27b-6da2-4dda-94cc-02fc5cfec071" status: 200 len: 1522 microversion: 2.1 time: 0.166997 Sep 24 05:02:50.479202 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 204/377] 10.222.0.50 () {58 vars in 1236 bytes} [Sat Sep 24 05:02:50 2022] GET /compute/v2.1/servers/50eed27b-6da2-4dda-94cc-02fc5cfec071 => generated 1522 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 05:02:50.556723 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-c5eb4137-780c-4a44-a2ba-0142d7ffe5b4 tempest-DeleteServersTestJSON-1630660203 tempest-DeleteServersTestJSON-1630660203-project] Calling method '>' {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:02:50.557515 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.compute.api [None req-c5eb4137-780c-4a44-a2ba-0142d7ffe5b4 tempest-DeleteServersTestJSON-1630660203 tempest-DeleteServersTestJSON-1630660203-project] [instance: ec88b440-40a0-459f-b94b-06c332e86094] Fetching instance by UUID {{(pid=120593) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:02:50.567310 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-c5eb4137-780c-4a44-a2ba-0142d7ffe5b4 tempest-DeleteServersTestJSON-1630660203 tempest-DeleteServersTestJSON-1630660203-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:02:50.567872 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-c5eb4137-780c-4a44-a2ba-0142d7ffe5b4 tempest-DeleteServersTestJSON-1630660203 tempest-DeleteServersTestJSON-1630660203-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:02:50.568486 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-c5eb4137-780c-4a44-a2ba-0142d7ffe5b4 tempest-DeleteServersTestJSON-1630660203 tempest-DeleteServersTestJSON-1630660203-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:02:50.570402 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-c5eb4137-780c-4a44-a2ba-0142d7ffe5b4 tempest-DeleteServersTestJSON-1630660203 tempest-DeleteServersTestJSON-1630660203-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:02:50.570877 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-c5eb4137-780c-4a44-a2ba-0142d7ffe5b4 tempest-DeleteServersTestJSON-1630660203 tempest-DeleteServersTestJSON-1630660203-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:02:50.571309 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-c5eb4137-780c-4a44-a2ba-0142d7ffe5b4 tempest-DeleteServersTestJSON-1630660203 tempest-DeleteServersTestJSON-1630660203-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:02:50.744975 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-c5eb4137-780c-4a44-a2ba-0142d7ffe5b4 tempest-DeleteServersTestJSON-1630660203 tempest-DeleteServersTestJSON-1630660203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27d1a24c9e15493195744bcbf598ac4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa84dfa1cc764dc99b6e804e778c3479', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:02:50.757829 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-c5eb4137-780c-4a44-a2ba-0142d7ffe5b4 tempest-DeleteServersTestJSON-1630660203 tempest-DeleteServersTestJSON-1630660203-project] 10.222.0.50 "GET /compute/v2.1/servers/ec88b440-40a0-459f-b94b-06c332e86094" status: 200 len: 1554 microversion: 2.1 time: 0.205827 Sep 24 05:02:50.759980 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 174/378] 10.222.0.50 () {58 vars in 1236 bytes} [Sat Sep 24 05:02:50 2022] GET /compute/v2.1/servers/ec88b440-40a0-459f-b94b-06c332e86094 => generated 1554 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 05:02:51.229047 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [req-e915064b-a722-4d69-84d2-6d5ddcf76983 req-097af652-6bfa-419e-9cdf-4618e4d31535 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ec88b440-40a0-459f-b94b-06c332e86094", "name": "network-vif-deleted", "tag": "290d6de0-525c-40c7-8eec-34ce73fcc7b9"}]} {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 05:02:51.242268 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [req-e915064b-a722-4d69-84d2-6d5ddcf76983 req-097af652-6bfa-419e-9cdf-4618e4d31535 service nova] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:02:51.242814 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [req-e915064b-a722-4d69-84d2-6d5ddcf76983 req-097af652-6bfa-419e-9cdf-4618e4d31535 service nova] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:02:51.244041 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [req-e915064b-a722-4d69-84d2-6d5ddcf76983 req-097af652-6bfa-419e-9cdf-4618e4d31535 service nova] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:02:51.259805 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: INFO nova.api.openstack.compute.server_external_events [req-e915064b-a722-4d69-84d2-6d5ddcf76983 req-097af652-6bfa-419e-9cdf-4618e4d31535 service nova] Creating event network-vif-deleted:290d6de0-525c-40c7-8eec-34ce73fcc7b9 for instance ec88b440-40a0-459f-b94b-06c332e86094 on hv-cinder-85918 Sep 24 05:02:51.266062 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [req-e915064b-a722-4d69-84d2-6d5ddcf76983 req-097af652-6bfa-419e-9cdf-4618e4d31535 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043835 Sep 24 05:02:51.267827 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 205/379] 10.222.0.50 () {64 vars in 1317 bytes} [Sat Sep 24 05:02:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 05:02:51.501913 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-fdc1f683-0cdb-4306-8a4f-1bea3e2c4490 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Calling method '>' {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:02:51.502573 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.compute.api [None req-fdc1f683-0cdb-4306-8a4f-1bea3e2c4490 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] [instance: 50eed27b-6da2-4dda-94cc-02fc5cfec071] Fetching instance by UUID {{(pid=120593) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:02:51.508428 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-fdc1f683-0cdb-4306-8a4f-1bea3e2c4490 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:02:51.508902 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-fdc1f683-0cdb-4306-8a4f-1bea3e2c4490 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:02:51.509569 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-fdc1f683-0cdb-4306-8a4f-1bea3e2c4490 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:02:51.510276 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-fdc1f683-0cdb-4306-8a4f-1bea3e2c4490 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:02:51.510713 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-fdc1f683-0cdb-4306-8a4f-1bea3e2c4490 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:02:51.511127 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-fdc1f683-0cdb-4306-8a4f-1bea3e2c4490 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:02:51.644551 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-fdc1f683-0cdb-4306-8a4f-1bea3e2c4490 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cdd0da2c7bc4139bcd48ef36a2ee183', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a18a3756ba2b460d977f738a115ebfe0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:02:51.654065 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-fdc1f683-0cdb-4306-8a4f-1bea3e2c4490 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] 10.222.0.50 "GET /compute/v2.1/servers/50eed27b-6da2-4dda-94cc-02fc5cfec071" status: 200 len: 1522 microversion: 2.1 time: 0.156654 Sep 24 05:02:51.655441 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 175/380] 10.222.0.50 () {58 vars in 1236 bytes} [Sat Sep 24 05:02:51 2022] GET /compute/v2.1/servers/50eed27b-6da2-4dda-94cc-02fc5cfec071 => generated 1522 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 05:02:51.785456 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-21adfd99-e7bc-4aec-ad9c-4a92c7df7358 tempest-DeleteServersTestJSON-1630660203 tempest-DeleteServersTestJSON-1630660203-project] Calling method '>' {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:02:51.786263 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.compute.api [None req-21adfd99-e7bc-4aec-ad9c-4a92c7df7358 tempest-DeleteServersTestJSON-1630660203 tempest-DeleteServersTestJSON-1630660203-project] [instance: ec88b440-40a0-459f-b94b-06c332e86094] Fetching instance by UUID {{(pid=120594) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:02:51.792491 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-21adfd99-e7bc-4aec-ad9c-4a92c7df7358 tempest-DeleteServersTestJSON-1630660203 tempest-DeleteServersTestJSON-1630660203-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:02:51.793047 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-21adfd99-e7bc-4aec-ad9c-4a92c7df7358 tempest-DeleteServersTestJSON-1630660203 tempest-DeleteServersTestJSON-1630660203-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:02:51.793551 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-21adfd99-e7bc-4aec-ad9c-4a92c7df7358 tempest-DeleteServersTestJSON-1630660203 tempest-DeleteServersTestJSON-1630660203-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:02:51.794323 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-21adfd99-e7bc-4aec-ad9c-4a92c7df7358 tempest-DeleteServersTestJSON-1630660203 tempest-DeleteServersTestJSON-1630660203-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:02:51.794769 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-21adfd99-e7bc-4aec-ad9c-4a92c7df7358 tempest-DeleteServersTestJSON-1630660203 tempest-DeleteServersTestJSON-1630660203-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:02:51.795181 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-21adfd99-e7bc-4aec-ad9c-4a92c7df7358 tempest-DeleteServersTestJSON-1630660203 tempest-DeleteServersTestJSON-1630660203-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:02:51.859000 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.policy [None req-21adfd99-e7bc-4aec-ad9c-4a92c7df7358 tempest-DeleteServersTestJSON-1630660203 tempest-DeleteServersTestJSON-1630660203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27d1a24c9e15493195744bcbf598ac4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa84dfa1cc764dc99b6e804e778c3479', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:02:51.867561 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [None req-21adfd99-e7bc-4aec-ad9c-4a92c7df7358 tempest-DeleteServersTestJSON-1630660203 tempest-DeleteServersTestJSON-1630660203-project] 10.222.0.50 "GET /compute/v2.1/servers/ec88b440-40a0-459f-b94b-06c332e86094" status: 200 len: 1346 microversion: 2.1 time: 0.086584 Sep 24 05:02:51.868437 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 206/381] 10.222.0.50 () {58 vars in 1236 bytes} [Sat Sep 24 05:02:51 2022] GET /compute/v2.1/servers/ec88b440-40a0-459f-b94b-06c332e86094 => generated 1346 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 05:02:52.677756 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-caaa206d-62ce-4e8f-a032-dba6afc0c5f6 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Calling method '>' {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:02:52.678620 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.compute.api [None req-caaa206d-62ce-4e8f-a032-dba6afc0c5f6 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] [instance: 50eed27b-6da2-4dda-94cc-02fc5cfec071] Fetching instance by UUID {{(pid=120593) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:02:52.684938 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-caaa206d-62ce-4e8f-a032-dba6afc0c5f6 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:02:52.685424 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-caaa206d-62ce-4e8f-a032-dba6afc0c5f6 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:02:52.685865 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-caaa206d-62ce-4e8f-a032-dba6afc0c5f6 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:02:52.686639 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-caaa206d-62ce-4e8f-a032-dba6afc0c5f6 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:02:52.687089 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-caaa206d-62ce-4e8f-a032-dba6afc0c5f6 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:02:52.687513 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-caaa206d-62ce-4e8f-a032-dba6afc0c5f6 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:02:52.823378 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-caaa206d-62ce-4e8f-a032-dba6afc0c5f6 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cdd0da2c7bc4139bcd48ef36a2ee183', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a18a3756ba2b460d977f738a115ebfe0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:02:52.833964 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-caaa206d-62ce-4e8f-a032-dba6afc0c5f6 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] 10.222.0.50 "GET /compute/v2.1/servers/50eed27b-6da2-4dda-94cc-02fc5cfec071" status: 200 len: 1522 microversion: 2.1 time: 0.160005 Sep 24 05:02:52.834565 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 176/382] 10.222.0.50 () {58 vars in 1236 bytes} [Sat Sep 24 05:02:52 2022] GET /compute/v2.1/servers/50eed27b-6da2-4dda-94cc-02fc5cfec071 => generated 1522 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 05:02:52.891390 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-bf6bd07c-29a4-459c-b6c5-8503a7bf54ed tempest-DeleteServersTestJSON-1630660203 tempest-DeleteServersTestJSON-1630660203-project] Calling method '>' {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:02:52.892257 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.compute.api [None req-bf6bd07c-29a4-459c-b6c5-8503a7bf54ed tempest-DeleteServersTestJSON-1630660203 tempest-DeleteServersTestJSON-1630660203-project] [instance: ec88b440-40a0-459f-b94b-06c332e86094] Fetching instance by UUID {{(pid=120594) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:02:52.898250 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-bf6bd07c-29a4-459c-b6c5-8503a7bf54ed tempest-DeleteServersTestJSON-1630660203 tempest-DeleteServersTestJSON-1630660203-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:02:52.898733 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-bf6bd07c-29a4-459c-b6c5-8503a7bf54ed tempest-DeleteServersTestJSON-1630660203 tempest-DeleteServersTestJSON-1630660203-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:02:52.899170 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-bf6bd07c-29a4-459c-b6c5-8503a7bf54ed tempest-DeleteServersTestJSON-1630660203 tempest-DeleteServersTestJSON-1630660203-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:02:52.899859 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-bf6bd07c-29a4-459c-b6c5-8503a7bf54ed tempest-DeleteServersTestJSON-1630660203 tempest-DeleteServersTestJSON-1630660203-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:02:52.900307 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-bf6bd07c-29a4-459c-b6c5-8503a7bf54ed tempest-DeleteServersTestJSON-1630660203 tempest-DeleteServersTestJSON-1630660203-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:02:52.900758 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-bf6bd07c-29a4-459c-b6c5-8503a7bf54ed tempest-DeleteServersTestJSON-1630660203 tempest-DeleteServersTestJSON-1630660203-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:02:52.964682 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.policy [None req-bf6bd07c-29a4-459c-b6c5-8503a7bf54ed tempest-DeleteServersTestJSON-1630660203 tempest-DeleteServersTestJSON-1630660203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27d1a24c9e15493195744bcbf598ac4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa84dfa1cc764dc99b6e804e778c3479', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:02:52.972732 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [None req-bf6bd07c-29a4-459c-b6c5-8503a7bf54ed tempest-DeleteServersTestJSON-1630660203 tempest-DeleteServersTestJSON-1630660203-project] 10.222.0.50 "GET /compute/v2.1/servers/ec88b440-40a0-459f-b94b-06c332e86094" status: 200 len: 1346 microversion: 2.1 time: 0.086447 Sep 24 05:02:52.973290 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 207/383] 10.222.0.50 () {58 vars in 1236 bytes} [Sat Sep 24 05:02:52 2022] GET /compute/v2.1/servers/ec88b440-40a0-459f-b94b-06c332e86094 => generated 1346 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 05:02:53.857264 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-ad87b434-aefb-4dc8-bb92-df55f760a6d3 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Calling method '>' {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:02:53.857864 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.compute.api [None req-ad87b434-aefb-4dc8-bb92-df55f760a6d3 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] [instance: 50eed27b-6da2-4dda-94cc-02fc5cfec071] Fetching instance by UUID {{(pid=120593) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:02:53.864213 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-ad87b434-aefb-4dc8-bb92-df55f760a6d3 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:02:53.864697 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-ad87b434-aefb-4dc8-bb92-df55f760a6d3 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:02:53.865132 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-ad87b434-aefb-4dc8-bb92-df55f760a6d3 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:02:53.865816 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-ad87b434-aefb-4dc8-bb92-df55f760a6d3 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:02:53.866289 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-ad87b434-aefb-4dc8-bb92-df55f760a6d3 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:02:53.866711 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-ad87b434-aefb-4dc8-bb92-df55f760a6d3 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:02:53.992166 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-ad87b434-aefb-4dc8-bb92-df55f760a6d3 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cdd0da2c7bc4139bcd48ef36a2ee183', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a18a3756ba2b460d977f738a115ebfe0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:02:53.995123 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-dfe089ff-6357-49a0-8a83-49e8ce398784 tempest-DeleteServersTestJSON-1630660203 tempest-DeleteServersTestJSON-1630660203-project] Calling method '>' {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:02:53.995729 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.compute.api [None req-dfe089ff-6357-49a0-8a83-49e8ce398784 tempest-DeleteServersTestJSON-1630660203 tempest-DeleteServersTestJSON-1630660203-project] [instance: ec88b440-40a0-459f-b94b-06c332e86094] Fetching instance by UUID {{(pid=120594) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:02:54.000532 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-ad87b434-aefb-4dc8-bb92-df55f760a6d3 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] 10.222.0.50 "GET /compute/v2.1/servers/50eed27b-6da2-4dda-94cc-02fc5cfec071" status: 200 len: 1522 microversion: 2.1 time: 0.147085 Sep 24 05:02:54.001439 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 177/384] 10.222.0.50 () {58 vars in 1236 bytes} [Sat Sep 24 05:02:53 2022] GET /compute/v2.1/servers/50eed27b-6da2-4dda-94cc-02fc5cfec071 => generated 1522 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 05:02:54.002252 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-dfe089ff-6357-49a0-8a83-49e8ce398784 tempest-DeleteServersTestJSON-1630660203 tempest-DeleteServersTestJSON-1630660203-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:02:54.002733 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-dfe089ff-6357-49a0-8a83-49e8ce398784 tempest-DeleteServersTestJSON-1630660203 tempest-DeleteServersTestJSON-1630660203-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:02:54.003198 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-dfe089ff-6357-49a0-8a83-49e8ce398784 tempest-DeleteServersTestJSON-1630660203 tempest-DeleteServersTestJSON-1630660203-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:02:54.003883 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-dfe089ff-6357-49a0-8a83-49e8ce398784 tempest-DeleteServersTestJSON-1630660203 tempest-DeleteServersTestJSON-1630660203-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:02:54.004329 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-dfe089ff-6357-49a0-8a83-49e8ce398784 tempest-DeleteServersTestJSON-1630660203 tempest-DeleteServersTestJSON-1630660203-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:02:54.004743 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-dfe089ff-6357-49a0-8a83-49e8ce398784 tempest-DeleteServersTestJSON-1630660203 tempest-DeleteServersTestJSON-1630660203-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:02:54.064889 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.policy [None req-dfe089ff-6357-49a0-8a83-49e8ce398784 tempest-DeleteServersTestJSON-1630660203 tempest-DeleteServersTestJSON-1630660203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27d1a24c9e15493195744bcbf598ac4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa84dfa1cc764dc99b6e804e778c3479', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:02:54.073056 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [None req-dfe089ff-6357-49a0-8a83-49e8ce398784 tempest-DeleteServersTestJSON-1630660203 tempest-DeleteServersTestJSON-1630660203-project] 10.222.0.50 "GET /compute/v2.1/servers/ec88b440-40a0-459f-b94b-06c332e86094" status: 200 len: 1346 microversion: 2.1 time: 0.081687 Sep 24 05:02:54.073612 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 208/385] 10.222.0.50 () {58 vars in 1236 bytes} [Sat Sep 24 05:02:53 2022] GET /compute/v2.1/servers/ec88b440-40a0-459f-b94b-06c332e86094 => generated 1346 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 24 05:02:55.023215 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-0ce7b059-bcf1-4cc5-8b06-cef220e95fc2 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Calling method '>' {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:02:55.023820 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.compute.api [None req-0ce7b059-bcf1-4cc5-8b06-cef220e95fc2 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] [instance: 50eed27b-6da2-4dda-94cc-02fc5cfec071] Fetching instance by UUID {{(pid=120593) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:02:55.030899 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-0ce7b059-bcf1-4cc5-8b06-cef220e95fc2 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:02:55.031378 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-0ce7b059-bcf1-4cc5-8b06-cef220e95fc2 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:02:55.031809 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-0ce7b059-bcf1-4cc5-8b06-cef220e95fc2 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:02:55.032494 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-0ce7b059-bcf1-4cc5-8b06-cef220e95fc2 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:02:55.032969 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-0ce7b059-bcf1-4cc5-8b06-cef220e95fc2 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:02:55.033603 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-0ce7b059-bcf1-4cc5-8b06-cef220e95fc2 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:02:55.096019 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-dbb3e69b-3c83-49ba-a4f3-8c2cd4e672a9 tempest-DeleteServersTestJSON-1630660203 tempest-DeleteServersTestJSON-1630660203-project] Calling method '>' {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:02:55.096641 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.compute.api [None req-dbb3e69b-3c83-49ba-a4f3-8c2cd4e672a9 tempest-DeleteServersTestJSON-1630660203 tempest-DeleteServersTestJSON-1630660203-project] [instance: ec88b440-40a0-459f-b94b-06c332e86094] Fetching instance by UUID {{(pid=120594) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:02:55.103724 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-dbb3e69b-3c83-49ba-a4f3-8c2cd4e672a9 tempest-DeleteServersTestJSON-1630660203 tempest-DeleteServersTestJSON-1630660203-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:02:55.104459 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-dbb3e69b-3c83-49ba-a4f3-8c2cd4e672a9 tempest-DeleteServersTestJSON-1630660203 tempest-DeleteServersTestJSON-1630660203-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:02:55.104920 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-dbb3e69b-3c83-49ba-a4f3-8c2cd4e672a9 tempest-DeleteServersTestJSON-1630660203 tempest-DeleteServersTestJSON-1630660203-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:02:55.105626 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-dbb3e69b-3c83-49ba-a4f3-8c2cd4e672a9 tempest-DeleteServersTestJSON-1630660203 tempest-DeleteServersTestJSON-1630660203-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:02:55.106241 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-dbb3e69b-3c83-49ba-a4f3-8c2cd4e672a9 tempest-DeleteServersTestJSON-1630660203 tempest-DeleteServersTestJSON-1630660203-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:02:55.106665 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-dbb3e69b-3c83-49ba-a4f3-8c2cd4e672a9 tempest-DeleteServersTestJSON-1630660203 tempest-DeleteServersTestJSON-1630660203-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:02:55.173801 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.policy [None req-dbb3e69b-3c83-49ba-a4f3-8c2cd4e672a9 tempest-DeleteServersTestJSON-1630660203 tempest-DeleteServersTestJSON-1630660203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27d1a24c9e15493195744bcbf598ac4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa84dfa1cc764dc99b6e804e778c3479', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:02:55.177272 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG dbcounter [-] [120594] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 05:02:55.183202 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [None req-dbb3e69b-3c83-49ba-a4f3-8c2cd4e672a9 tempest-DeleteServersTestJSON-1630660203 tempest-DeleteServersTestJSON-1630660203-project] 10.222.0.50 "GET /compute/v2.1/servers/ec88b440-40a0-459f-b94b-06c332e86094" status: 200 len: 1346 microversion: 2.1 time: 0.091260 Sep 24 05:02:55.183785 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 209/386] 10.222.0.50 () {58 vars in 1236 bytes} [Sat Sep 24 05:02:55 2022] GET /compute/v2.1/servers/ec88b440-40a0-459f-b94b-06c332e86094 => generated 1346 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 24 05:02:55.188534 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-0ce7b059-bcf1-4cc5-8b06-cef220e95fc2 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cdd0da2c7bc4139bcd48ef36a2ee183', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a18a3756ba2b460d977f738a115ebfe0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:02:55.201506 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-0ce7b059-bcf1-4cc5-8b06-cef220e95fc2 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] 10.222.0.50 "GET /compute/v2.1/servers/50eed27b-6da2-4dda-94cc-02fc5cfec071" status: 200 len: 1522 microversion: 2.1 time: 0.181913 Sep 24 05:02:55.203200 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 178/387] 10.222.0.50 () {58 vars in 1236 bytes} [Sat Sep 24 05:02:55 2022] GET /compute/v2.1/servers/50eed27b-6da2-4dda-94cc-02fc5cfec071 => generated 1522 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 05:02:56.209175 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-c0b51e2f-2fab-4aa6-bd26-9f6e31a85b01 tempest-DeleteServersTestJSON-1630660203 tempest-DeleteServersTestJSON-1630660203-project] Calling method '>' {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:02:56.209785 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.compute.api [None req-c0b51e2f-2fab-4aa6-bd26-9f6e31a85b01 tempest-DeleteServersTestJSON-1630660203 tempest-DeleteServersTestJSON-1630660203-project] [instance: ec88b440-40a0-459f-b94b-06c332e86094] Fetching instance by UUID {{(pid=120594) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:02:56.218177 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-c0b51e2f-2fab-4aa6-bd26-9f6e31a85b01 tempest-DeleteServersTestJSON-1630660203 tempest-DeleteServersTestJSON-1630660203-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:02:56.218982 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-c0b51e2f-2fab-4aa6-bd26-9f6e31a85b01 tempest-DeleteServersTestJSON-1630660203 tempest-DeleteServersTestJSON-1630660203-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:02:56.219455 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-c0b51e2f-2fab-4aa6-bd26-9f6e31a85b01 tempest-DeleteServersTestJSON-1630660203 tempest-DeleteServersTestJSON-1630660203-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:02:56.220151 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-c0b51e2f-2fab-4aa6-bd26-9f6e31a85b01 tempest-DeleteServersTestJSON-1630660203 tempest-DeleteServersTestJSON-1630660203-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:02:56.220635 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-c0b51e2f-2fab-4aa6-bd26-9f6e31a85b01 tempest-DeleteServersTestJSON-1630660203 tempest-DeleteServersTestJSON-1630660203-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:02:56.221054 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-c0b51e2f-2fab-4aa6-bd26-9f6e31a85b01 tempest-DeleteServersTestJSON-1630660203 tempest-DeleteServersTestJSON-1630660203-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:02:56.224883 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-cb95da82-97be-4248-9117-7dfb8ab346f8 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Calling method '>' {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:02:56.225660 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.compute.api [None req-cb95da82-97be-4248-9117-7dfb8ab346f8 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] [instance: 50eed27b-6da2-4dda-94cc-02fc5cfec071] Fetching instance by UUID {{(pid=120593) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:02:56.232169 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-cb95da82-97be-4248-9117-7dfb8ab346f8 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:02:56.232653 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-cb95da82-97be-4248-9117-7dfb8ab346f8 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:02:56.233575 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-cb95da82-97be-4248-9117-7dfb8ab346f8 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:02:56.234307 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-cb95da82-97be-4248-9117-7dfb8ab346f8 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:02:56.234822 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-cb95da82-97be-4248-9117-7dfb8ab346f8 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:02:56.235244 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-cb95da82-97be-4248-9117-7dfb8ab346f8 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:02:56.299096 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.policy [None req-c0b51e2f-2fab-4aa6-bd26-9f6e31a85b01 tempest-DeleteServersTestJSON-1630660203 tempest-DeleteServersTestJSON-1630660203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27d1a24c9e15493195744bcbf598ac4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa84dfa1cc764dc99b6e804e778c3479', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:02:56.307855 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [None req-c0b51e2f-2fab-4aa6-bd26-9f6e31a85b01 tempest-DeleteServersTestJSON-1630660203 tempest-DeleteServersTestJSON-1630660203-project] 10.222.0.50 "GET /compute/v2.1/servers/ec88b440-40a0-459f-b94b-06c332e86094" status: 200 len: 1346 microversion: 2.1 time: 0.102527 Sep 24 05:02:56.308685 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 210/388] 10.222.0.50 () {58 vars in 1236 bytes} [Sat Sep 24 05:02:56 2022] GET /compute/v2.1/servers/ec88b440-40a0-459f-b94b-06c332e86094 => generated 1346 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 05:02:56.385099 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-cb95da82-97be-4248-9117-7dfb8ab346f8 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cdd0da2c7bc4139bcd48ef36a2ee183', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a18a3756ba2b460d977f738a115ebfe0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:02:56.393196 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-cb95da82-97be-4248-9117-7dfb8ab346f8 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] 10.222.0.50 "GET /compute/v2.1/servers/50eed27b-6da2-4dda-94cc-02fc5cfec071" status: 200 len: 1522 microversion: 2.1 time: 0.172191 Sep 24 05:02:56.393773 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 179/389] 10.222.0.50 () {58 vars in 1236 bytes} [Sat Sep 24 05:02:56 2022] GET /compute/v2.1/servers/50eed27b-6da2-4dda-94cc-02fc5cfec071 => generated 1522 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 24 05:02:57.331009 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-0a506492-e668-4ac8-b854-19f37bdcb59a tempest-DeleteServersTestJSON-1630660203 tempest-DeleteServersTestJSON-1630660203-project] Calling method '>' {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:02:57.331693 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.compute.api [None req-0a506492-e668-4ac8-b854-19f37bdcb59a tempest-DeleteServersTestJSON-1630660203 tempest-DeleteServersTestJSON-1630660203-project] [instance: ec88b440-40a0-459f-b94b-06c332e86094] Fetching instance by UUID {{(pid=120594) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:02:57.337532 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-0a506492-e668-4ac8-b854-19f37bdcb59a tempest-DeleteServersTestJSON-1630660203 tempest-DeleteServersTestJSON-1630660203-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:02:57.338026 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-0a506492-e668-4ac8-b854-19f37bdcb59a tempest-DeleteServersTestJSON-1630660203 tempest-DeleteServersTestJSON-1630660203-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:02:57.338465 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-0a506492-e668-4ac8-b854-19f37bdcb59a tempest-DeleteServersTestJSON-1630660203 tempest-DeleteServersTestJSON-1630660203-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:02:57.339143 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-0a506492-e668-4ac8-b854-19f37bdcb59a tempest-DeleteServersTestJSON-1630660203 tempest-DeleteServersTestJSON-1630660203-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:02:57.339588 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-0a506492-e668-4ac8-b854-19f37bdcb59a tempest-DeleteServersTestJSON-1630660203 tempest-DeleteServersTestJSON-1630660203-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:02:57.340002 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-0a506492-e668-4ac8-b854-19f37bdcb59a tempest-DeleteServersTestJSON-1630660203 tempest-DeleteServersTestJSON-1630660203-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:02:57.370633 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-0a506492-e668-4ac8-b854-19f37bdcb59a tempest-DeleteServersTestJSON-1630660203 tempest-DeleteServersTestJSON-1630660203-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:02:57.371099 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-0a506492-e668-4ac8-b854-19f37bdcb59a tempest-DeleteServersTestJSON-1630660203 tempest-DeleteServersTestJSON-1630660203-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:02:57.371526 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-0a506492-e668-4ac8-b854-19f37bdcb59a tempest-DeleteServersTestJSON-1630660203 tempest-DeleteServersTestJSON-1630660203-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:02:57.371956 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.objects.instance [None req-0a506492-e668-4ac8-b854-19f37bdcb59a tempest-DeleteServersTestJSON-1630660203 tempest-DeleteServersTestJSON-1630660203-project] Lazy-loading 'fault' on Instance uuid ec88b440-40a0-459f-b94b-06c332e86094 {{(pid=120594) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 24 05:02:57.416057 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-420cf438-b10c-4784-84c0-d7f9000d3547 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Calling method '>' {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:02:57.416503 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.policy [None req-0a506492-e668-4ac8-b854-19f37bdcb59a tempest-DeleteServersTestJSON-1630660203 tempest-DeleteServersTestJSON-1630660203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27d1a24c9e15493195744bcbf598ac4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa84dfa1cc764dc99b6e804e778c3479', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:02:57.416687 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.compute.api [None req-420cf438-b10c-4784-84c0-d7f9000d3547 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] [instance: 50eed27b-6da2-4dda-94cc-02fc5cfec071] Fetching instance by UUID {{(pid=120593) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:02:57.423579 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-420cf438-b10c-4784-84c0-d7f9000d3547 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:02:57.424057 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-420cf438-b10c-4784-84c0-d7f9000d3547 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:02:57.424487 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-420cf438-b10c-4784-84c0-d7f9000d3547 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:02:57.425165 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-420cf438-b10c-4784-84c0-d7f9000d3547 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:02:57.425455 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [None req-0a506492-e668-4ac8-b854-19f37bdcb59a tempest-DeleteServersTestJSON-1630660203 tempest-DeleteServersTestJSON-1630660203-project] 10.222.0.50 "GET /compute/v2.1/servers/ec88b440-40a0-459f-b94b-06c332e86094" status: 200 len: 1351 microversion: 2.1 time: 0.098312 Sep 24 05:02:57.425606 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-420cf438-b10c-4784-84c0-d7f9000d3547 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:02:57.426042 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-420cf438-b10c-4784-84c0-d7f9000d3547 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:02:57.426167 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 211/390] 10.222.0.50 () {58 vars in 1236 bytes} [Sat Sep 24 05:02:57 2022] GET /compute/v2.1/servers/ec88b440-40a0-459f-b94b-06c332e86094 => generated 1351 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 05:02:57.557702 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-420cf438-b10c-4784-84c0-d7f9000d3547 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cdd0da2c7bc4139bcd48ef36a2ee183', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a18a3756ba2b460d977f738a115ebfe0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:02:57.565373 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-420cf438-b10c-4784-84c0-d7f9000d3547 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] 10.222.0.50 "GET /compute/v2.1/servers/50eed27b-6da2-4dda-94cc-02fc5cfec071" status: 200 len: 1522 microversion: 2.1 time: 0.153141 Sep 24 05:02:57.565933 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 180/391] 10.222.0.50 () {58 vars in 1236 bytes} [Sat Sep 24 05:02:57 2022] GET /compute/v2.1/servers/50eed27b-6da2-4dda-94cc-02fc5cfec071 => generated 1522 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 24 05:02:58.448769 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-6df00cf4-46b8-4f0a-9819-78bed28a5b3a tempest-DeleteServersTestJSON-1630660203 tempest-DeleteServersTestJSON-1630660203-project] Calling method '>' {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:02:58.449363 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.compute.api [None req-6df00cf4-46b8-4f0a-9819-78bed28a5b3a tempest-DeleteServersTestJSON-1630660203 tempest-DeleteServersTestJSON-1630660203-project] [instance: ec88b440-40a0-459f-b94b-06c332e86094] Fetching instance by UUID {{(pid=120594) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:02:58.455739 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-6df00cf4-46b8-4f0a-9819-78bed28a5b3a tempest-DeleteServersTestJSON-1630660203 tempest-DeleteServersTestJSON-1630660203-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:02:58.456213 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-6df00cf4-46b8-4f0a-9819-78bed28a5b3a tempest-DeleteServersTestJSON-1630660203 tempest-DeleteServersTestJSON-1630660203-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:02:58.456637 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-6df00cf4-46b8-4f0a-9819-78bed28a5b3a tempest-DeleteServersTestJSON-1630660203 tempest-DeleteServersTestJSON-1630660203-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:02:58.457306 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-6df00cf4-46b8-4f0a-9819-78bed28a5b3a tempest-DeleteServersTestJSON-1630660203 tempest-DeleteServersTestJSON-1630660203-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:02:58.457749 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-6df00cf4-46b8-4f0a-9819-78bed28a5b3a tempest-DeleteServersTestJSON-1630660203 tempest-DeleteServersTestJSON-1630660203-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:02:58.458195 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-6df00cf4-46b8-4f0a-9819-78bed28a5b3a tempest-DeleteServersTestJSON-1630660203 tempest-DeleteServersTestJSON-1630660203-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:02:58.489250 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-6df00cf4-46b8-4f0a-9819-78bed28a5b3a tempest-DeleteServersTestJSON-1630660203 tempest-DeleteServersTestJSON-1630660203-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:02:58.489714 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-6df00cf4-46b8-4f0a-9819-78bed28a5b3a tempest-DeleteServersTestJSON-1630660203 tempest-DeleteServersTestJSON-1630660203-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:02:58.490177 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-6df00cf4-46b8-4f0a-9819-78bed28a5b3a tempest-DeleteServersTestJSON-1630660203 tempest-DeleteServersTestJSON-1630660203-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:02:58.490614 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.objects.instance [None req-6df00cf4-46b8-4f0a-9819-78bed28a5b3a tempest-DeleteServersTestJSON-1630660203 tempest-DeleteServersTestJSON-1630660203-project] Lazy-loading 'fault' on Instance uuid ec88b440-40a0-459f-b94b-06c332e86094 {{(pid=120594) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 24 05:02:58.530958 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.policy [None req-6df00cf4-46b8-4f0a-9819-78bed28a5b3a tempest-DeleteServersTestJSON-1630660203 tempest-DeleteServersTestJSON-1630660203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27d1a24c9e15493195744bcbf598ac4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa84dfa1cc764dc99b6e804e778c3479', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:02:58.539592 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [None req-6df00cf4-46b8-4f0a-9819-78bed28a5b3a tempest-DeleteServersTestJSON-1630660203 tempest-DeleteServersTestJSON-1630660203-project] 10.222.0.50 "GET /compute/v2.1/servers/ec88b440-40a0-459f-b94b-06c332e86094" status: 200 len: 1351 microversion: 2.1 time: 0.094454 Sep 24 05:02:58.539996 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 212/392] 10.222.0.50 () {58 vars in 1236 bytes} [Sat Sep 24 05:02:58 2022] GET /compute/v2.1/servers/ec88b440-40a0-459f-b94b-06c332e86094 => generated 1351 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 05:02:58.587380 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-0e4abbaf-6de9-4a4f-804b-ddbcd9002943 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Calling method '>' {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:02:58.587994 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.compute.api [None req-0e4abbaf-6de9-4a4f-804b-ddbcd9002943 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] [instance: 50eed27b-6da2-4dda-94cc-02fc5cfec071] Fetching instance by UUID {{(pid=120593) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:02:58.595219 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-0e4abbaf-6de9-4a4f-804b-ddbcd9002943 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:02:58.595632 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-0e4abbaf-6de9-4a4f-804b-ddbcd9002943 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:02:58.596066 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-0e4abbaf-6de9-4a4f-804b-ddbcd9002943 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:02:58.596754 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-0e4abbaf-6de9-4a4f-804b-ddbcd9002943 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:02:58.597203 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-0e4abbaf-6de9-4a4f-804b-ddbcd9002943 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:02:58.597622 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-0e4abbaf-6de9-4a4f-804b-ddbcd9002943 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:02:58.736302 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-0e4abbaf-6de9-4a4f-804b-ddbcd9002943 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cdd0da2c7bc4139bcd48ef36a2ee183', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a18a3756ba2b460d977f738a115ebfe0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:02:58.743930 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-0e4abbaf-6de9-4a4f-804b-ddbcd9002943 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] 10.222.0.50 "GET /compute/v2.1/servers/50eed27b-6da2-4dda-94cc-02fc5cfec071" status: 200 len: 1522 microversion: 2.1 time: 0.160287 Sep 24 05:02:58.744493 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 181/393] 10.222.0.50 () {58 vars in 1236 bytes} [Sat Sep 24 05:02:58 2022] GET /compute/v2.1/servers/50eed27b-6da2-4dda-94cc-02fc5cfec071 => generated 1522 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 05:02:59.562187 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-42fbd5a7-50c5-449e-b43f-179e24c6e93c tempest-DeleteServersTestJSON-1630660203 tempest-DeleteServersTestJSON-1630660203-project] Calling method '>' {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:02:59.562821 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.compute.api [None req-42fbd5a7-50c5-449e-b43f-179e24c6e93c tempest-DeleteServersTestJSON-1630660203 tempest-DeleteServersTestJSON-1630660203-project] [instance: ec88b440-40a0-459f-b94b-06c332e86094] Fetching instance by UUID {{(pid=120594) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:02:59.568827 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-42fbd5a7-50c5-449e-b43f-179e24c6e93c tempest-DeleteServersTestJSON-1630660203 tempest-DeleteServersTestJSON-1630660203-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:02:59.569303 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-42fbd5a7-50c5-449e-b43f-179e24c6e93c tempest-DeleteServersTestJSON-1630660203 tempest-DeleteServersTestJSON-1630660203-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:02:59.569776 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-42fbd5a7-50c5-449e-b43f-179e24c6e93c tempest-DeleteServersTestJSON-1630660203 tempest-DeleteServersTestJSON-1630660203-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:02:59.570715 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-42fbd5a7-50c5-449e-b43f-179e24c6e93c tempest-DeleteServersTestJSON-1630660203 tempest-DeleteServersTestJSON-1630660203-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:02:59.571170 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-42fbd5a7-50c5-449e-b43f-179e24c6e93c tempest-DeleteServersTestJSON-1630660203 tempest-DeleteServersTestJSON-1630660203-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:02:59.571592 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-42fbd5a7-50c5-449e-b43f-179e24c6e93c tempest-DeleteServersTestJSON-1630660203 tempest-DeleteServersTestJSON-1630660203-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:02:59.602363 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-42fbd5a7-50c5-449e-b43f-179e24c6e93c tempest-DeleteServersTestJSON-1630660203 tempest-DeleteServersTestJSON-1630660203-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:02:59.602838 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-42fbd5a7-50c5-449e-b43f-179e24c6e93c tempest-DeleteServersTestJSON-1630660203 tempest-DeleteServersTestJSON-1630660203-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:02:59.603264 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-42fbd5a7-50c5-449e-b43f-179e24c6e93c tempest-DeleteServersTestJSON-1630660203 tempest-DeleteServersTestJSON-1630660203-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:02:59.603700 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.objects.instance [None req-42fbd5a7-50c5-449e-b43f-179e24c6e93c tempest-DeleteServersTestJSON-1630660203 tempest-DeleteServersTestJSON-1630660203-project] Lazy-loading 'fault' on Instance uuid ec88b440-40a0-459f-b94b-06c332e86094 {{(pid=120594) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 24 05:02:59.644231 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.policy [None req-42fbd5a7-50c5-449e-b43f-179e24c6e93c tempest-DeleteServersTestJSON-1630660203 tempest-DeleteServersTestJSON-1630660203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27d1a24c9e15493195744bcbf598ac4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa84dfa1cc764dc99b6e804e778c3479', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:02:59.652781 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [None req-42fbd5a7-50c5-449e-b43f-179e24c6e93c tempest-DeleteServersTestJSON-1630660203 tempest-DeleteServersTestJSON-1630660203-project] 10.222.0.50 "GET /compute/v2.1/servers/ec88b440-40a0-459f-b94b-06c332e86094" status: 200 len: 1351 microversion: 2.1 time: 0.094965 Sep 24 05:02:59.657990 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 213/394] 10.222.0.50 () {58 vars in 1236 bytes} [Sat Sep 24 05:02:59 2022] GET /compute/v2.1/servers/ec88b440-40a0-459f-b94b-06c332e86094 => generated 1351 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 05:02:59.765894 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-51f868c1-a843-4c60-9272-94e75bc8a1e2 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Calling method '>' {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:02:59.766555 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.compute.api [None req-51f868c1-a843-4c60-9272-94e75bc8a1e2 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] [instance: 50eed27b-6da2-4dda-94cc-02fc5cfec071] Fetching instance by UUID {{(pid=120593) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:02:59.773347 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-51f868c1-a843-4c60-9272-94e75bc8a1e2 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:02:59.773827 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-51f868c1-a843-4c60-9272-94e75bc8a1e2 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:02:59.774288 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-51f868c1-a843-4c60-9272-94e75bc8a1e2 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:02:59.774978 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-51f868c1-a843-4c60-9272-94e75bc8a1e2 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:02:59.775464 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-51f868c1-a843-4c60-9272-94e75bc8a1e2 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:02:59.775889 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-51f868c1-a843-4c60-9272-94e75bc8a1e2 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:02:59.903464 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-51f868c1-a843-4c60-9272-94e75bc8a1e2 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cdd0da2c7bc4139bcd48ef36a2ee183', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a18a3756ba2b460d977f738a115ebfe0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:02:59.911998 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-51f868c1-a843-4c60-9272-94e75bc8a1e2 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] 10.222.0.50 "GET /compute/v2.1/servers/50eed27b-6da2-4dda-94cc-02fc5cfec071" status: 200 len: 1522 microversion: 2.1 time: 0.149954 Sep 24 05:02:59.912556 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 182/395] 10.222.0.50 () {58 vars in 1236 bytes} [Sat Sep 24 05:02:59 2022] GET /compute/v2.1/servers/50eed27b-6da2-4dda-94cc-02fc5cfec071 => generated 1522 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 05:03:00.676397 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-331da695-9329-4625-9304-0ce106267136 tempest-DeleteServersTestJSON-1630660203 tempest-DeleteServersTestJSON-1630660203-project] Calling method '>' {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:03:00.677000 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.compute.api [None req-331da695-9329-4625-9304-0ce106267136 tempest-DeleteServersTestJSON-1630660203 tempest-DeleteServersTestJSON-1630660203-project] [instance: ec88b440-40a0-459f-b94b-06c332e86094] Fetching instance by UUID {{(pid=120594) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:03:00.682903 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-331da695-9329-4625-9304-0ce106267136 tempest-DeleteServersTestJSON-1630660203 tempest-DeleteServersTestJSON-1630660203-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:03:00.683387 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-331da695-9329-4625-9304-0ce106267136 tempest-DeleteServersTestJSON-1630660203 tempest-DeleteServersTestJSON-1630660203-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:03:00.683819 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-331da695-9329-4625-9304-0ce106267136 tempest-DeleteServersTestJSON-1630660203 tempest-DeleteServersTestJSON-1630660203-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:03:00.684503 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-331da695-9329-4625-9304-0ce106267136 tempest-DeleteServersTestJSON-1630660203 tempest-DeleteServersTestJSON-1630660203-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:03:00.684953 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-331da695-9329-4625-9304-0ce106267136 tempest-DeleteServersTestJSON-1630660203 tempest-DeleteServersTestJSON-1630660203-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:03:00.685375 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-331da695-9329-4625-9304-0ce106267136 tempest-DeleteServersTestJSON-1630660203 tempest-DeleteServersTestJSON-1630660203-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:03:00.720177 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-331da695-9329-4625-9304-0ce106267136 tempest-DeleteServersTestJSON-1630660203 tempest-DeleteServersTestJSON-1630660203-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:03:00.720652 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-331da695-9329-4625-9304-0ce106267136 tempest-DeleteServersTestJSON-1630660203 tempest-DeleteServersTestJSON-1630660203-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:03:00.721078 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-331da695-9329-4625-9304-0ce106267136 tempest-DeleteServersTestJSON-1630660203 tempest-DeleteServersTestJSON-1630660203-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:03:00.721584 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.objects.instance [None req-331da695-9329-4625-9304-0ce106267136 tempest-DeleteServersTestJSON-1630660203 tempest-DeleteServersTestJSON-1630660203-project] Lazy-loading 'fault' on Instance uuid ec88b440-40a0-459f-b94b-06c332e86094 {{(pid=120594) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 24 05:03:00.762193 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.policy [None req-331da695-9329-4625-9304-0ce106267136 tempest-DeleteServersTestJSON-1630660203 tempest-DeleteServersTestJSON-1630660203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27d1a24c9e15493195744bcbf598ac4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa84dfa1cc764dc99b6e804e778c3479', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:03:00.771381 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [None req-331da695-9329-4625-9304-0ce106267136 tempest-DeleteServersTestJSON-1630660203 tempest-DeleteServersTestJSON-1630660203-project] 10.222.0.50 "GET /compute/v2.1/servers/ec88b440-40a0-459f-b94b-06c332e86094" status: 200 len: 1351 microversion: 2.1 time: 0.098758 Sep 24 05:03:00.772091 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 214/396] 10.222.0.50 () {58 vars in 1236 bytes} [Sat Sep 24 05:03:00 2022] GET /compute/v2.1/servers/ec88b440-40a0-459f-b94b-06c332e86094 => generated 1351 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 05:03:00.934259 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-83e0ec3b-d3d7-428d-82ca-f94a5ea8dcd4 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Calling method '>' {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:03:00.934799 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.compute.api [None req-83e0ec3b-d3d7-428d-82ca-f94a5ea8dcd4 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] [instance: 50eed27b-6da2-4dda-94cc-02fc5cfec071] Fetching instance by UUID {{(pid=120593) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:03:00.941988 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-83e0ec3b-d3d7-428d-82ca-f94a5ea8dcd4 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:03:00.942492 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-83e0ec3b-d3d7-428d-82ca-f94a5ea8dcd4 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:03:00.942953 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-83e0ec3b-d3d7-428d-82ca-f94a5ea8dcd4 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:03:00.943634 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-83e0ec3b-d3d7-428d-82ca-f94a5ea8dcd4 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:03:00.944083 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-83e0ec3b-d3d7-428d-82ca-f94a5ea8dcd4 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:03:00.944502 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-83e0ec3b-d3d7-428d-82ca-f94a5ea8dcd4 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:03:01.071389 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-83e0ec3b-d3d7-428d-82ca-f94a5ea8dcd4 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cdd0da2c7bc4139bcd48ef36a2ee183', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a18a3756ba2b460d977f738a115ebfe0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:03:01.080218 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-83e0ec3b-d3d7-428d-82ca-f94a5ea8dcd4 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] 10.222.0.50 "GET /compute/v2.1/servers/50eed27b-6da2-4dda-94cc-02fc5cfec071" status: 200 len: 1522 microversion: 2.1 time: 0.149787 Sep 24 05:03:01.080845 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 183/397] 10.222.0.50 () {58 vars in 1236 bytes} [Sat Sep 24 05:03:00 2022] GET /compute/v2.1/servers/50eed27b-6da2-4dda-94cc-02fc5cfec071 => generated 1522 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 05:03:01.793690 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-432cc008-ea23-44f3-bba1-033847d2d0fd tempest-DeleteServersTestJSON-1630660203 tempest-DeleteServersTestJSON-1630660203-project] Calling method '>' {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:03:01.794360 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.compute.api [None req-432cc008-ea23-44f3-bba1-033847d2d0fd tempest-DeleteServersTestJSON-1630660203 tempest-DeleteServersTestJSON-1630660203-project] [instance: ec88b440-40a0-459f-b94b-06c332e86094] Fetching instance by UUID {{(pid=120594) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:03:01.800761 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-432cc008-ea23-44f3-bba1-033847d2d0fd tempest-DeleteServersTestJSON-1630660203 tempest-DeleteServersTestJSON-1630660203-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:03:01.801237 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-432cc008-ea23-44f3-bba1-033847d2d0fd tempest-DeleteServersTestJSON-1630660203 tempest-DeleteServersTestJSON-1630660203-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:03:01.801665 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-432cc008-ea23-44f3-bba1-033847d2d0fd tempest-DeleteServersTestJSON-1630660203 tempest-DeleteServersTestJSON-1630660203-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:03:01.802379 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-432cc008-ea23-44f3-bba1-033847d2d0fd tempest-DeleteServersTestJSON-1630660203 tempest-DeleteServersTestJSON-1630660203-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:03:01.802827 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-432cc008-ea23-44f3-bba1-033847d2d0fd tempest-DeleteServersTestJSON-1630660203 tempest-DeleteServersTestJSON-1630660203-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:03:01.803240 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-432cc008-ea23-44f3-bba1-033847d2d0fd tempest-DeleteServersTestJSON-1630660203 tempest-DeleteServersTestJSON-1630660203-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:03:01.833987 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-432cc008-ea23-44f3-bba1-033847d2d0fd tempest-DeleteServersTestJSON-1630660203 tempest-DeleteServersTestJSON-1630660203-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:03:01.834487 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-432cc008-ea23-44f3-bba1-033847d2d0fd tempest-DeleteServersTestJSON-1630660203 tempest-DeleteServersTestJSON-1630660203-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:03:01.834925 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-432cc008-ea23-44f3-bba1-033847d2d0fd tempest-DeleteServersTestJSON-1630660203 tempest-DeleteServersTestJSON-1630660203-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:03:01.835355 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.objects.instance [None req-432cc008-ea23-44f3-bba1-033847d2d0fd tempest-DeleteServersTestJSON-1630660203 tempest-DeleteServersTestJSON-1630660203-project] Lazy-loading 'fault' on Instance uuid ec88b440-40a0-459f-b94b-06c332e86094 {{(pid=120594) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 24 05:03:01.875606 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.policy [None req-432cc008-ea23-44f3-bba1-033847d2d0fd tempest-DeleteServersTestJSON-1630660203 tempest-DeleteServersTestJSON-1630660203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27d1a24c9e15493195744bcbf598ac4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa84dfa1cc764dc99b6e804e778c3479', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:03:01.883566 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [None req-432cc008-ea23-44f3-bba1-033847d2d0fd tempest-DeleteServersTestJSON-1630660203 tempest-DeleteServersTestJSON-1630660203-project] 10.222.0.50 "GET /compute/v2.1/servers/ec88b440-40a0-459f-b94b-06c332e86094" status: 200 len: 1351 microversion: 2.1 time: 0.093673 Sep 24 05:03:01.884121 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 215/398] 10.222.0.50 () {58 vars in 1236 bytes} [Sat Sep 24 05:03:01 2022] GET /compute/v2.1/servers/ec88b440-40a0-459f-b94b-06c332e86094 => generated 1351 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 05:03:02.103001 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-aea4bd1c-9771-43e3-b732-091cc07271ce tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Calling method '>' {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:03:02.103607 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.compute.api [None req-aea4bd1c-9771-43e3-b732-091cc07271ce tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] [instance: 50eed27b-6da2-4dda-94cc-02fc5cfec071] Fetching instance by UUID {{(pid=120593) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:03:02.110549 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-aea4bd1c-9771-43e3-b732-091cc07271ce tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:03:02.111031 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-aea4bd1c-9771-43e3-b732-091cc07271ce tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:03:02.111463 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-aea4bd1c-9771-43e3-b732-091cc07271ce tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:03:02.112155 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-aea4bd1c-9771-43e3-b732-091cc07271ce tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:03:02.112606 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-aea4bd1c-9771-43e3-b732-091cc07271ce tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:03:02.113032 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-aea4bd1c-9771-43e3-b732-091cc07271ce tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:03:02.240742 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-aea4bd1c-9771-43e3-b732-091cc07271ce tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cdd0da2c7bc4139bcd48ef36a2ee183', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a18a3756ba2b460d977f738a115ebfe0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:03:02.248555 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-aea4bd1c-9771-43e3-b732-091cc07271ce tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] 10.222.0.50 "GET /compute/v2.1/servers/50eed27b-6da2-4dda-94cc-02fc5cfec071" status: 200 len: 1522 microversion: 2.1 time: 0.149415 Sep 24 05:03:02.249138 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 184/399] 10.222.0.50 () {58 vars in 1236 bytes} [Sat Sep 24 05:03:02 2022] GET /compute/v2.1/servers/50eed27b-6da2-4dda-94cc-02fc5cfec071 => generated 1522 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 05:03:02.906355 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-70ab32e0-1a51-4a53-a4cd-ff6082e97a15 tempest-DeleteServersTestJSON-1630660203 tempest-DeleteServersTestJSON-1630660203-project] Calling method '>' {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:03:02.906966 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.compute.api [None req-70ab32e0-1a51-4a53-a4cd-ff6082e97a15 tempest-DeleteServersTestJSON-1630660203 tempest-DeleteServersTestJSON-1630660203-project] [instance: ec88b440-40a0-459f-b94b-06c332e86094] Fetching instance by UUID {{(pid=120594) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:03:02.913724 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-70ab32e0-1a51-4a53-a4cd-ff6082e97a15 tempest-DeleteServersTestJSON-1630660203 tempest-DeleteServersTestJSON-1630660203-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:03:02.914362 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-70ab32e0-1a51-4a53-a4cd-ff6082e97a15 tempest-DeleteServersTestJSON-1630660203 tempest-DeleteServersTestJSON-1630660203-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:03:02.914801 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-70ab32e0-1a51-4a53-a4cd-ff6082e97a15 tempest-DeleteServersTestJSON-1630660203 tempest-DeleteServersTestJSON-1630660203-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:03:02.915517 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-70ab32e0-1a51-4a53-a4cd-ff6082e97a15 tempest-DeleteServersTestJSON-1630660203 tempest-DeleteServersTestJSON-1630660203-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:03:02.915965 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-70ab32e0-1a51-4a53-a4cd-ff6082e97a15 tempest-DeleteServersTestJSON-1630660203 tempest-DeleteServersTestJSON-1630660203-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:03:02.916380 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-70ab32e0-1a51-4a53-a4cd-ff6082e97a15 tempest-DeleteServersTestJSON-1630660203 tempest-DeleteServersTestJSON-1630660203-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:03:02.929587 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: INFO nova.api.openstack.wsgi [None req-70ab32e0-1a51-4a53-a4cd-ff6082e97a15 tempest-DeleteServersTestJSON-1630660203 tempest-DeleteServersTestJSON-1630660203-project] HTTP exception thrown: Instance ec88b440-40a0-459f-b94b-06c332e86094 could not be found. Sep 24 05:03:02.934172 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-70ab32e0-1a51-4a53-a4cd-ff6082e97a15 tempest-DeleteServersTestJSON-1630660203 tempest-DeleteServersTestJSON-1630660203-project] Request method failure captured: Sep 24 05:03:02.934172 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: request: GET /compute/v2.1/servers/ec88b440-40a0-459f-b94b-06c332e86094 HTTP/1.1 Sep 24 05:03:02.934172 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: Accept: application/json Sep 24 05:03:02.934172 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: Accept-Encoding: identity Sep 24 05:03:02.934172 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: Connection: close Sep 24 05:03:02.934172 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: Content-Length: 0 Sep 24 05:03:02.934172 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: Content-Type: application/json Sep 24 05:03:02.934172 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: Host: 10.222.0.50 Sep 24 05:03:02.934172 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: Openstack-System-Scope: None Sep 24 05:03:02.934172 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: User-Agent: python-urllib3/1.26.12 Sep 24 05:03:02.934172 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: X-Auth-Token: gAAAAABjLo8DvIS27N7_w2y1RKeuu9HDak3TofK8Dj80mp0_K4-GcMrr5Dbk5MUIe22gPSVip10rF73qvHziP2eZS1sagrJ2prp78zxuwuNi7aeU4k0zgw7hKMosAauJQt9JIpPyMXgVRTBk8Xa9fwgogbqVIad2guWiWumdGWAVz0hLYUhAWk4 Sep 24 05:03:02.934172 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: X-Domain-Id: None Sep 24 05:03:02.934172 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: X-Domain-Name: None Sep 24 05:03:02.934172 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: X-Identity-Status: Confirmed Sep 24 05:03:02.934172 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: X-Is-Admin-Project: True Sep 24 05:03:02.934172 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: X-Project-Domain-Id: default Sep 24 05:03:02.934172 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: X-Project-Domain-Name: Default Sep 24 05:03:02.934172 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: X-Project-Id: aa84dfa1cc764dc99b6e804e778c3479 Sep 24 05:03:02.934172 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: X-Project-Name: tempest-DeleteServersTestJSON-1630660203 Sep 24 05:03:02.934172 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: X-Role: member,reader Sep 24 05:03:02.934172 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: X-Roles: member,reader Sep 24 05:03:02.935611 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/aa84dfa1cc764dc99b6e804e778c3479"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/aa84dfa1cc764dc99b6e804e778c3479"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/aa84dfa1cc764dc99b6e804e778c3479"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.50:8080", "publicURL": "http://10.222.0.50:8080/v1/AUTH_aa84dfa1cc764dc99b6e804e778c3479"}]}] Sep 24 05:03:02.935611 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: X-Tenant: tempest-DeleteServersTestJSON-1630660203 Sep 24 05:03:02.935611 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: X-Tenant-Id: aa84dfa1cc764dc99b6e804e778c3479 Sep 24 05:03:02.935611 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: X-Tenant-Name: tempest-DeleteServersTestJSON-1630660203 Sep 24 05:03:02.935611 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: X-User: tempest-DeleteServersTestJSON-1630660203-project Sep 24 05:03:02.935611 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: X-User-Domain-Id: default Sep 24 05:03:02.935611 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: X-User-Domain-Name: Default Sep 24 05:03:02.935611 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: X-User-Id: 27d1a24c9e15493195744bcbf598ac4a Sep 24 05:03:02.935611 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: X-User-Name: tempest-DeleteServersTestJSON-1630660203-project Sep 24 05:03:02.935611 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: method: > Sep 24 05:03:02.935611 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: exception: Instance ec88b440-40a0-459f-b94b-06c332e86094 could not be found. Sep 24 05:03:02.935611 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: action_args: {'id': 'ec88b440-40a0-459f-b94b-06c332e86094'} Sep 24 05:03:02.936984 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 24 05:03:02.936984 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 05:03:02.936984 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 24 05:03:02.936984 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 24 05:03:02.936984 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 24 05:03:02.936984 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 24 05:03:02.936984 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 24 05:03:02.936984 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 24 05:03:02.936984 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 24 05:03:02.936984 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 24 05:03:02.936984 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ec88b440-40a0-459f-b94b-06c332e86094 could not be found. Sep 24 05:03:02.936984 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi Sep 24 05:03:02.936984 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 05:03:02.936984 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi Sep 24 05:03:02.936984 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 05:03:02.936984 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 05:03:02.936984 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 05:03:02.936984 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 24 05:03:02.936984 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 24 05:03:02.936984 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 24 05:03:02.938549 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 24 05:03:02.938549 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 24 05:03:02.938549 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 24 05:03:02.938549 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 24 05:03:02.938549 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 24 05:03:02.938549 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 24 05:03:02.938549 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 24 05:03:02.938549 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ec88b440-40a0-459f-b94b-06c332e86094 could not be found. Sep 24 05:03:02.938549 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi Sep 24 05:03:02.938549 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 05:03:02.938549 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi Sep 24 05:03:02.938549 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 05:03:02.938549 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 05:03:02.938549 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 05:03:02.938549 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 24 05:03:02.938549 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 24 05:03:02.938549 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ec88b440-40a0-459f-b94b-06c332e86094 could not be found. Sep 24 05:03:02.938549 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi Sep 24 05:03:02.939892 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-70ab32e0-1a51-4a53-a4cd-ff6082e97a15 tempest-DeleteServersTestJSON-1630660203 tempest-DeleteServersTestJSON-1630660203-project] Returning 404 to user: Instance ec88b440-40a0-459f-b94b-06c332e86094 could not be found. {{(pid=120594) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 24 05:03:02.939892 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [None req-70ab32e0-1a51-4a53-a4cd-ff6082e97a15 tempest-DeleteServersTestJSON-1630660203 tempest-DeleteServersTestJSON-1630660203-project] 10.222.0.50 "GET /compute/v2.1/servers/ec88b440-40a0-459f-b94b-06c332e86094" status: 404 len: 111 microversion: 2.1 time: 0.033156 Sep 24 05:03:02.939892 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 216/400] 10.222.0.50 () {58 vars in 1236 bytes} [Sat Sep 24 05:03:02 2022] GET /compute/v2.1/servers/ec88b440-40a0-459f-b94b-06c332e86094 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 24 05:03:03.049125 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-4d5aa684-8c6a-4b3d-8060-9f2bbfe40ac0 tempest-DeleteServersTestJSON-1630660203 tempest-DeleteServersTestJSON-1630660203-project] Calling method '>' {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:03:03.051322 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.compute.api [None req-4d5aa684-8c6a-4b3d-8060-9f2bbfe40ac0 tempest-DeleteServersTestJSON-1630660203 tempest-DeleteServersTestJSON-1630660203-project] [instance: ec88b440-40a0-459f-b94b-06c332e86094] Fetching instance by UUID {{(pid=120593) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:03:03.057168 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-4d5aa684-8c6a-4b3d-8060-9f2bbfe40ac0 tempest-DeleteServersTestJSON-1630660203 tempest-DeleteServersTestJSON-1630660203-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:03:03.057588 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-4d5aa684-8c6a-4b3d-8060-9f2bbfe40ac0 tempest-DeleteServersTestJSON-1630660203 tempest-DeleteServersTestJSON-1630660203-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:03:03.058041 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-4d5aa684-8c6a-4b3d-8060-9f2bbfe40ac0 tempest-DeleteServersTestJSON-1630660203 tempest-DeleteServersTestJSON-1630660203-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:03:03.058725 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-4d5aa684-8c6a-4b3d-8060-9f2bbfe40ac0 tempest-DeleteServersTestJSON-1630660203 tempest-DeleteServersTestJSON-1630660203-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:03:03.059173 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-4d5aa684-8c6a-4b3d-8060-9f2bbfe40ac0 tempest-DeleteServersTestJSON-1630660203 tempest-DeleteServersTestJSON-1630660203-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:03:03.059593 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-4d5aa684-8c6a-4b3d-8060-9f2bbfe40ac0 tempest-DeleteServersTestJSON-1630660203 tempest-DeleteServersTestJSON-1630660203-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:03:03.072254 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.wsgi [None req-4d5aa684-8c6a-4b3d-8060-9f2bbfe40ac0 tempest-DeleteServersTestJSON-1630660203 tempest-DeleteServersTestJSON-1630660203-project] HTTP exception thrown: Instance ec88b440-40a0-459f-b94b-06c332e86094 could not be found. Sep 24 05:03:03.076312 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-4d5aa684-8c6a-4b3d-8060-9f2bbfe40ac0 tempest-DeleteServersTestJSON-1630660203 tempest-DeleteServersTestJSON-1630660203-project] Request method failure captured: Sep 24 05:03:03.076312 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: request: GET /compute/v2.1/servers/ec88b440-40a0-459f-b94b-06c332e86094/os-volume_attachments HTTP/1.1 Sep 24 05:03:03.076312 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: Accept: application/json Sep 24 05:03:03.076312 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: Accept-Encoding: identity Sep 24 05:03:03.076312 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: Connection: close Sep 24 05:03:03.076312 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: Content-Length: 0 Sep 24 05:03:03.076312 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: Content-Type: application/json Sep 24 05:03:03.076312 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: Host: 10.222.0.50 Sep 24 05:03:03.076312 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: Openstack-System-Scope: None Sep 24 05:03:03.076312 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: User-Agent: python-urllib3/1.26.12 Sep 24 05:03:03.076312 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: X-Auth-Token: gAAAAABjLo8DvIS27N7_w2y1RKeuu9HDak3TofK8Dj80mp0_K4-GcMrr5Dbk5MUIe22gPSVip10rF73qvHziP2eZS1sagrJ2prp78zxuwuNi7aeU4k0zgw7hKMosAauJQt9JIpPyMXgVRTBk8Xa9fwgogbqVIad2guWiWumdGWAVz0hLYUhAWk4 Sep 24 05:03:03.076312 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: X-Domain-Id: None Sep 24 05:03:03.076312 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: X-Domain-Name: None Sep 24 05:03:03.076312 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: X-Identity-Status: Confirmed Sep 24 05:03:03.076312 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: X-Is-Admin-Project: True Sep 24 05:03:03.076312 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: X-Project-Domain-Id: default Sep 24 05:03:03.076312 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: X-Project-Domain-Name: Default Sep 24 05:03:03.076312 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: X-Project-Id: aa84dfa1cc764dc99b6e804e778c3479 Sep 24 05:03:03.076312 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: X-Project-Name: tempest-DeleteServersTestJSON-1630660203 Sep 24 05:03:03.076312 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: X-Role: member,reader Sep 24 05:03:03.076312 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: X-Roles: member,reader Sep 24 05:03:03.077697 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/aa84dfa1cc764dc99b6e804e778c3479"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/aa84dfa1cc764dc99b6e804e778c3479"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/aa84dfa1cc764dc99b6e804e778c3479"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.50:8080", "publicURL": "http://10.222.0.50:8080/v1/AUTH_aa84dfa1cc764dc99b6e804e778c3479"}]}] Sep 24 05:03:03.077697 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: X-Tenant: tempest-DeleteServersTestJSON-1630660203 Sep 24 05:03:03.077697 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: X-Tenant-Id: aa84dfa1cc764dc99b6e804e778c3479 Sep 24 05:03:03.077697 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: X-Tenant-Name: tempest-DeleteServersTestJSON-1630660203 Sep 24 05:03:03.077697 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: X-User: tempest-DeleteServersTestJSON-1630660203-project Sep 24 05:03:03.077697 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: X-User-Domain-Id: default Sep 24 05:03:03.077697 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: X-User-Domain-Name: Default Sep 24 05:03:03.077697 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: X-User-Id: 27d1a24c9e15493195744bcbf598ac4a Sep 24 05:03:03.077697 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: X-User-Name: tempest-DeleteServersTestJSON-1630660203-project Sep 24 05:03:03.077697 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: method: > Sep 24 05:03:03.077697 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: exception: Instance ec88b440-40a0-459f-b94b-06c332e86094 could not be found. Sep 24 05:03:03.077697 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: action_args: {'server_id': 'ec88b440-40a0-459f-b94b-06c332e86094'} Sep 24 05:03:03.078482 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 24 05:03:03.078482 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 05:03:03.078482 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 24 05:03:03.078482 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 24 05:03:03.078482 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 24 05:03:03.078482 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 24 05:03:03.078482 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 24 05:03:03.078482 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 24 05:03:03.078482 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 24 05:03:03.078482 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 24 05:03:03.078482 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ec88b440-40a0-459f-b94b-06c332e86094 could not be found. Sep 24 05:03:03.078482 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi Sep 24 05:03:03.078482 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 05:03:03.078482 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi Sep 24 05:03:03.078482 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 05:03:03.078482 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 05:03:03.078482 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 05:03:03.078482 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 24 05:03:03.078482 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 24 05:03:03.078482 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 24 05:03:03.079756 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 24 05:03:03.079756 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Sep 24 05:03:03.079756 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 24 05:03:03.079756 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Sep 24 05:03:03.079756 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 24 05:03:03.079756 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Sep 24 05:03:03.079756 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Sep 24 05:03:03.079756 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 24 05:03:03.079756 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 24 05:03:03.079756 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ec88b440-40a0-459f-b94b-06c332e86094 could not be found. Sep 24 05:03:03.079756 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi Sep 24 05:03:03.079756 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 05:03:03.079756 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi Sep 24 05:03:03.079756 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 05:03:03.079756 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 05:03:03.079756 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 05:03:03.079756 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 24 05:03:03.079756 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 24 05:03:03.079756 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ec88b440-40a0-459f-b94b-06c332e86094 could not be found. Sep 24 05:03:03.079756 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi Sep 24 05:03:03.081038 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-4d5aa684-8c6a-4b3d-8060-9f2bbfe40ac0 tempest-DeleteServersTestJSON-1630660203 tempest-DeleteServersTestJSON-1630660203-project] Returning 404 to user: Instance ec88b440-40a0-459f-b94b-06c332e86094 could not be found. {{(pid=120593) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 24 05:03:03.081038 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-4d5aa684-8c6a-4b3d-8060-9f2bbfe40ac0 tempest-DeleteServersTestJSON-1630660203 tempest-DeleteServersTestJSON-1630660203-project] 10.222.0.50 "GET /compute/v2.1/servers/ec88b440-40a0-459f-b94b-06c332e86094/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.033052 Sep 24 05:03:03.081038 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 185/401] 10.222.0.50 () {58 vars in 1302 bytes} [Sat Sep 24 05:03:03 2022] GET /compute/v2.1/servers/ec88b440-40a0-459f-b94b-06c332e86094/os-volume_attachments => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 24 05:03:03.271030 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-364da4e2-9b9c-44a0-ba42-aef61af63edd tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Calling method '>' {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:03:03.271639 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.compute.api [None req-364da4e2-9b9c-44a0-ba42-aef61af63edd tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] [instance: 50eed27b-6da2-4dda-94cc-02fc5cfec071] Fetching instance by UUID {{(pid=120594) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:03:03.277438 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-364da4e2-9b9c-44a0-ba42-aef61af63edd tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:03:03.277918 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-364da4e2-9b9c-44a0-ba42-aef61af63edd tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:03:03.278389 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-364da4e2-9b9c-44a0-ba42-aef61af63edd tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:03:03.279073 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-364da4e2-9b9c-44a0-ba42-aef61af63edd tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:03:03.279521 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-364da4e2-9b9c-44a0-ba42-aef61af63edd tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:03:03.279942 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-364da4e2-9b9c-44a0-ba42-aef61af63edd tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:03:03.406968 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.policy [None req-364da4e2-9b9c-44a0-ba42-aef61af63edd tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cdd0da2c7bc4139bcd48ef36a2ee183', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a18a3756ba2b460d977f738a115ebfe0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:03:03.414505 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [None req-364da4e2-9b9c-44a0-ba42-aef61af63edd tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] 10.222.0.50 "GET /compute/v2.1/servers/50eed27b-6da2-4dda-94cc-02fc5cfec071" status: 200 len: 1522 microversion: 2.1 time: 0.147666 Sep 24 05:03:03.415054 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 217/402] 10.222.0.50 () {58 vars in 1236 bytes} [Sat Sep 24 05:03:03 2022] GET /compute/v2.1/servers/50eed27b-6da2-4dda-94cc-02fc5cfec071 => generated 1522 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 05:03:04.437536 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-d7f9da6c-5e86-4019-865f-16c3924c00fa tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Calling method '>' {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:03:04.438224 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.compute.api [None req-d7f9da6c-5e86-4019-865f-16c3924c00fa tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] [instance: 50eed27b-6da2-4dda-94cc-02fc5cfec071] Fetching instance by UUID {{(pid=120593) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:03:04.440684 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG dbcounter [-] [120593] Writing DB stats nova_api:SELECT=56 {{(pid=120593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 05:03:04.446457 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-d7f9da6c-5e86-4019-865f-16c3924c00fa tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:03:04.446999 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-d7f9da6c-5e86-4019-865f-16c3924c00fa tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:03:04.447434 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-d7f9da6c-5e86-4019-865f-16c3924c00fa tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:03:04.448119 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-d7f9da6c-5e86-4019-865f-16c3924c00fa tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:03:04.448596 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-d7f9da6c-5e86-4019-865f-16c3924c00fa tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:03:04.449016 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-d7f9da6c-5e86-4019-865f-16c3924c00fa tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:03:04.581226 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-d7f9da6c-5e86-4019-865f-16c3924c00fa tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cdd0da2c7bc4139bcd48ef36a2ee183', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a18a3756ba2b460d977f738a115ebfe0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:03:04.588826 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-d7f9da6c-5e86-4019-865f-16c3924c00fa tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] 10.222.0.50 "GET /compute/v2.1/servers/50eed27b-6da2-4dda-94cc-02fc5cfec071" status: 200 len: 1522 microversion: 2.1 time: 0.155269 Sep 24 05:03:04.589390 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 186/403] 10.222.0.50 () {58 vars in 1236 bytes} [Sat Sep 24 05:03:04 2022] GET /compute/v2.1/servers/50eed27b-6da2-4dda-94cc-02fc5cfec071 => generated 1522 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 05:03:05.388752 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-00b62193-1b4d-49ca-a28a-ad93c8d628f8 tempest-DeleteServersTestJSON-1630660203 tempest-DeleteServersTestJSON-1630660203-project] Calling method '>' {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:03:05.390112 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.compute.api [None req-00b62193-1b4d-49ca-a28a-ad93c8d628f8 tempest-DeleteServersTestJSON-1630660203 tempest-DeleteServersTestJSON-1630660203-project] [instance: ec88b440-40a0-459f-b94b-06c332e86094] Fetching instance by UUID {{(pid=120594) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:03:05.392440 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG dbcounter [-] [120594] Writing DB stats nova_api:SELECT=71,nova_api:UPDATE=1 {{(pid=120594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 05:03:05.398802 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-00b62193-1b4d-49ca-a28a-ad93c8d628f8 tempest-DeleteServersTestJSON-1630660203 tempest-DeleteServersTestJSON-1630660203-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:03:05.399152 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-00b62193-1b4d-49ca-a28a-ad93c8d628f8 tempest-DeleteServersTestJSON-1630660203 tempest-DeleteServersTestJSON-1630660203-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:03:05.399798 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-00b62193-1b4d-49ca-a28a-ad93c8d628f8 tempest-DeleteServersTestJSON-1630660203 tempest-DeleteServersTestJSON-1630660203-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:03:05.400483 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-00b62193-1b4d-49ca-a28a-ad93c8d628f8 tempest-DeleteServersTestJSON-1630660203 tempest-DeleteServersTestJSON-1630660203-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:03:05.401078 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-00b62193-1b4d-49ca-a28a-ad93c8d628f8 tempest-DeleteServersTestJSON-1630660203 tempest-DeleteServersTestJSON-1630660203-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:03:05.401650 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-00b62193-1b4d-49ca-a28a-ad93c8d628f8 tempest-DeleteServersTestJSON-1630660203 tempest-DeleteServersTestJSON-1630660203-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:03:05.422504 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: INFO nova.api.openstack.wsgi [None req-00b62193-1b4d-49ca-a28a-ad93c8d628f8 tempest-DeleteServersTestJSON-1630660203 tempest-DeleteServersTestJSON-1630660203-project] HTTP exception thrown: Instance ec88b440-40a0-459f-b94b-06c332e86094 could not be found. Sep 24 05:03:05.424059 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-00b62193-1b4d-49ca-a28a-ad93c8d628f8 tempest-DeleteServersTestJSON-1630660203 tempest-DeleteServersTestJSON-1630660203-project] Request method failure captured: Sep 24 05:03:05.424059 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: request: DELETE /compute/v2.1/servers/ec88b440-40a0-459f-b94b-06c332e86094 HTTP/1.1 Sep 24 05:03:05.424059 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: Accept: application/json Sep 24 05:03:05.424059 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: Accept-Encoding: identity Sep 24 05:03:05.424059 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: Connection: close Sep 24 05:03:05.424059 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: Content-Length: 0 Sep 24 05:03:05.424059 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: Content-Type: application/json Sep 24 05:03:05.424059 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: Host: 10.222.0.50 Sep 24 05:03:05.424059 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: Openstack-System-Scope: None Sep 24 05:03:05.424059 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: User-Agent: python-urllib3/1.26.12 Sep 24 05:03:05.424059 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: X-Auth-Token: gAAAAABjLo8DvIS27N7_w2y1RKeuu9HDak3TofK8Dj80mp0_K4-GcMrr5Dbk5MUIe22gPSVip10rF73qvHziP2eZS1sagrJ2prp78zxuwuNi7aeU4k0zgw7hKMosAauJQt9JIpPyMXgVRTBk8Xa9fwgogbqVIad2guWiWumdGWAVz0hLYUhAWk4 Sep 24 05:03:05.424059 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: X-Domain-Id: None Sep 24 05:03:05.424059 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: X-Domain-Name: None Sep 24 05:03:05.424059 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: X-Identity-Status: Confirmed Sep 24 05:03:05.424059 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: X-Is-Admin-Project: True Sep 24 05:03:05.424059 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: X-Project-Domain-Id: default Sep 24 05:03:05.424059 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: X-Project-Domain-Name: Default Sep 24 05:03:05.424059 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: X-Project-Id: aa84dfa1cc764dc99b6e804e778c3479 Sep 24 05:03:05.424059 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: X-Project-Name: tempest-DeleteServersTestJSON-1630660203 Sep 24 05:03:05.424059 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: X-Role: member,reader Sep 24 05:03:05.424059 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: X-Roles: member,reader Sep 24 05:03:05.425296 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/aa84dfa1cc764dc99b6e804e778c3479"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/aa84dfa1cc764dc99b6e804e778c3479"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/aa84dfa1cc764dc99b6e804e778c3479"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.50:8080", "publicURL": "http://10.222.0.50:8080/v1/AUTH_aa84dfa1cc764dc99b6e804e778c3479"}]}] Sep 24 05:03:05.425296 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: X-Tenant: tempest-DeleteServersTestJSON-1630660203 Sep 24 05:03:05.425296 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: X-Tenant-Id: aa84dfa1cc764dc99b6e804e778c3479 Sep 24 05:03:05.425296 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: X-Tenant-Name: tempest-DeleteServersTestJSON-1630660203 Sep 24 05:03:05.425296 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: X-User: tempest-DeleteServersTestJSON-1630660203-project Sep 24 05:03:05.425296 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: X-User-Domain-Id: default Sep 24 05:03:05.425296 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: X-User-Domain-Name: Default Sep 24 05:03:05.425296 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: X-User-Id: 27d1a24c9e15493195744bcbf598ac4a Sep 24 05:03:05.425296 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: X-User-Name: tempest-DeleteServersTestJSON-1630660203-project Sep 24 05:03:05.425296 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: method: > Sep 24 05:03:05.425296 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: exception: Instance ec88b440-40a0-459f-b94b-06c332e86094 could not be found. Sep 24 05:03:05.425296 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: action_args: {'id': 'ec88b440-40a0-459f-b94b-06c332e86094'} Sep 24 05:03:05.426017 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 24 05:03:05.426017 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 05:03:05.426017 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 24 05:03:05.426017 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 24 05:03:05.426017 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 24 05:03:05.426017 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 24 05:03:05.426017 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 24 05:03:05.426017 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 24 05:03:05.426017 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 24 05:03:05.426017 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 24 05:03:05.426017 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ec88b440-40a0-459f-b94b-06c332e86094 could not be found. Sep 24 05:03:05.426017 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi Sep 24 05:03:05.426017 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 05:03:05.426017 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi Sep 24 05:03:05.426017 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 05:03:05.426017 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 05:03:05.426017 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 05:03:05.426017 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 24 05:03:05.426017 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 24 05:03:05.426017 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 24 05:03:05.427073 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 24 05:03:05.427073 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 24 05:03:05.427073 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 24 05:03:05.427073 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 24 05:03:05.427073 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 24 05:03:05.427073 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 24 05:03:05.427073 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 24 05:03:05.427073 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 24 05:03:05.427073 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 24 05:03:05.427073 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ec88b440-40a0-459f-b94b-06c332e86094 could not be found. Sep 24 05:03:05.427073 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi Sep 24 05:03:05.427073 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 05:03:05.427073 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi Sep 24 05:03:05.427073 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 05:03:05.427073 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 05:03:05.427073 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 05:03:05.427073 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 24 05:03:05.427073 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 24 05:03:05.427073 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ec88b440-40a0-459f-b94b-06c332e86094 could not be found. Sep 24 05:03:05.427073 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi Sep 24 05:03:05.429421 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-00b62193-1b4d-49ca-a28a-ad93c8d628f8 tempest-DeleteServersTestJSON-1630660203 tempest-DeleteServersTestJSON-1630660203-project] Returning 404 to user: Instance ec88b440-40a0-459f-b94b-06c332e86094 could not be found. {{(pid=120594) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 24 05:03:05.430274 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [None req-00b62193-1b4d-49ca-a28a-ad93c8d628f8 tempest-DeleteServersTestJSON-1630660203 tempest-DeleteServersTestJSON-1630660203-project] 10.222.0.50 "DELETE /compute/v2.1/servers/ec88b440-40a0-459f-b94b-06c332e86094" status: 404 len: 111 microversion: 2.1 time: 0.045353 Sep 24 05:03:05.431006 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 218/404] 10.222.0.50 () {58 vars in 1239 bytes} [Sat Sep 24 05:03:05 2022] DELETE /compute/v2.1/servers/ec88b440-40a0-459f-b94b-06c332e86094 => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 24 05:03:05.439065 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-91779353-d9d9-48d9-8e31-03e7e0290c7a tempest-DeleteServersTestJSON-1630660203 tempest-DeleteServersTestJSON-1630660203-project] Calling method '>' {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:03:05.439669 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.compute.api [None req-91779353-d9d9-48d9-8e31-03e7e0290c7a tempest-DeleteServersTestJSON-1630660203 tempest-DeleteServersTestJSON-1630660203-project] [instance: ec88b440-40a0-459f-b94b-06c332e86094] Fetching instance by UUID {{(pid=120593) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:03:05.446137 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-91779353-d9d9-48d9-8e31-03e7e0290c7a tempest-DeleteServersTestJSON-1630660203 tempest-DeleteServersTestJSON-1630660203-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:03:05.446625 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-91779353-d9d9-48d9-8e31-03e7e0290c7a tempest-DeleteServersTestJSON-1630660203 tempest-DeleteServersTestJSON-1630660203-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:03:05.447055 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-91779353-d9d9-48d9-8e31-03e7e0290c7a tempest-DeleteServersTestJSON-1630660203 tempest-DeleteServersTestJSON-1630660203-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:03:05.447746 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-91779353-d9d9-48d9-8e31-03e7e0290c7a tempest-DeleteServersTestJSON-1630660203 tempest-DeleteServersTestJSON-1630660203-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:03:05.448191 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-91779353-d9d9-48d9-8e31-03e7e0290c7a tempest-DeleteServersTestJSON-1630660203 tempest-DeleteServersTestJSON-1630660203-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:03:05.448608 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-91779353-d9d9-48d9-8e31-03e7e0290c7a tempest-DeleteServersTestJSON-1630660203 tempest-DeleteServersTestJSON-1630660203-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:03:05.463978 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.wsgi [None req-91779353-d9d9-48d9-8e31-03e7e0290c7a tempest-DeleteServersTestJSON-1630660203 tempest-DeleteServersTestJSON-1630660203-project] HTTP exception thrown: Instance ec88b440-40a0-459f-b94b-06c332e86094 could not be found. Sep 24 05:03:05.466204 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-91779353-d9d9-48d9-8e31-03e7e0290c7a tempest-DeleteServersTestJSON-1630660203 tempest-DeleteServersTestJSON-1630660203-project] Request method failure captured: Sep 24 05:03:05.466204 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: request: GET /compute/v2.1/servers/ec88b440-40a0-459f-b94b-06c332e86094 HTTP/1.1 Sep 24 05:03:05.466204 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: Accept: application/json Sep 24 05:03:05.466204 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: Accept-Encoding: identity Sep 24 05:03:05.466204 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: Connection: close Sep 24 05:03:05.466204 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: Content-Length: 0 Sep 24 05:03:05.466204 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: Content-Type: application/json Sep 24 05:03:05.466204 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: Host: 10.222.0.50 Sep 24 05:03:05.466204 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: Openstack-System-Scope: None Sep 24 05:03:05.466204 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: User-Agent: python-urllib3/1.26.12 Sep 24 05:03:05.466204 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: X-Auth-Token: gAAAAABjLo8DvIS27N7_w2y1RKeuu9HDak3TofK8Dj80mp0_K4-GcMrr5Dbk5MUIe22gPSVip10rF73qvHziP2eZS1sagrJ2prp78zxuwuNi7aeU4k0zgw7hKMosAauJQt9JIpPyMXgVRTBk8Xa9fwgogbqVIad2guWiWumdGWAVz0hLYUhAWk4 Sep 24 05:03:05.466204 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: X-Domain-Id: None Sep 24 05:03:05.466204 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: X-Domain-Name: None Sep 24 05:03:05.466204 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: X-Identity-Status: Confirmed Sep 24 05:03:05.466204 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: X-Is-Admin-Project: True Sep 24 05:03:05.466204 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: X-Project-Domain-Id: default Sep 24 05:03:05.466204 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: X-Project-Domain-Name: Default Sep 24 05:03:05.466204 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: X-Project-Id: aa84dfa1cc764dc99b6e804e778c3479 Sep 24 05:03:05.466204 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: X-Project-Name: tempest-DeleteServersTestJSON-1630660203 Sep 24 05:03:05.466204 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: X-Role: member,reader Sep 24 05:03:05.466204 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: X-Roles: member,reader Sep 24 05:03:05.467794 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/aa84dfa1cc764dc99b6e804e778c3479"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/aa84dfa1cc764dc99b6e804e778c3479"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/aa84dfa1cc764dc99b6e804e778c3479"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.50:8080", "publicURL": "http://10.222.0.50:8080/v1/AUTH_aa84dfa1cc764dc99b6e804e778c3479"}]}] Sep 24 05:03:05.467794 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: X-Tenant: tempest-DeleteServersTestJSON-1630660203 Sep 24 05:03:05.467794 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: X-Tenant-Id: aa84dfa1cc764dc99b6e804e778c3479 Sep 24 05:03:05.467794 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: X-Tenant-Name: tempest-DeleteServersTestJSON-1630660203 Sep 24 05:03:05.467794 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: X-User: tempest-DeleteServersTestJSON-1630660203-project Sep 24 05:03:05.467794 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: X-User-Domain-Id: default Sep 24 05:03:05.467794 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: X-User-Domain-Name: Default Sep 24 05:03:05.467794 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: X-User-Id: 27d1a24c9e15493195744bcbf598ac4a Sep 24 05:03:05.467794 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: X-User-Name: tempest-DeleteServersTestJSON-1630660203-project Sep 24 05:03:05.467794 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: method: > Sep 24 05:03:05.467794 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: exception: Instance ec88b440-40a0-459f-b94b-06c332e86094 could not be found. Sep 24 05:03:05.467794 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: action_args: {'id': 'ec88b440-40a0-459f-b94b-06c332e86094'} Sep 24 05:03:05.468668 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 24 05:03:05.468668 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 05:03:05.468668 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 24 05:03:05.468668 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 24 05:03:05.468668 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 24 05:03:05.468668 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 24 05:03:05.468668 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 24 05:03:05.468668 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 24 05:03:05.468668 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 24 05:03:05.468668 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 24 05:03:05.468668 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ec88b440-40a0-459f-b94b-06c332e86094 could not be found. Sep 24 05:03:05.468668 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi Sep 24 05:03:05.468668 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 05:03:05.468668 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi Sep 24 05:03:05.468668 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 05:03:05.468668 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 05:03:05.468668 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 05:03:05.468668 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 24 05:03:05.468668 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 24 05:03:05.468668 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 24 05:03:05.469949 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 24 05:03:05.469949 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 24 05:03:05.469949 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 24 05:03:05.469949 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 24 05:03:05.469949 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 24 05:03:05.469949 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 24 05:03:05.469949 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 24 05:03:05.469949 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ec88b440-40a0-459f-b94b-06c332e86094 could not be found. Sep 24 05:03:05.469949 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi Sep 24 05:03:05.469949 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 05:03:05.469949 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi Sep 24 05:03:05.469949 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 05:03:05.469949 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 05:03:05.469949 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 05:03:05.469949 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 24 05:03:05.469949 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 24 05:03:05.469949 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ec88b440-40a0-459f-b94b-06c332e86094 could not be found. Sep 24 05:03:05.469949 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi Sep 24 05:03:05.471157 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-91779353-d9d9-48d9-8e31-03e7e0290c7a tempest-DeleteServersTestJSON-1630660203 tempest-DeleteServersTestJSON-1630660203-project] Returning 404 to user: Instance ec88b440-40a0-459f-b94b-06c332e86094 could not be found. {{(pid=120593) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 24 05:03:05.471157 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-91779353-d9d9-48d9-8e31-03e7e0290c7a tempest-DeleteServersTestJSON-1630660203 tempest-DeleteServersTestJSON-1630660203-project] 10.222.0.50 "GET /compute/v2.1/servers/ec88b440-40a0-459f-b94b-06c332e86094" status: 404 len: 111 microversion: 2.1 time: 0.032409 Sep 24 05:03:05.471157 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 187/405] 10.222.0.50 () {58 vars in 1236 bytes} [Sat Sep 24 05:03:05 2022] GET /compute/v2.1/servers/ec88b440-40a0-459f-b94b-06c332e86094 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 24 05:03:05.611975 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-8504f6eb-ff74-4534-a397-b338f3fa2ac6 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Calling method '>' {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:03:05.612489 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.compute.api [None req-8504f6eb-ff74-4534-a397-b338f3fa2ac6 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] [instance: 50eed27b-6da2-4dda-94cc-02fc5cfec071] Fetching instance by UUID {{(pid=120594) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:03:05.618615 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-8504f6eb-ff74-4534-a397-b338f3fa2ac6 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:03:05.619094 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-8504f6eb-ff74-4534-a397-b338f3fa2ac6 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:03:05.619538 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-8504f6eb-ff74-4534-a397-b338f3fa2ac6 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:03:05.620220 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-8504f6eb-ff74-4534-a397-b338f3fa2ac6 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:03:05.620665 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-8504f6eb-ff74-4534-a397-b338f3fa2ac6 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:03:05.621080 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-8504f6eb-ff74-4534-a397-b338f3fa2ac6 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:03:05.757521 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.policy [None req-8504f6eb-ff74-4534-a397-b338f3fa2ac6 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cdd0da2c7bc4139bcd48ef36a2ee183', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a18a3756ba2b460d977f738a115ebfe0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:03:05.766039 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [None req-8504f6eb-ff74-4534-a397-b338f3fa2ac6 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] 10.222.0.50 "GET /compute/v2.1/servers/50eed27b-6da2-4dda-94cc-02fc5cfec071" status: 200 len: 1522 microversion: 2.1 time: 0.158041 Sep 24 05:03:05.766614 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 219/406] 10.222.0.50 () {58 vars in 1236 bytes} [Sat Sep 24 05:03:05 2022] GET /compute/v2.1/servers/50eed27b-6da2-4dda-94cc-02fc5cfec071 => generated 1522 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 05:03:06.788587 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-e4f3df8a-b825-4f96-9c05-f18e5cc94bff tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Calling method '>' {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:03:06.789766 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.compute.api [None req-e4f3df8a-b825-4f96-9c05-f18e5cc94bff tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] [instance: 50eed27b-6da2-4dda-94cc-02fc5cfec071] Fetching instance by UUID {{(pid=120593) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:03:06.796939 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-e4f3df8a-b825-4f96-9c05-f18e5cc94bff tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:03:06.797663 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-e4f3df8a-b825-4f96-9c05-f18e5cc94bff tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:03:06.798296 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-e4f3df8a-b825-4f96-9c05-f18e5cc94bff tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:03:06.799137 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-e4f3df8a-b825-4f96-9c05-f18e5cc94bff tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:03:06.799725 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-e4f3df8a-b825-4f96-9c05-f18e5cc94bff tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:03:06.800289 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-e4f3df8a-b825-4f96-9c05-f18e5cc94bff tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:03:06.947742 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-e4f3df8a-b825-4f96-9c05-f18e5cc94bff tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cdd0da2c7bc4139bcd48ef36a2ee183', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a18a3756ba2b460d977f738a115ebfe0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:03:06.958201 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-e4f3df8a-b825-4f96-9c05-f18e5cc94bff tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] 10.222.0.50 "GET /compute/v2.1/servers/50eed27b-6da2-4dda-94cc-02fc5cfec071" status: 200 len: 1522 microversion: 2.1 time: 0.172978 Sep 24 05:03:06.958806 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 188/407] 10.222.0.50 () {58 vars in 1236 bytes} [Sat Sep 24 05:03:06 2022] GET /compute/v2.1/servers/50eed27b-6da2-4dda-94cc-02fc5cfec071 => generated 1522 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 05:03:07.981554 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-846540db-e56b-4690-b229-ea5d3eb5e7a6 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Calling method '>' {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:03:07.982258 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.compute.api [None req-846540db-e56b-4690-b229-ea5d3eb5e7a6 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] [instance: 50eed27b-6da2-4dda-94cc-02fc5cfec071] Fetching instance by UUID {{(pid=120594) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:03:07.988922 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-846540db-e56b-4690-b229-ea5d3eb5e7a6 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:03:07.989606 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-846540db-e56b-4690-b229-ea5d3eb5e7a6 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:03:07.990061 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-846540db-e56b-4690-b229-ea5d3eb5e7a6 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:03:07.990907 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-846540db-e56b-4690-b229-ea5d3eb5e7a6 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:03:07.991360 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-846540db-e56b-4690-b229-ea5d3eb5e7a6 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:03:07.991777 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-846540db-e56b-4690-b229-ea5d3eb5e7a6 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:03:08.223384 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.policy [None req-846540db-e56b-4690-b229-ea5d3eb5e7a6 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cdd0da2c7bc4139bcd48ef36a2ee183', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a18a3756ba2b460d977f738a115ebfe0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:03:08.231160 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [None req-846540db-e56b-4690-b229-ea5d3eb5e7a6 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] 10.222.0.50 "GET /compute/v2.1/servers/50eed27b-6da2-4dda-94cc-02fc5cfec071" status: 200 len: 1522 microversion: 2.1 time: 0.253570 Sep 24 05:03:08.231727 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 220/408] 10.222.0.50 () {58 vars in 1236 bytes} [Sat Sep 24 05:03:07 2022] GET /compute/v2.1/servers/50eed27b-6da2-4dda-94cc-02fc5cfec071 => generated 1522 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 05:03:09.254451 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-3f1b3c49-d109-4f19-8111-55fc6ee6312a tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Calling method '>' {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:03:09.255060 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.compute.api [None req-3f1b3c49-d109-4f19-8111-55fc6ee6312a tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] [instance: 50eed27b-6da2-4dda-94cc-02fc5cfec071] Fetching instance by UUID {{(pid=120593) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:03:09.262855 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-3f1b3c49-d109-4f19-8111-55fc6ee6312a tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:03:09.263343 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-3f1b3c49-d109-4f19-8111-55fc6ee6312a tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:03:09.263683 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-3f1b3c49-d109-4f19-8111-55fc6ee6312a tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:03:09.264905 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-3f1b3c49-d109-4f19-8111-55fc6ee6312a tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:03:09.265350 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-3f1b3c49-d109-4f19-8111-55fc6ee6312a tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:03:09.265892 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-3f1b3c49-d109-4f19-8111-55fc6ee6312a tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:03:09.426486 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-3f1b3c49-d109-4f19-8111-55fc6ee6312a tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cdd0da2c7bc4139bcd48ef36a2ee183', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a18a3756ba2b460d977f738a115ebfe0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:03:09.436257 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-3f1b3c49-d109-4f19-8111-55fc6ee6312a tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] 10.222.0.50 "GET /compute/v2.1/servers/50eed27b-6da2-4dda-94cc-02fc5cfec071" status: 200 len: 1522 microversion: 2.1 time: 0.187479 Sep 24 05:03:09.450237 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 189/409] 10.222.0.50 () {58 vars in 1236 bytes} [Sat Sep 24 05:03:09 2022] GET /compute/v2.1/servers/50eed27b-6da2-4dda-94cc-02fc5cfec071 => generated 1522 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 05:03:10.463126 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-08423def-5820-4b94-b44b-c582edbfb0ec tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Calling method '>' {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:03:10.463786 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.compute.api [None req-08423def-5820-4b94-b44b-c582edbfb0ec tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] [instance: 50eed27b-6da2-4dda-94cc-02fc5cfec071] Fetching instance by UUID {{(pid=120594) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:03:10.473634 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-08423def-5820-4b94-b44b-c582edbfb0ec tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:03:10.474070 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-08423def-5820-4b94-b44b-c582edbfb0ec tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:03:10.474504 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-08423def-5820-4b94-b44b-c582edbfb0ec tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:03:10.475208 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-08423def-5820-4b94-b44b-c582edbfb0ec tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:03:10.477526 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-08423def-5820-4b94-b44b-c582edbfb0ec tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:03:10.478274 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-08423def-5820-4b94-b44b-c582edbfb0ec tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:03:10.750496 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.policy [None req-08423def-5820-4b94-b44b-c582edbfb0ec tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cdd0da2c7bc4139bcd48ef36a2ee183', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a18a3756ba2b460d977f738a115ebfe0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:03:10.759310 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [None req-08423def-5820-4b94-b44b-c582edbfb0ec tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] 10.222.0.50 "GET /compute/v2.1/servers/50eed27b-6da2-4dda-94cc-02fc5cfec071" status: 200 len: 1522 microversion: 2.1 time: 0.304032 Sep 24 05:03:10.762307 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 221/410] 10.222.0.50 () {58 vars in 1236 bytes} [Sat Sep 24 05:03:10 2022] GET /compute/v2.1/servers/50eed27b-6da2-4dda-94cc-02fc5cfec071 => generated 1522 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 05:03:10.978871 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-d3d6d0b9-7755-4cb3-8f5e-4880dc52eb3e tempest-VolumesNegativeTest-833199006 tempest-VolumesNegativeTest-833199006-project] Action: 'create', calling method: .version_select at 0x7f7950859310>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1597387853", "metadata": {"Type": "work"}}} {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 05:03:10.994653 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-d3d6d0b9-7755-4cb3-8f5e-4880dc52eb3e tempest-VolumesNegativeTest-833199006 tempest-VolumesNegativeTest-833199006-project] Request method failure captured: Sep 24 05:03:10.994653 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Sep 24 05:03:10.994653 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: Accept: application/json Sep 24 05:03:10.994653 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: Accept-Encoding: identity Sep 24 05:03:10.994653 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: Connection: close Sep 24 05:03:10.994653 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: Content-Length: 122 Sep 24 05:03:10.994653 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: Content-Type: application/json Sep 24 05:03:10.994653 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: Host: 10.222.0.50 Sep 24 05:03:10.994653 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: Openstack-System-Scope: None Sep 24 05:03:10.994653 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: User-Agent: python-urllib3/1.26.12 Sep 24 05:03:10.994653 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: X-Auth-Token: gAAAAABjLo-Onrkf0Kkjj6-YSC0mJ3RP3pr-p6ZZhC9Y4pXZl1c0Ylw4Xj_ChdJ2tc8c-eELzJkcy-5MFRaoz__7s8-uV9ZW0CIUAvJzqrgpoN8Y6xZ6-H3H2NDKcHfAnfbhqZ9oz9Pbi6E1gSlJQLC_-PjmlOCnAuMdzh5RVA8Ka-eg-1VZ6s0 Sep 24 05:03:10.994653 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: X-Domain-Id: None Sep 24 05:03:10.994653 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: X-Domain-Name: None Sep 24 05:03:10.994653 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: X-Identity-Status: Confirmed Sep 24 05:03:10.994653 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: X-Is-Admin-Project: True Sep 24 05:03:10.994653 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: X-Project-Domain-Id: default Sep 24 05:03:10.994653 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: X-Project-Domain-Name: Default Sep 24 05:03:10.994653 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: X-Project-Id: 932c6d1e53f44d91b1a7da56d637b1de Sep 24 05:03:10.994653 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: X-Project-Name: tempest-VolumesNegativeTest-833199006 Sep 24 05:03:10.994653 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: X-Role: member,reader Sep 24 05:03:10.994653 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: X-Roles: member,reader Sep 24 05:03:10.995954 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/932c6d1e53f44d91b1a7da56d637b1de"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/932c6d1e53f44d91b1a7da56d637b1de"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/932c6d1e53f44d91b1a7da56d637b1de"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.50:8080", "publicURL": "http://10.222.0.50:8080/v1/AUTH_932c6d1e53f44d91b1a7da56d637b1de"}]}] Sep 24 05:03:10.995954 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: X-Tenant: tempest-VolumesNegativeTest-833199006 Sep 24 05:03:10.995954 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: X-Tenant-Id: 932c6d1e53f44d91b1a7da56d637b1de Sep 24 05:03:10.995954 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: X-Tenant-Name: tempest-VolumesNegativeTest-833199006 Sep 24 05:03:10.995954 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: X-User: tempest-VolumesNegativeTest-833199006-project Sep 24 05:03:10.995954 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: X-User-Domain-Id: default Sep 24 05:03:10.995954 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: X-User-Domain-Name: Default Sep 24 05:03:10.995954 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: X-User-Id: 41d85dde58db4a38aeccbf665340e126 Sep 24 05:03:10.995954 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: X-User-Name: tempest-VolumesNegativeTest-833199006-project Sep 24 05:03:10.995954 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: Sep 24 05:03:10.995954 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1597387853", "metadata": {"Type": "work"}}} Sep 24 05:03:10.995954 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: method: Sep 24 05:03:10.995954 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Sep 24 05:03:10.996688 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-1597387853', 'metadata': {'Type': 'work'}}}} Sep 24 05:03:10.996688 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 24 05:03:10.996688 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 05:03:10.996688 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 24 05:03:10.996688 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 24 05:03:10.996688 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 24 05:03:10.996688 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi raise error Sep 24 05:03:10.996688 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' Sep 24 05:03:10.996688 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi Sep 24 05:03:10.996688 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Sep 24 05:03:10.996688 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Sep 24 05:03:10.996688 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi Sep 24 05:03:10.996688 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi On instance['volume']: Sep 24 05:03:10.996688 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi '#$%' Sep 24 05:03:10.996688 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi Sep 24 05:03:10.996688 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 05:03:10.996688 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi Sep 24 05:03:10.996688 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 05:03:10.996688 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 05:03:10.996688 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 05:03:10.996688 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 24 05:03:10.996688 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 24 05:03:10.997925 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 24 05:03:10.997925 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 24 05:03:10.997925 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 24 05:03:10.997925 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 24 05:03:10.997925 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 24 05:03:10.997925 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 24 05:03:10.997925 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 24 05:03:10.997925 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 24 05:03:10.997925 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 24 05:03:10.997925 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 24 05:03:10.997925 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Sep 24 05:03:10.997925 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi Sep 24 05:03:10.997925 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 05:03:10.997925 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi Sep 24 05:03:10.997925 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 05:03:10.997925 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 05:03:10.997925 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 05:03:10.997925 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 24 05:03:10.997925 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 24 05:03:11.000069 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Sep 24 05:03:11.000069 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi Sep 24 05:03:11.000069 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-d3d6d0b9-7755-4cb3-8f5e-4880dc52eb3e tempest-VolumesNegativeTest-833199006 tempest-VolumesNegativeTest-833199006-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=120593) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 24 05:03:11.000069 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-d3d6d0b9-7755-4cb3-8f5e-4880dc52eb3e tempest-VolumesNegativeTest-833199006 tempest-VolumesNegativeTest-833199006-project] 10.222.0.50 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 0.210211 Sep 24 05:03:11.000069 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 190/411] 10.222.0.50 () {60 vars in 1156 bytes} [Sat Sep 24 05:03:10 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 211 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 24 05:03:11.010758 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-f4c40a60-d179-415c-9ba4-f00c5b5ac3ec tempest-VolumesNegativeTest-833199006 tempest-VolumesNegativeTest-833199006-project] Action: 'create', calling method: .version_select at 0x7f79508bbd30>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1811083550", "metadata": {"Type": "work"}}} {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 05:03:11.017536 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-f4c40a60-d179-415c-9ba4-f00c5b5ac3ec tempest-VolumesNegativeTest-833199006 tempest-VolumesNegativeTest-833199006-project] Request method failure captured: Sep 24 05:03:11.017536 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Sep 24 05:03:11.017536 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: Accept: application/json Sep 24 05:03:11.017536 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: Accept-Encoding: identity Sep 24 05:03:11.017536 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: Connection: close Sep 24 05:03:11.017536 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: Content-Length: 120 Sep 24 05:03:11.017536 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: Content-Type: application/json Sep 24 05:03:11.017536 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: Host: 10.222.0.50 Sep 24 05:03:11.017536 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: Openstack-System-Scope: None Sep 24 05:03:11.017536 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: User-Agent: python-urllib3/1.26.12 Sep 24 05:03:11.017536 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: X-Auth-Token: gAAAAABjLo-Onrkf0Kkjj6-YSC0mJ3RP3pr-p6ZZhC9Y4pXZl1c0Ylw4Xj_ChdJ2tc8c-eELzJkcy-5MFRaoz__7s8-uV9ZW0CIUAvJzqrgpoN8Y6xZ6-H3H2NDKcHfAnfbhqZ9oz9Pbi6E1gSlJQLC_-PjmlOCnAuMdzh5RVA8Ka-eg-1VZ6s0 Sep 24 05:03:11.017536 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: X-Domain-Id: None Sep 24 05:03:11.017536 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: X-Domain-Name: None Sep 24 05:03:11.017536 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: X-Identity-Status: Confirmed Sep 24 05:03:11.017536 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: X-Is-Admin-Project: True Sep 24 05:03:11.017536 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: X-Project-Domain-Id: default Sep 24 05:03:11.017536 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: X-Project-Domain-Name: Default Sep 24 05:03:11.017536 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: X-Project-Id: 932c6d1e53f44d91b1a7da56d637b1de Sep 24 05:03:11.017536 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: X-Project-Name: tempest-VolumesNegativeTest-833199006 Sep 24 05:03:11.017536 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: X-Role: member,reader Sep 24 05:03:11.017536 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: X-Roles: member,reader Sep 24 05:03:11.018747 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/932c6d1e53f44d91b1a7da56d637b1de"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/932c6d1e53f44d91b1a7da56d637b1de"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/932c6d1e53f44d91b1a7da56d637b1de"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.50:8080", "publicURL": "http://10.222.0.50:8080/v1/AUTH_932c6d1e53f44d91b1a7da56d637b1de"}]}] Sep 24 05:03:11.018747 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: X-Tenant: tempest-VolumesNegativeTest-833199006 Sep 24 05:03:11.018747 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: X-Tenant-Id: 932c6d1e53f44d91b1a7da56d637b1de Sep 24 05:03:11.018747 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: X-Tenant-Name: tempest-VolumesNegativeTest-833199006 Sep 24 05:03:11.018747 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: X-User: tempest-VolumesNegativeTest-833199006-project Sep 24 05:03:11.018747 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: X-User-Domain-Id: default Sep 24 05:03:11.018747 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: X-User-Domain-Name: Default Sep 24 05:03:11.018747 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: X-User-Id: 41d85dde58db4a38aeccbf665340e126 Sep 24 05:03:11.018747 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: X-User-Name: tempest-VolumesNegativeTest-833199006-project Sep 24 05:03:11.018747 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: Sep 24 05:03:11.018747 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1811083550", "metadata": {"Type": "work"}}} Sep 24 05:03:11.018747 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: method: Sep 24 05:03:11.018747 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Sep 24 05:03:11.019462 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-1811083550', 'metadata': {'Type': 'work'}}}} Sep 24 05:03:11.019462 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 24 05:03:11.019462 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 05:03:11.019462 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 24 05:03:11.019462 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 24 05:03:11.019462 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 24 05:03:11.019462 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi raise error Sep 24 05:03:11.019462 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Sep 24 05:03:11.019462 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi Sep 24 05:03:11.019462 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: Sep 24 05:03:11.019462 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Sep 24 05:03:11.019462 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi Sep 24 05:03:11.019462 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi On instance['volume']: Sep 24 05:03:11.019462 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi '0' Sep 24 05:03:11.019462 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi Sep 24 05:03:11.019462 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 05:03:11.019462 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi Sep 24 05:03:11.019462 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 05:03:11.019462 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 05:03:11.019462 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 05:03:11.019462 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 24 05:03:11.019462 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 24 05:03:11.020704 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 24 05:03:11.020704 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 24 05:03:11.020704 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 24 05:03:11.020704 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 24 05:03:11.020704 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 24 05:03:11.020704 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 24 05:03:11.020704 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 24 05:03:11.020704 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 24 05:03:11.020704 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 24 05:03:11.020704 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 24 05:03:11.020704 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Sep 24 05:03:11.020704 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi Sep 24 05:03:11.020704 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 05:03:11.020704 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi Sep 24 05:03:11.020704 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 05:03:11.020704 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 05:03:11.020704 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 05:03:11.020704 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 24 05:03:11.020704 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 24 05:03:11.021709 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Sep 24 05:03:11.021709 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi Sep 24 05:03:11.021709 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-f4c40a60-d179-415c-9ba4-f00c5b5ac3ec tempest-VolumesNegativeTest-833199006 tempest-VolumesNegativeTest-833199006-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=120594) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 24 05:03:11.021709 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [None req-f4c40a60-d179-415c-9ba4-f00c5b5ac3ec tempest-VolumesNegativeTest-833199006 tempest-VolumesNegativeTest-833199006-project] 10.222.0.50 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.016839 Sep 24 05:03:11.025015 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 222/412] 10.222.0.50 () {60 vars in 1156 bytes} [Sat Sep 24 05:03:11 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 23 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Sep 24 05:03:11.031336 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-2b9140f2-8697-4d0d-b260-4b92c9049f7b tempest-VolumesNegativeTest-833199006 tempest-VolumesNegativeTest-833199006-project] Action: 'create', calling method: .version_select at 0x7f79508aaca0>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1411109347", "metadata": {"Type": "work"}}} {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 05:03:11.036442 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-2b9140f2-8697-4d0d-b260-4b92c9049f7b tempest-VolumesNegativeTest-833199006 tempest-VolumesNegativeTest-833199006-project] Request method failure captured: Sep 24 05:03:11.036442 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Sep 24 05:03:11.036442 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: Accept: application/json Sep 24 05:03:11.036442 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: Accept-Encoding: identity Sep 24 05:03:11.036442 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: Connection: close Sep 24 05:03:11.036442 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: Content-Length: 119 Sep 24 05:03:11.036442 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: Content-Type: application/json Sep 24 05:03:11.036442 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: Host: 10.222.0.50 Sep 24 05:03:11.036442 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: Openstack-System-Scope: None Sep 24 05:03:11.036442 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: User-Agent: python-urllib3/1.26.12 Sep 24 05:03:11.036442 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: X-Auth-Token: gAAAAABjLo-Onrkf0Kkjj6-YSC0mJ3RP3pr-p6ZZhC9Y4pXZl1c0Ylw4Xj_ChdJ2tc8c-eELzJkcy-5MFRaoz__7s8-uV9ZW0CIUAvJzqrgpoN8Y6xZ6-H3H2NDKcHfAnfbhqZ9oz9Pbi6E1gSlJQLC_-PjmlOCnAuMdzh5RVA8Ka-eg-1VZ6s0 Sep 24 05:03:11.036442 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: X-Domain-Id: None Sep 24 05:03:11.036442 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: X-Domain-Name: None Sep 24 05:03:11.036442 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: X-Identity-Status: Confirmed Sep 24 05:03:11.036442 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: X-Is-Admin-Project: True Sep 24 05:03:11.036442 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: X-Project-Domain-Id: default Sep 24 05:03:11.036442 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: X-Project-Domain-Name: Default Sep 24 05:03:11.036442 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: X-Project-Id: 932c6d1e53f44d91b1a7da56d637b1de Sep 24 05:03:11.036442 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: X-Project-Name: tempest-VolumesNegativeTest-833199006 Sep 24 05:03:11.036442 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: X-Role: member,reader Sep 24 05:03:11.036442 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: X-Roles: member,reader Sep 24 05:03:11.037662 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/932c6d1e53f44d91b1a7da56d637b1de"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/932c6d1e53f44d91b1a7da56d637b1de"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/932c6d1e53f44d91b1a7da56d637b1de"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.50:8080", "publicURL": "http://10.222.0.50:8080/v1/AUTH_932c6d1e53f44d91b1a7da56d637b1de"}]}] Sep 24 05:03:11.037662 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: X-Tenant: tempest-VolumesNegativeTest-833199006 Sep 24 05:03:11.037662 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: X-Tenant-Id: 932c6d1e53f44d91b1a7da56d637b1de Sep 24 05:03:11.037662 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: X-Tenant-Name: tempest-VolumesNegativeTest-833199006 Sep 24 05:03:11.037662 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: X-User: tempest-VolumesNegativeTest-833199006-project Sep 24 05:03:11.037662 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: X-User-Domain-Id: default Sep 24 05:03:11.037662 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: X-User-Domain-Name: Default Sep 24 05:03:11.037662 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: X-User-Id: 41d85dde58db4a38aeccbf665340e126 Sep 24 05:03:11.037662 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: X-User-Name: tempest-VolumesNegativeTest-833199006-project Sep 24 05:03:11.037662 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: Sep 24 05:03:11.037662 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1411109347", "metadata": {"Type": "work"}}} Sep 24 05:03:11.037662 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: method: Sep 24 05:03:11.037662 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Sep 24 05:03:11.038511 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-1411109347', 'metadata': {'Type': 'work'}}}} Sep 24 05:03:11.038511 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 24 05:03:11.038511 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 05:03:11.038511 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 24 05:03:11.038511 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 24 05:03:11.038511 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 24 05:03:11.038511 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi raise error Sep 24 05:03:11.038511 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' Sep 24 05:03:11.038511 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi Sep 24 05:03:11.038511 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Sep 24 05:03:11.038511 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Sep 24 05:03:11.038511 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi Sep 24 05:03:11.038511 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi On instance['volume']: Sep 24 05:03:11.038511 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi '' Sep 24 05:03:11.038511 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi Sep 24 05:03:11.038511 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 05:03:11.038511 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi Sep 24 05:03:11.038511 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 05:03:11.038511 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 05:03:11.038511 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 05:03:11.038511 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 24 05:03:11.038511 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 24 05:03:11.039706 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 24 05:03:11.039706 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 24 05:03:11.039706 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 24 05:03:11.039706 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 24 05:03:11.039706 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 24 05:03:11.039706 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 24 05:03:11.039706 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 24 05:03:11.039706 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 24 05:03:11.039706 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 24 05:03:11.039706 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 24 05:03:11.039706 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Sep 24 05:03:11.039706 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi Sep 24 05:03:11.039706 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 05:03:11.039706 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi Sep 24 05:03:11.039706 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 05:03:11.039706 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 05:03:11.039706 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 05:03:11.039706 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 24 05:03:11.039706 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 24 05:03:11.041247 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Sep 24 05:03:11.041247 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi Sep 24 05:03:11.042748 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-2b9140f2-8697-4d0d-b260-4b92c9049f7b tempest-VolumesNegativeTest-833199006 tempest-VolumesNegativeTest-833199006-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=120593) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 24 05:03:11.045094 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-2b9140f2-8697-4d0d-b260-4b92c9049f7b tempest-VolumesNegativeTest-833199006 tempest-VolumesNegativeTest-833199006-project] 10.222.0.50 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.019144 Sep 24 05:03:11.046162 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 191/413] 10.222.0.50 () {60 vars in 1156 bytes} [Sat Sep 24 05:03:11 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 21 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Sep 24 05:03:11.055179 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-035cbaff-f4d9-4662-85f7-337fe87b02a6 tempest-VolumesNegativeTest-833199006 tempest-VolumesNegativeTest-833199006-project] Calling method '.version_select at 0x7f79508c8940>' {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:03:11.088232 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: INFO nova.api.openstack.wsgi [None req-035cbaff-f4d9-4662-85f7-337fe87b02a6 tempest-VolumesNegativeTest-833199006 tempest-VolumesNegativeTest-833199006-project] HTTP exception thrown: Volume tempest-invalid-1116975363 could not be found. Sep 24 05:03:11.090138 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-035cbaff-f4d9-4662-85f7-337fe87b02a6 tempest-VolumesNegativeTest-833199006 tempest-VolumesNegativeTest-833199006-project] Request method failure captured: Sep 24 05:03:11.090138 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-1116975363 HTTP/1.1 Sep 24 05:03:11.090138 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: Accept: application/json Sep 24 05:03:11.090138 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: Accept-Encoding: identity Sep 24 05:03:11.090138 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: Connection: close Sep 24 05:03:11.090138 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: Content-Length: 0 Sep 24 05:03:11.090138 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: Content-Type: application/json Sep 24 05:03:11.090138 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: Host: 10.222.0.50 Sep 24 05:03:11.090138 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: Openstack-System-Scope: None Sep 24 05:03:11.090138 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: User-Agent: python-urllib3/1.26.12 Sep 24 05:03:11.090138 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: X-Auth-Token: gAAAAABjLo-Onrkf0Kkjj6-YSC0mJ3RP3pr-p6ZZhC9Y4pXZl1c0Ylw4Xj_ChdJ2tc8c-eELzJkcy-5MFRaoz__7s8-uV9ZW0CIUAvJzqrgpoN8Y6xZ6-H3H2NDKcHfAnfbhqZ9oz9Pbi6E1gSlJQLC_-PjmlOCnAuMdzh5RVA8Ka-eg-1VZ6s0 Sep 24 05:03:11.090138 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: X-Domain-Id: None Sep 24 05:03:11.090138 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: X-Domain-Name: None Sep 24 05:03:11.090138 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: X-Identity-Status: Confirmed Sep 24 05:03:11.090138 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: X-Is-Admin-Project: True Sep 24 05:03:11.090138 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: X-Project-Domain-Id: default Sep 24 05:03:11.090138 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: X-Project-Domain-Name: Default Sep 24 05:03:11.090138 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: X-Project-Id: 932c6d1e53f44d91b1a7da56d637b1de Sep 24 05:03:11.090138 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: X-Project-Name: tempest-VolumesNegativeTest-833199006 Sep 24 05:03:11.090138 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: X-Role: member,reader Sep 24 05:03:11.090138 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: X-Roles: member,reader Sep 24 05:03:11.091644 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/932c6d1e53f44d91b1a7da56d637b1de"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/932c6d1e53f44d91b1a7da56d637b1de"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/932c6d1e53f44d91b1a7da56d637b1de"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.50:8080", "publicURL": "http://10.222.0.50:8080/v1/AUTH_932c6d1e53f44d91b1a7da56d637b1de"}]}] Sep 24 05:03:11.091644 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: X-Tenant: tempest-VolumesNegativeTest-833199006 Sep 24 05:03:11.091644 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: X-Tenant-Id: 932c6d1e53f44d91b1a7da56d637b1de Sep 24 05:03:11.091644 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: X-Tenant-Name: tempest-VolumesNegativeTest-833199006 Sep 24 05:03:11.091644 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: X-User: tempest-VolumesNegativeTest-833199006-project Sep 24 05:03:11.091644 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: X-User-Domain-Id: default Sep 24 05:03:11.091644 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: X-User-Domain-Name: Default Sep 24 05:03:11.091644 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: X-User-Id: 41d85dde58db4a38aeccbf665340e126 Sep 24 05:03:11.091644 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: X-User-Name: tempest-VolumesNegativeTest-833199006-project Sep 24 05:03:11.091644 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: method: Sep 24 05:03:11.091644 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: exception: Volume tempest-invalid-1116975363 could not be found. Sep 24 05:03:11.091644 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: action_args: {'id': 'tempest-invalid-1116975363'} Sep 24 05:03:11.091644 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 24 05:03:11.092544 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 05:03:11.092544 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 24 05:03:11.092544 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 24 05:03:11.092544 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Sep 24 05:03:11.092544 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Sep 24 05:03:11.092544 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Sep 24 05:03:11.092544 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi return self._delete(loc) Sep 24 05:03:11.092544 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Sep 24 05:03:11.092544 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Sep 24 05:03:11.092544 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Sep 24 05:03:11.092544 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Sep 24 05:03:11.092544 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 24 05:03:11.092544 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 24 05:03:11.092544 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 24 05:03:11.092544 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 24 05:03:11.092544 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-1116975363 could not be found. (HTTP 404) (Request-ID: req-7ce86cc8-fa0d-4e2c-9149-793dc17b6af8) Sep 24 05:03:11.092544 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi Sep 24 05:03:11.092544 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 05:03:11.092544 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi Sep 24 05:03:11.093788 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 05:03:11.093788 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Sep 24 05:03:11.093788 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Sep 24 05:03:11.093788 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 24 05:03:11.093788 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 24 05:03:11.093788 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 24 05:03:11.093788 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 24 05:03:11.093788 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 24 05:03:11.093788 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 24 05:03:11.093788 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 24 05:03:11.093788 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 24 05:03:11.093788 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Sep 24 05:03:11.093788 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Sep 24 05:03:11.093788 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Sep 24 05:03:11.093788 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi return self._delete(loc) Sep 24 05:03:11.093788 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Sep 24 05:03:11.093788 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Sep 24 05:03:11.093788 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Sep 24 05:03:11.093788 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Sep 24 05:03:11.096734 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 24 05:03:11.096734 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 24 05:03:11.096734 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 24 05:03:11.096734 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 24 05:03:11.096734 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-1116975363 could not be found. Sep 24 05:03:11.096734 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi Sep 24 05:03:11.096734 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 05:03:11.096734 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi Sep 24 05:03:11.096734 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 05:03:11.096734 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 05:03:11.096734 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 05:03:11.096734 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 24 05:03:11.096734 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 24 05:03:11.096734 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 24 05:03:11.096734 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 24 05:03:11.096734 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 24 05:03:11.096734 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 24 05:03:11.096734 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Sep 24 05:03:11.096734 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 24 05:03:11.096734 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-1116975363 could not be found. Sep 24 05:03:11.098948 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi Sep 24 05:03:11.098948 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 05:03:11.098948 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi Sep 24 05:03:11.098948 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 05:03:11.098948 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 05:03:11.098948 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 05:03:11.098948 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 24 05:03:11.098948 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 24 05:03:11.098948 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-1116975363 could not be found. Sep 24 05:03:11.098948 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi Sep 24 05:03:11.098948 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-035cbaff-f4d9-4662-85f7-337fe87b02a6 tempest-VolumesNegativeTest-833199006 tempest-VolumesNegativeTest-833199006-project] Returning 404 to user: Volume tempest-invalid-1116975363 could not be found. {{(pid=120594) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 24 05:03:11.098948 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [None req-035cbaff-f4d9-4662-85f7-337fe87b02a6 tempest-VolumesNegativeTest-833199006 tempest-VolumesNegativeTest-833199006-project] 10.222.0.50 "DELETE /compute/v2.1/os-volumes/tempest-invalid-1116975363" status: 404 len: 99 microversion: 2.1 time: 0.040300 Sep 24 05:03:11.098948 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 223/414] 10.222.0.50 () {58 vars in 1218 bytes} [Sat Sep 24 05:03:11 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-1116975363 => generated 99 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Sep 24 05:03:11.105231 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-fa171abe-bf7b-4372-9e71-67914a03d3bf tempest-VolumesNegativeTest-833199006 tempest-VolumesNegativeTest-833199006-project] 10.222.0.50 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.004631 Sep 24 05:03:11.105740 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 192/415] 10.222.0.50 () {58 vars in 1140 bytes} [Sat Sep 24 05:03:11 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 9 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Sep 24 05:03:11.115324 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [None req-67778891-250a-437d-9411-cad921f58589 tempest-VolumesNegativeTest-833199006 tempest-VolumesNegativeTest-833199006-project] 10.222.0.50 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.004380 Sep 24 05:03:11.116158 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 224/416] 10.222.0.50 () {58 vars in 1137 bytes} [Sat Sep 24 05:03:11 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 6 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Sep 24 05:03:11.128075 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-74f58ec1-1ded-4758-b92c-86877bbb7b35 tempest-VolumesNegativeTest-833199006 tempest-VolumesNegativeTest-833199006-project] Calling method '.version_select at 0x7f79508ac1f0>' {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:03:11.163209 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.wsgi [None req-74f58ec1-1ded-4758-b92c-86877bbb7b35 tempest-VolumesNegativeTest-833199006 tempest-VolumesNegativeTest-833199006-project] HTTP exception thrown: Volume 773197d1-e31b-40e7-907c-ad865cfc8bcb could not be found. Sep 24 05:03:11.165646 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-74f58ec1-1ded-4758-b92c-86877bbb7b35 tempest-VolumesNegativeTest-833199006 tempest-VolumesNegativeTest-833199006-project] Request method failure captured: Sep 24 05:03:11.165646 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: request: DELETE /compute/v2.1/os-volumes/773197d1-e31b-40e7-907c-ad865cfc8bcb HTTP/1.1 Sep 24 05:03:11.165646 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: Accept: application/json Sep 24 05:03:11.165646 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: Accept-Encoding: identity Sep 24 05:03:11.165646 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: Connection: close Sep 24 05:03:11.165646 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: Content-Length: 0 Sep 24 05:03:11.165646 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: Content-Type: application/json Sep 24 05:03:11.165646 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: Host: 10.222.0.50 Sep 24 05:03:11.165646 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: Openstack-System-Scope: None Sep 24 05:03:11.165646 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: User-Agent: python-urllib3/1.26.12 Sep 24 05:03:11.165646 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: X-Auth-Token: gAAAAABjLo-Onrkf0Kkjj6-YSC0mJ3RP3pr-p6ZZhC9Y4pXZl1c0Ylw4Xj_ChdJ2tc8c-eELzJkcy-5MFRaoz__7s8-uV9ZW0CIUAvJzqrgpoN8Y6xZ6-H3H2NDKcHfAnfbhqZ9oz9Pbi6E1gSlJQLC_-PjmlOCnAuMdzh5RVA8Ka-eg-1VZ6s0 Sep 24 05:03:11.165646 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: X-Domain-Id: None Sep 24 05:03:11.165646 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: X-Domain-Name: None Sep 24 05:03:11.165646 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: X-Identity-Status: Confirmed Sep 24 05:03:11.165646 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: X-Is-Admin-Project: True Sep 24 05:03:11.165646 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: X-Project-Domain-Id: default Sep 24 05:03:11.165646 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: X-Project-Domain-Name: Default Sep 24 05:03:11.165646 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: X-Project-Id: 932c6d1e53f44d91b1a7da56d637b1de Sep 24 05:03:11.165646 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: X-Project-Name: tempest-VolumesNegativeTest-833199006 Sep 24 05:03:11.165646 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: X-Role: member,reader Sep 24 05:03:11.165646 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: X-Roles: member,reader Sep 24 05:03:11.166881 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/932c6d1e53f44d91b1a7da56d637b1de"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/932c6d1e53f44d91b1a7da56d637b1de"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/932c6d1e53f44d91b1a7da56d637b1de"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.50:8080", "publicURL": "http://10.222.0.50:8080/v1/AUTH_932c6d1e53f44d91b1a7da56d637b1de"}]}] Sep 24 05:03:11.166881 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: X-Tenant: tempest-VolumesNegativeTest-833199006 Sep 24 05:03:11.166881 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: X-Tenant-Id: 932c6d1e53f44d91b1a7da56d637b1de Sep 24 05:03:11.166881 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: X-Tenant-Name: tempest-VolumesNegativeTest-833199006 Sep 24 05:03:11.166881 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: X-User: tempest-VolumesNegativeTest-833199006-project Sep 24 05:03:11.166881 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: X-User-Domain-Id: default Sep 24 05:03:11.166881 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: X-User-Domain-Name: Default Sep 24 05:03:11.166881 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: X-User-Id: 41d85dde58db4a38aeccbf665340e126 Sep 24 05:03:11.166881 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: X-User-Name: tempest-VolumesNegativeTest-833199006-project Sep 24 05:03:11.166881 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: method: Sep 24 05:03:11.166881 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: exception: Volume 773197d1-e31b-40e7-907c-ad865cfc8bcb could not be found. Sep 24 05:03:11.166881 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: action_args: {'id': '773197d1-e31b-40e7-907c-ad865cfc8bcb'} Sep 24 05:03:11.166881 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 24 05:03:11.167698 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 05:03:11.167698 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 24 05:03:11.167698 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 24 05:03:11.167698 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Sep 24 05:03:11.167698 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Sep 24 05:03:11.167698 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Sep 24 05:03:11.167698 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi return self._delete(loc) Sep 24 05:03:11.167698 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Sep 24 05:03:11.167698 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Sep 24 05:03:11.167698 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Sep 24 05:03:11.167698 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Sep 24 05:03:11.167698 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 24 05:03:11.167698 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 24 05:03:11.167698 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 24 05:03:11.167698 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 24 05:03:11.167698 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 773197d1-e31b-40e7-907c-ad865cfc8bcb could not be found. (HTTP 404) (Request-ID: req-1800c3f1-8496-4e64-a536-e26c3e18f0f7) Sep 24 05:03:11.167698 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi Sep 24 05:03:11.167698 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 05:03:11.167698 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi Sep 24 05:03:11.168727 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 05:03:11.168727 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Sep 24 05:03:11.168727 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Sep 24 05:03:11.168727 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 24 05:03:11.168727 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 24 05:03:11.168727 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 24 05:03:11.168727 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 24 05:03:11.168727 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 24 05:03:11.168727 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 24 05:03:11.168727 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 24 05:03:11.168727 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 24 05:03:11.168727 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Sep 24 05:03:11.168727 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Sep 24 05:03:11.168727 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Sep 24 05:03:11.168727 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi return self._delete(loc) Sep 24 05:03:11.168727 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Sep 24 05:03:11.168727 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Sep 24 05:03:11.168727 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Sep 24 05:03:11.168727 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Sep 24 05:03:11.169716 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 24 05:03:11.169716 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 24 05:03:11.169716 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 24 05:03:11.169716 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 24 05:03:11.169716 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 773197d1-e31b-40e7-907c-ad865cfc8bcb could not be found. Sep 24 05:03:11.169716 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi Sep 24 05:03:11.169716 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 05:03:11.169716 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi Sep 24 05:03:11.169716 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 05:03:11.169716 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 05:03:11.169716 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 05:03:11.169716 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 24 05:03:11.169716 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 24 05:03:11.169716 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 24 05:03:11.169716 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 24 05:03:11.169716 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 24 05:03:11.169716 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 24 05:03:11.169716 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Sep 24 05:03:11.169716 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 24 05:03:11.172155 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 773197d1-e31b-40e7-907c-ad865cfc8bcb could not be found. Sep 24 05:03:11.172155 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi Sep 24 05:03:11.172155 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 05:03:11.172155 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi Sep 24 05:03:11.172155 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 05:03:11.172155 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 05:03:11.172155 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 05:03:11.172155 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 24 05:03:11.172155 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 24 05:03:11.172155 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 773197d1-e31b-40e7-907c-ad865cfc8bcb could not be found. Sep 24 05:03:11.172155 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi Sep 24 05:03:11.172155 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-74f58ec1-1ded-4758-b92c-86877bbb7b35 tempest-VolumesNegativeTest-833199006 tempest-VolumesNegativeTest-833199006-project] Returning 404 to user: Volume 773197d1-e31b-40e7-907c-ad865cfc8bcb could not be found. {{(pid=120593) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 24 05:03:11.172155 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-74f58ec1-1ded-4758-b92c-86877bbb7b35 tempest-VolumesNegativeTest-833199006 tempest-VolumesNegativeTest-833199006-project] 10.222.0.50 "DELETE /compute/v2.1/os-volumes/773197d1-e31b-40e7-907c-ad865cfc8bcb" status: 404 len: 109 microversion: 2.1 time: 0.045978 Sep 24 05:03:11.172155 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 193/417] 10.222.0.50 () {58 vars in 1248 bytes} [Sat Sep 24 05:03:11 2022] DELETE /compute/v2.1/os-volumes/773197d1-e31b-40e7-907c-ad865cfc8bcb => generated 109 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 24 05:03:11.179430 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-dcf0de5d-3613-4e89-821f-03fbeb9f9ebd tempest-VolumesNegativeTest-833199006 tempest-VolumesNegativeTest-833199006-project] Calling method '.version_select at 0x7f79508bb3a0>' {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:03:11.219036 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: INFO nova.api.openstack.wsgi [None req-dcf0de5d-3613-4e89-821f-03fbeb9f9ebd tempest-VolumesNegativeTest-833199006 tempest-VolumesNegativeTest-833199006-project] HTTP exception thrown: Volume 4e9a742b-bb07-465c-ad61-1f65c730bcd8 could not be found. Sep 24 05:03:11.222763 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-dcf0de5d-3613-4e89-821f-03fbeb9f9ebd tempest-VolumesNegativeTest-833199006 tempest-VolumesNegativeTest-833199006-project] Request method failure captured: Sep 24 05:03:11.222763 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: request: GET /compute/v2.1/os-volumes/4e9a742b-bb07-465c-ad61-1f65c730bcd8 HTTP/1.1 Sep 24 05:03:11.222763 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: Accept: application/json Sep 24 05:03:11.222763 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: Accept-Encoding: identity Sep 24 05:03:11.222763 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: Connection: close Sep 24 05:03:11.222763 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: Content-Length: 0 Sep 24 05:03:11.222763 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: Content-Type: application/json Sep 24 05:03:11.222763 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: Host: 10.222.0.50 Sep 24 05:03:11.222763 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: Openstack-System-Scope: None Sep 24 05:03:11.222763 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: User-Agent: python-urllib3/1.26.12 Sep 24 05:03:11.222763 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: X-Auth-Token: gAAAAABjLo-Onrkf0Kkjj6-YSC0mJ3RP3pr-p6ZZhC9Y4pXZl1c0Ylw4Xj_ChdJ2tc8c-eELzJkcy-5MFRaoz__7s8-uV9ZW0CIUAvJzqrgpoN8Y6xZ6-H3H2NDKcHfAnfbhqZ9oz9Pbi6E1gSlJQLC_-PjmlOCnAuMdzh5RVA8Ka-eg-1VZ6s0 Sep 24 05:03:11.222763 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: X-Domain-Id: None Sep 24 05:03:11.222763 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: X-Domain-Name: None Sep 24 05:03:11.222763 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: X-Identity-Status: Confirmed Sep 24 05:03:11.222763 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: X-Is-Admin-Project: True Sep 24 05:03:11.222763 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: X-Project-Domain-Id: default Sep 24 05:03:11.222763 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: X-Project-Domain-Name: Default Sep 24 05:03:11.222763 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: X-Project-Id: 932c6d1e53f44d91b1a7da56d637b1de Sep 24 05:03:11.222763 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: X-Project-Name: tempest-VolumesNegativeTest-833199006 Sep 24 05:03:11.222763 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: X-Role: member,reader Sep 24 05:03:11.222763 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: X-Roles: member,reader Sep 24 05:03:11.223940 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/932c6d1e53f44d91b1a7da56d637b1de"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/932c6d1e53f44d91b1a7da56d637b1de"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/932c6d1e53f44d91b1a7da56d637b1de"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.50:8080", "publicURL": "http://10.222.0.50:8080/v1/AUTH_932c6d1e53f44d91b1a7da56d637b1de"}]}] Sep 24 05:03:11.223940 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: X-Tenant: tempest-VolumesNegativeTest-833199006 Sep 24 05:03:11.223940 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: X-Tenant-Id: 932c6d1e53f44d91b1a7da56d637b1de Sep 24 05:03:11.223940 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: X-Tenant-Name: tempest-VolumesNegativeTest-833199006 Sep 24 05:03:11.223940 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: X-User: tempest-VolumesNegativeTest-833199006-project Sep 24 05:03:11.223940 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: X-User-Domain-Id: default Sep 24 05:03:11.223940 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: X-User-Domain-Name: Default Sep 24 05:03:11.223940 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: X-User-Id: 41d85dde58db4a38aeccbf665340e126 Sep 24 05:03:11.223940 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: X-User-Name: tempest-VolumesNegativeTest-833199006-project Sep 24 05:03:11.223940 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: method: Sep 24 05:03:11.223940 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: exception: Volume 4e9a742b-bb07-465c-ad61-1f65c730bcd8 could not be found. Sep 24 05:03:11.223940 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: action_args: {'id': '4e9a742b-bb07-465c-ad61-1f65c730bcd8'} Sep 24 05:03:11.223940 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 24 05:03:11.224714 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 05:03:11.224714 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 24 05:03:11.224714 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 24 05:03:11.224714 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 24 05:03:11.224714 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 24 05:03:11.224714 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 24 05:03:11.224714 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 24 05:03:11.224714 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 24 05:03:11.224714 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 24 05:03:11.224714 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 24 05:03:11.224714 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 24 05:03:11.224714 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 24 05:03:11.224714 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 24 05:03:11.224714 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 24 05:03:11.224714 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 24 05:03:11.224714 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 4e9a742b-bb07-465c-ad61-1f65c730bcd8 could not be found. (HTTP 404) (Request-ID: req-f1efb962-233a-407a-9e41-09ad4672536c) Sep 24 05:03:11.224714 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi Sep 24 05:03:11.224714 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 05:03:11.224714 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi Sep 24 05:03:11.225743 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 05:03:11.225743 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Sep 24 05:03:11.225743 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Sep 24 05:03:11.225743 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 24 05:03:11.225743 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 24 05:03:11.225743 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 24 05:03:11.225743 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 24 05:03:11.225743 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 24 05:03:11.225743 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 24 05:03:11.225743 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 24 05:03:11.225743 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 24 05:03:11.225743 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 24 05:03:11.225743 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 24 05:03:11.225743 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 24 05:03:11.225743 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 24 05:03:11.225743 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 24 05:03:11.225743 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 24 05:03:11.225743 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 24 05:03:11.225743 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 24 05:03:11.226837 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 24 05:03:11.226837 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 24 05:03:11.226837 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 24 05:03:11.226837 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 24 05:03:11.226837 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 4e9a742b-bb07-465c-ad61-1f65c730bcd8 could not be found. Sep 24 05:03:11.226837 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi Sep 24 05:03:11.226837 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 05:03:11.226837 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi Sep 24 05:03:11.226837 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 05:03:11.226837 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 05:03:11.226837 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 05:03:11.226837 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 24 05:03:11.226837 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 24 05:03:11.226837 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 24 05:03:11.226837 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 24 05:03:11.226837 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 24 05:03:11.226837 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 24 05:03:11.226837 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Sep 24 05:03:11.226837 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 24 05:03:11.227965 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 4e9a742b-bb07-465c-ad61-1f65c730bcd8 could not be found. Sep 24 05:03:11.227965 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi Sep 24 05:03:11.227965 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 05:03:11.227965 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi Sep 24 05:03:11.227965 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 05:03:11.227965 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 05:03:11.227965 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 05:03:11.227965 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 24 05:03:11.227965 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 24 05:03:11.227965 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 4e9a742b-bb07-465c-ad61-1f65c730bcd8 could not be found. Sep 24 05:03:11.227965 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi Sep 24 05:03:11.227965 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-dcf0de5d-3613-4e89-821f-03fbeb9f9ebd tempest-VolumesNegativeTest-833199006 tempest-VolumesNegativeTest-833199006-project] Returning 404 to user: Volume 4e9a742b-bb07-465c-ad61-1f65c730bcd8 could not be found. {{(pid=120594) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 24 05:03:11.227965 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [None req-dcf0de5d-3613-4e89-821f-03fbeb9f9ebd tempest-VolumesNegativeTest-833199006 tempest-VolumesNegativeTest-833199006-project] 10.222.0.50 "GET /compute/v2.1/os-volumes/4e9a742b-bb07-465c-ad61-1f65c730bcd8" status: 404 len: 109 microversion: 2.1 time: 0.050496 Sep 24 05:03:11.227965 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 225/418] 10.222.0.50 () {58 vars in 1245 bytes} [Sat Sep 24 05:03:11 2022] GET /compute/v2.1/os-volumes/4e9a742b-bb07-465c-ad61-1f65c730bcd8 => generated 109 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 24 05:03:11.786899 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-0971205f-91c3-41ef-9b25-1d80ecf856f0 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Calling method '>' {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:03:11.788074 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.compute.api [None req-0971205f-91c3-41ef-9b25-1d80ecf856f0 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] [instance: 50eed27b-6da2-4dda-94cc-02fc5cfec071] Fetching instance by UUID {{(pid=120593) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:03:11.798733 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-0971205f-91c3-41ef-9b25-1d80ecf856f0 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:03:11.799218 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-0971205f-91c3-41ef-9b25-1d80ecf856f0 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:03:11.799723 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-0971205f-91c3-41ef-9b25-1d80ecf856f0 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:03:11.800624 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-0971205f-91c3-41ef-9b25-1d80ecf856f0 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:03:11.801283 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-0971205f-91c3-41ef-9b25-1d80ecf856f0 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:03:11.801910 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-0971205f-91c3-41ef-9b25-1d80ecf856f0 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:03:11.825642 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG dbcounter [-] [120593] Writing DB stats nova_cell1:SELECT=100 {{(pid=120593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 05:03:12.054028 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-0971205f-91c3-41ef-9b25-1d80ecf856f0 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cdd0da2c7bc4139bcd48ef36a2ee183', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a18a3756ba2b460d977f738a115ebfe0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:03:12.071458 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-0971205f-91c3-41ef-9b25-1d80ecf856f0 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] 10.222.0.50 "GET /compute/v2.1/servers/50eed27b-6da2-4dda-94cc-02fc5cfec071" status: 200 len: 1502 microversion: 2.1 time: 0.290023 Sep 24 05:03:12.072097 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 194/419] 10.222.0.50 () {58 vars in 1236 bytes} [Sat Sep 24 05:03:11 2022] GET /compute/v2.1/servers/50eed27b-6da2-4dda-94cc-02fc5cfec071 => generated 1502 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 05:03:12.095988 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-2268e9e0-bf76-4cbf-b752-e82aa33f18f3 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Calling method '>' {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:03:12.095988 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.compute.api [None req-2268e9e0-bf76-4cbf-b752-e82aa33f18f3 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] [instance: 87dcedb5-91c7-4bc3-b46f-124ccffedf78] Fetching instance by UUID {{(pid=120594) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:03:12.111583 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-2268e9e0-bf76-4cbf-b752-e82aa33f18f3 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:03:12.112488 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-2268e9e0-bf76-4cbf-b752-e82aa33f18f3 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:03:12.113527 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-2268e9e0-bf76-4cbf-b752-e82aa33f18f3 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:03:12.114471 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-2268e9e0-bf76-4cbf-b752-e82aa33f18f3 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:03:12.115349 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-2268e9e0-bf76-4cbf-b752-e82aa33f18f3 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:03:12.116233 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-2268e9e0-bf76-4cbf-b752-e82aa33f18f3 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:03:12.309579 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.policy [None req-2268e9e0-bf76-4cbf-b752-e82aa33f18f3 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cdd0da2c7bc4139bcd48ef36a2ee183', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a18a3756ba2b460d977f738a115ebfe0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:03:12.320462 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [None req-2268e9e0-bf76-4cbf-b752-e82aa33f18f3 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] 10.222.0.50 "GET /compute/v2.1/servers/87dcedb5-91c7-4bc3-b46f-124ccffedf78" status: 200 len: 1515 microversion: 2.1 time: 0.229298 Sep 24 05:03:12.321401 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 226/420] 10.222.0.50 () {58 vars in 1236 bytes} [Sat Sep 24 05:03:12 2022] GET /compute/v2.1/servers/87dcedb5-91c7-4bc3-b46f-124ccffedf78 => generated 1515 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 24 05:03:14.945135 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-90b3e7b2-78bb-41b7-9e37-fbe002ac9c34 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 05:03:14.947682 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.compute.api [None req-90b3e7b2-78bb-41b7-9e37-fbe002ac9c34 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] [instance: 87dcedb5-91c7-4bc3-b46f-124ccffedf78] Fetching instance by UUID {{(pid=120593) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:03:14.954669 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-90b3e7b2-78bb-41b7-9e37-fbe002ac9c34 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:03:14.955149 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-90b3e7b2-78bb-41b7-9e37-fbe002ac9c34 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:03:14.955586 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-90b3e7b2-78bb-41b7-9e37-fbe002ac9c34 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:03:14.956273 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-90b3e7b2-78bb-41b7-9e37-fbe002ac9c34 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:03:14.956724 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-90b3e7b2-78bb-41b7-9e37-fbe002ac9c34 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:03:14.957149 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-90b3e7b2-78bb-41b7-9e37-fbe002ac9c34 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:03:14.979768 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.objects.instance [None req-90b3e7b2-78bb-41b7-9e37-fbe002ac9c34 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Lazy-loading 'flavor' on Instance uuid 87dcedb5-91c7-4bc3-b46f-124ccffedf78 {{(pid=120593) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 24 05:03:15.103772 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-90b3e7b2-78bb-41b7-9e37-fbe002ac9c34 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] 10.222.0.50 "POST /compute/v2.1/servers/87dcedb5-91c7-4bc3-b46f-124ccffedf78/action" status: 200 len: 32 microversion: 2.1 time: 0.162193 Sep 24 05:03:15.105013 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 195/421] 10.222.0.50 () {60 vars in 1278 bytes} [Sat Sep 24 05:03:14 2022] POST /compute/v2.1/servers/87dcedb5-91c7-4bc3-b46f-124ccffedf78/action => generated 32 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 24 05:03:15.113903 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-8748875d-af51-4418-be02-cab68ec97c56 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Calling method '>' {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:03:15.115805 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.compute.api [None req-8748875d-af51-4418-be02-cab68ec97c56 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] [instance: 87dcedb5-91c7-4bc3-b46f-124ccffedf78] Fetching instance by UUID {{(pid=120594) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:03:15.122571 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-8748875d-af51-4418-be02-cab68ec97c56 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:03:15.123566 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-8748875d-af51-4418-be02-cab68ec97c56 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:03:15.124357 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-8748875d-af51-4418-be02-cab68ec97c56 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:03:15.125264 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-8748875d-af51-4418-be02-cab68ec97c56 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:03:15.125973 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-8748875d-af51-4418-be02-cab68ec97c56 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:03:15.126882 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-8748875d-af51-4418-be02-cab68ec97c56 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:03:15.268941 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.policy [None req-8748875d-af51-4418-be02-cab68ec97c56 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cdd0da2c7bc4139bcd48ef36a2ee183', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a18a3756ba2b460d977f738a115ebfe0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:03:15.276595 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [None req-8748875d-af51-4418-be02-cab68ec97c56 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] 10.222.0.50 "GET /compute/v2.1/servers/87dcedb5-91c7-4bc3-b46f-124ccffedf78" status: 200 len: 1521 microversion: 2.1 time: 0.166493 Sep 24 05:03:15.277237 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 227/422] 10.222.0.50 () {58 vars in 1236 bytes} [Sat Sep 24 05:03:15 2022] GET /compute/v2.1/servers/87dcedb5-91c7-4bc3-b46f-124ccffedf78 => generated 1521 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 05:03:16.299408 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-89847b34-c0ef-401c-9119-ffb741eafa9f tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Calling method '>' {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:03:16.300090 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.compute.api [None req-89847b34-c0ef-401c-9119-ffb741eafa9f tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] [instance: 87dcedb5-91c7-4bc3-b46f-124ccffedf78] Fetching instance by UUID {{(pid=120593) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:03:16.307174 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-89847b34-c0ef-401c-9119-ffb741eafa9f tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:03:16.307659 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-89847b34-c0ef-401c-9119-ffb741eafa9f tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:03:16.308097 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-89847b34-c0ef-401c-9119-ffb741eafa9f tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:03:16.308786 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-89847b34-c0ef-401c-9119-ffb741eafa9f tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:03:16.309232 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-89847b34-c0ef-401c-9119-ffb741eafa9f tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:03:16.309657 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-89847b34-c0ef-401c-9119-ffb741eafa9f tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:03:16.449584 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-89847b34-c0ef-401c-9119-ffb741eafa9f tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cdd0da2c7bc4139bcd48ef36a2ee183', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a18a3756ba2b460d977f738a115ebfe0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:03:16.460530 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-89847b34-c0ef-401c-9119-ffb741eafa9f tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] 10.222.0.50 "GET /compute/v2.1/servers/87dcedb5-91c7-4bc3-b46f-124ccffedf78" status: 200 len: 1521 microversion: 2.1 time: 0.165306 Sep 24 05:03:16.461337 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 196/423] 10.222.0.50 () {58 vars in 1236 bytes} [Sat Sep 24 05:03:16 2022] GET /compute/v2.1/servers/87dcedb5-91c7-4bc3-b46f-124ccffedf78 => generated 1521 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 05:03:17.482582 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-d5158ce1-770c-4a87-9086-911ab37e592e tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Calling method '>' {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:03:17.483185 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.compute.api [None req-d5158ce1-770c-4a87-9086-911ab37e592e tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] [instance: 87dcedb5-91c7-4bc3-b46f-124ccffedf78] Fetching instance by UUID {{(pid=120594) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:03:17.488979 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-d5158ce1-770c-4a87-9086-911ab37e592e tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:03:17.489459 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-d5158ce1-770c-4a87-9086-911ab37e592e tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:03:17.489892 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-d5158ce1-770c-4a87-9086-911ab37e592e tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:03:17.490599 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-d5158ce1-770c-4a87-9086-911ab37e592e tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:03:17.491053 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-d5158ce1-770c-4a87-9086-911ab37e592e tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:03:17.491470 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-d5158ce1-770c-4a87-9086-911ab37e592e tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:03:17.628182 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.policy [None req-d5158ce1-770c-4a87-9086-911ab37e592e tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cdd0da2c7bc4139bcd48ef36a2ee183', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a18a3756ba2b460d977f738a115ebfe0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:03:17.635696 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [None req-d5158ce1-770c-4a87-9086-911ab37e592e tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] 10.222.0.50 "GET /compute/v2.1/servers/87dcedb5-91c7-4bc3-b46f-124ccffedf78" status: 200 len: 1521 microversion: 2.1 time: 0.156865 Sep 24 05:03:17.636257 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 228/424] 10.222.0.50 () {58 vars in 1236 bytes} [Sat Sep 24 05:03:17 2022] GET /compute/v2.1/servers/87dcedb5-91c7-4bc3-b46f-124ccffedf78 => generated 1521 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 05:03:18.659627 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-9a124e86-d8bf-4e99-9220-829bde6539e5 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Calling method '>' {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:03:18.660230 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.compute.api [None req-9a124e86-d8bf-4e99-9220-829bde6539e5 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] [instance: 87dcedb5-91c7-4bc3-b46f-124ccffedf78] Fetching instance by UUID {{(pid=120593) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:03:18.666379 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-9a124e86-d8bf-4e99-9220-829bde6539e5 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:03:18.666837 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-9a124e86-d8bf-4e99-9220-829bde6539e5 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:03:18.667276 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-9a124e86-d8bf-4e99-9220-829bde6539e5 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:03:18.667963 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-9a124e86-d8bf-4e99-9220-829bde6539e5 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:03:18.668418 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-9a124e86-d8bf-4e99-9220-829bde6539e5 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:03:18.668844 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-9a124e86-d8bf-4e99-9220-829bde6539e5 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:03:18.803527 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-9a124e86-d8bf-4e99-9220-829bde6539e5 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cdd0da2c7bc4139bcd48ef36a2ee183', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a18a3756ba2b460d977f738a115ebfe0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:03:18.811244 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-9a124e86-d8bf-4e99-9220-829bde6539e5 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] 10.222.0.50 "GET /compute/v2.1/servers/87dcedb5-91c7-4bc3-b46f-124ccffedf78" status: 200 len: 1521 microversion: 2.1 time: 0.155550 Sep 24 05:03:18.811812 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 197/425] 10.222.0.50 () {58 vars in 1236 bytes} [Sat Sep 24 05:03:18 2022] GET /compute/v2.1/servers/87dcedb5-91c7-4bc3-b46f-124ccffedf78 => generated 1521 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 05:03:19.833962 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-9201792d-7a6a-4d74-bbfa-c698aa7719ec tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Calling method '>' {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:03:19.834535 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.compute.api [None req-9201792d-7a6a-4d74-bbfa-c698aa7719ec tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] [instance: 87dcedb5-91c7-4bc3-b46f-124ccffedf78] Fetching instance by UUID {{(pid=120594) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:03:19.841068 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-9201792d-7a6a-4d74-bbfa-c698aa7719ec tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:03:19.841683 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-9201792d-7a6a-4d74-bbfa-c698aa7719ec tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:03:19.842775 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-9201792d-7a6a-4d74-bbfa-c698aa7719ec tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:03:19.843625 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-9201792d-7a6a-4d74-bbfa-c698aa7719ec tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:03:19.844132 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-9201792d-7a6a-4d74-bbfa-c698aa7719ec tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:03:19.844660 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-9201792d-7a6a-4d74-bbfa-c698aa7719ec tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:03:19.976125 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.policy [None req-9201792d-7a6a-4d74-bbfa-c698aa7719ec tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cdd0da2c7bc4139bcd48ef36a2ee183', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a18a3756ba2b460d977f738a115ebfe0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:03:19.983675 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [None req-9201792d-7a6a-4d74-bbfa-c698aa7719ec tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] 10.222.0.50 "GET /compute/v2.1/servers/87dcedb5-91c7-4bc3-b46f-124ccffedf78" status: 200 len: 1521 microversion: 2.1 time: 0.153892 Sep 24 05:03:19.984231 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 229/426] 10.222.0.50 () {58 vars in 1236 bytes} [Sat Sep 24 05:03:19 2022] GET /compute/v2.1/servers/87dcedb5-91c7-4bc3-b46f-124ccffedf78 => generated 1521 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 05:03:21.007817 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-e88ea2da-98ed-41c6-b233-2612f70b0e18 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Calling method '>' {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:03:21.008540 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.compute.api [None req-e88ea2da-98ed-41c6-b233-2612f70b0e18 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] [instance: 87dcedb5-91c7-4bc3-b46f-124ccffedf78] Fetching instance by UUID {{(pid=120593) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:03:21.015462 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-e88ea2da-98ed-41c6-b233-2612f70b0e18 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:03:21.015931 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-e88ea2da-98ed-41c6-b233-2612f70b0e18 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:03:21.016358 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-e88ea2da-98ed-41c6-b233-2612f70b0e18 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:03:21.017058 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-e88ea2da-98ed-41c6-b233-2612f70b0e18 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:03:21.017766 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-e88ea2da-98ed-41c6-b233-2612f70b0e18 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:03:21.018211 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-e88ea2da-98ed-41c6-b233-2612f70b0e18 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:03:21.150182 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-e88ea2da-98ed-41c6-b233-2612f70b0e18 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cdd0da2c7bc4139bcd48ef36a2ee183', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a18a3756ba2b460d977f738a115ebfe0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:03:21.160931 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-e88ea2da-98ed-41c6-b233-2612f70b0e18 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] 10.222.0.50 "GET /compute/v2.1/servers/87dcedb5-91c7-4bc3-b46f-124ccffedf78" status: 200 len: 1521 microversion: 2.1 time: 0.156686 Sep 24 05:03:21.161724 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 198/427] 10.222.0.50 () {58 vars in 1236 bytes} [Sat Sep 24 05:03:21 2022] GET /compute/v2.1/servers/87dcedb5-91c7-4bc3-b46f-124ccffedf78 => generated 1521 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 05:03:22.184021 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-fda57c01-edcb-4f58-bbc4-90f429a2045d tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Calling method '>' {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:03:22.184623 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.compute.api [None req-fda57c01-edcb-4f58-bbc4-90f429a2045d tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] [instance: 87dcedb5-91c7-4bc3-b46f-124ccffedf78] Fetching instance by UUID {{(pid=120594) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:03:22.191125 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-fda57c01-edcb-4f58-bbc4-90f429a2045d tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:03:22.191601 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-fda57c01-edcb-4f58-bbc4-90f429a2045d tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:03:22.192038 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-fda57c01-edcb-4f58-bbc4-90f429a2045d tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:03:22.192715 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-fda57c01-edcb-4f58-bbc4-90f429a2045d tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:03:22.193158 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-fda57c01-edcb-4f58-bbc4-90f429a2045d tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:03:22.193574 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-fda57c01-edcb-4f58-bbc4-90f429a2045d tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:03:22.197439 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG dbcounter [-] [120594] Writing DB stats nova_cell1:SELECT=100 {{(pid=120594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 05:03:22.335408 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.policy [None req-fda57c01-edcb-4f58-bbc4-90f429a2045d tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cdd0da2c7bc4139bcd48ef36a2ee183', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a18a3756ba2b460d977f738a115ebfe0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:03:22.343585 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [None req-fda57c01-edcb-4f58-bbc4-90f429a2045d tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] 10.222.0.50 "GET /compute/v2.1/servers/87dcedb5-91c7-4bc3-b46f-124ccffedf78" status: 200 len: 1521 microversion: 2.1 time: 0.163385 Sep 24 05:03:22.344428 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 230/428] 10.222.0.50 () {58 vars in 1236 bytes} [Sat Sep 24 05:03:22 2022] GET /compute/v2.1/servers/87dcedb5-91c7-4bc3-b46f-124ccffedf78 => generated 1521 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 05:03:23.369446 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-700bba45-759c-44fc-8674-68d419022631 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Calling method '>' {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:03:23.370064 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.compute.api [None req-700bba45-759c-44fc-8674-68d419022631 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] [instance: 87dcedb5-91c7-4bc3-b46f-124ccffedf78] Fetching instance by UUID {{(pid=120593) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:03:23.376509 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-700bba45-759c-44fc-8674-68d419022631 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:03:23.377042 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-700bba45-759c-44fc-8674-68d419022631 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:03:23.377408 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-700bba45-759c-44fc-8674-68d419022631 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:03:23.378120 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-700bba45-759c-44fc-8674-68d419022631 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:03:23.378567 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-700bba45-759c-44fc-8674-68d419022631 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:03:23.378982 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-700bba45-759c-44fc-8674-68d419022631 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:03:23.511288 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-700bba45-759c-44fc-8674-68d419022631 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cdd0da2c7bc4139bcd48ef36a2ee183', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a18a3756ba2b460d977f738a115ebfe0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:03:23.519666 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-700bba45-759c-44fc-8674-68d419022631 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] 10.222.0.50 "GET /compute/v2.1/servers/87dcedb5-91c7-4bc3-b46f-124ccffedf78" status: 200 len: 1521 microversion: 2.1 time: 0.154137 Sep 24 05:03:23.520227 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 199/429] 10.222.0.50 () {58 vars in 1236 bytes} [Sat Sep 24 05:03:23 2022] GET /compute/v2.1/servers/87dcedb5-91c7-4bc3-b46f-124ccffedf78 => generated 1521 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 05:03:24.546624 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-0bc815c6-412b-4d37-8528-65f5bb171c4b tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Calling method '>' {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:03:24.547216 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.compute.api [None req-0bc815c6-412b-4d37-8528-65f5bb171c4b tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] [instance: 87dcedb5-91c7-4bc3-b46f-124ccffedf78] Fetching instance by UUID {{(pid=120594) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:03:24.552993 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-0bc815c6-412b-4d37-8528-65f5bb171c4b tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:03:24.553464 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-0bc815c6-412b-4d37-8528-65f5bb171c4b tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:03:24.553888 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-0bc815c6-412b-4d37-8528-65f5bb171c4b tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:03:24.554590 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-0bc815c6-412b-4d37-8528-65f5bb171c4b tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:03:24.555033 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-0bc815c6-412b-4d37-8528-65f5bb171c4b tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:03:24.555449 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-0bc815c6-412b-4d37-8528-65f5bb171c4b tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:03:24.687223 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.policy [None req-0bc815c6-412b-4d37-8528-65f5bb171c4b tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cdd0da2c7bc4139bcd48ef36a2ee183', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a18a3756ba2b460d977f738a115ebfe0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:03:24.695110 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [None req-0bc815c6-412b-4d37-8528-65f5bb171c4b tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] 10.222.0.50 "GET /compute/v2.1/servers/87dcedb5-91c7-4bc3-b46f-124ccffedf78" status: 200 len: 1521 microversion: 2.1 time: 0.153051 Sep 24 05:03:24.696222 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 231/430] 10.222.0.50 () {58 vars in 1236 bytes} [Sat Sep 24 05:03:24 2022] GET /compute/v2.1/servers/87dcedb5-91c7-4bc3-b46f-124ccffedf78 => generated 1521 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 05:03:25.719497 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-ac73dc9c-06c6-4438-9b2a-796e1ed534dc tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Calling method '>' {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:03:25.720439 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.compute.api [None req-ac73dc9c-06c6-4438-9b2a-796e1ed534dc tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] [instance: 87dcedb5-91c7-4bc3-b46f-124ccffedf78] Fetching instance by UUID {{(pid=120593) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:03:25.728104 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-ac73dc9c-06c6-4438-9b2a-796e1ed534dc tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:03:25.728601 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-ac73dc9c-06c6-4438-9b2a-796e1ed534dc tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:03:25.729031 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-ac73dc9c-06c6-4438-9b2a-796e1ed534dc tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:03:25.729720 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-ac73dc9c-06c6-4438-9b2a-796e1ed534dc tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:03:25.730199 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-ac73dc9c-06c6-4438-9b2a-796e1ed534dc tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:03:25.730619 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-ac73dc9c-06c6-4438-9b2a-796e1ed534dc tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:03:25.861602 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-ac73dc9c-06c6-4438-9b2a-796e1ed534dc tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cdd0da2c7bc4139bcd48ef36a2ee183', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a18a3756ba2b460d977f738a115ebfe0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:03:25.869439 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-ac73dc9c-06c6-4438-9b2a-796e1ed534dc tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] 10.222.0.50 "GET /compute/v2.1/servers/87dcedb5-91c7-4bc3-b46f-124ccffedf78" status: 200 len: 1521 microversion: 2.1 time: 0.154715 Sep 24 05:03:25.870020 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 200/431] 10.222.0.50 () {58 vars in 1236 bytes} [Sat Sep 24 05:03:25 2022] GET /compute/v2.1/servers/87dcedb5-91c7-4bc3-b46f-124ccffedf78 => generated 1521 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 05:03:26.893166 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-0158232e-b462-4440-87e2-81a40050de13 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Calling method '>' {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:03:26.894082 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.compute.api [None req-0158232e-b462-4440-87e2-81a40050de13 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] [instance: 87dcedb5-91c7-4bc3-b46f-124ccffedf78] Fetching instance by UUID {{(pid=120594) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:03:26.900193 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-0158232e-b462-4440-87e2-81a40050de13 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:03:26.900678 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-0158232e-b462-4440-87e2-81a40050de13 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:03:26.901116 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-0158232e-b462-4440-87e2-81a40050de13 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:03:26.901848 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-0158232e-b462-4440-87e2-81a40050de13 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:03:26.902380 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-0158232e-b462-4440-87e2-81a40050de13 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:03:26.902806 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-0158232e-b462-4440-87e2-81a40050de13 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:03:27.037042 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.policy [None req-0158232e-b462-4440-87e2-81a40050de13 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cdd0da2c7bc4139bcd48ef36a2ee183', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a18a3756ba2b460d977f738a115ebfe0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:03:27.044834 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [None req-0158232e-b462-4440-87e2-81a40050de13 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] 10.222.0.50 "GET /compute/v2.1/servers/87dcedb5-91c7-4bc3-b46f-124ccffedf78" status: 200 len: 1521 microversion: 2.1 time: 0.156113 Sep 24 05:03:27.045411 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 232/432] 10.222.0.50 () {58 vars in 1236 bytes} [Sat Sep 24 05:03:26 2022] GET /compute/v2.1/servers/87dcedb5-91c7-4bc3-b46f-124ccffedf78 => generated 1521 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 05:03:28.068411 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-242902cf-f066-4407-9b99-6ccc1ae7a2c4 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Calling method '>' {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:03:28.068921 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.compute.api [None req-242902cf-f066-4407-9b99-6ccc1ae7a2c4 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] [instance: 87dcedb5-91c7-4bc3-b46f-124ccffedf78] Fetching instance by UUID {{(pid=120593) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:03:28.075350 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-242902cf-f066-4407-9b99-6ccc1ae7a2c4 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:03:28.075821 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-242902cf-f066-4407-9b99-6ccc1ae7a2c4 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:03:28.076259 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-242902cf-f066-4407-9b99-6ccc1ae7a2c4 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:03:28.076932 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-242902cf-f066-4407-9b99-6ccc1ae7a2c4 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:03:28.077378 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-242902cf-f066-4407-9b99-6ccc1ae7a2c4 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:03:28.077791 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-242902cf-f066-4407-9b99-6ccc1ae7a2c4 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:03:28.202720 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-242902cf-f066-4407-9b99-6ccc1ae7a2c4 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cdd0da2c7bc4139bcd48ef36a2ee183', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a18a3756ba2b460d977f738a115ebfe0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:03:28.211067 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-242902cf-f066-4407-9b99-6ccc1ae7a2c4 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] 10.222.0.50 "GET /compute/v2.1/servers/87dcedb5-91c7-4bc3-b46f-124ccffedf78" status: 200 len: 1521 microversion: 2.1 time: 0.146582 Sep 24 05:03:28.211620 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 201/433] 10.222.0.50 () {58 vars in 1236 bytes} [Sat Sep 24 05:03:28 2022] GET /compute/v2.1/servers/87dcedb5-91c7-4bc3-b46f-124ccffedf78 => generated 1521 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 05:03:29.232621 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-cb8e0b6e-eddf-45ea-9244-9bca1ec06fdc tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Calling method '>' {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:03:29.233245 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.compute.api [None req-cb8e0b6e-eddf-45ea-9244-9bca1ec06fdc tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] [instance: 87dcedb5-91c7-4bc3-b46f-124ccffedf78] Fetching instance by UUID {{(pid=120594) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:03:29.239147 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-cb8e0b6e-eddf-45ea-9244-9bca1ec06fdc tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:03:29.239618 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-cb8e0b6e-eddf-45ea-9244-9bca1ec06fdc tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:03:29.240047 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-cb8e0b6e-eddf-45ea-9244-9bca1ec06fdc tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:03:29.240724 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-cb8e0b6e-eddf-45ea-9244-9bca1ec06fdc tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:03:29.241164 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-cb8e0b6e-eddf-45ea-9244-9bca1ec06fdc tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:03:29.241579 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-cb8e0b6e-eddf-45ea-9244-9bca1ec06fdc tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:03:29.380257 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.policy [None req-cb8e0b6e-eddf-45ea-9244-9bca1ec06fdc tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cdd0da2c7bc4139bcd48ef36a2ee183', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a18a3756ba2b460d977f738a115ebfe0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:03:29.387776 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [None req-cb8e0b6e-eddf-45ea-9244-9bca1ec06fdc tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] 10.222.0.50 "GET /compute/v2.1/servers/87dcedb5-91c7-4bc3-b46f-124ccffedf78" status: 200 len: 1521 microversion: 2.1 time: 0.158961 Sep 24 05:03:29.388333 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 233/434] 10.222.0.50 () {58 vars in 1236 bytes} [Sat Sep 24 05:03:29 2022] GET /compute/v2.1/servers/87dcedb5-91c7-4bc3-b46f-124ccffedf78 => generated 1521 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 05:03:30.412522 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-f5dfd4a4-3295-4fc1-8705-e171530874fa tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Calling method '>' {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:03:30.413526 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.compute.api [None req-f5dfd4a4-3295-4fc1-8705-e171530874fa tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] [instance: 87dcedb5-91c7-4bc3-b46f-124ccffedf78] Fetching instance by UUID {{(pid=120593) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:03:30.421590 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-f5dfd4a4-3295-4fc1-8705-e171530874fa tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:03:30.422188 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-f5dfd4a4-3295-4fc1-8705-e171530874fa tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:03:30.422871 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-f5dfd4a4-3295-4fc1-8705-e171530874fa tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:03:30.423636 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-f5dfd4a4-3295-4fc1-8705-e171530874fa tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:03:30.424125 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-f5dfd4a4-3295-4fc1-8705-e171530874fa tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:03:30.424734 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-f5dfd4a4-3295-4fc1-8705-e171530874fa tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:03:30.557828 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-f5dfd4a4-3295-4fc1-8705-e171530874fa tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cdd0da2c7bc4139bcd48ef36a2ee183', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a18a3756ba2b460d977f738a115ebfe0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:03:30.566820 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-f5dfd4a4-3295-4fc1-8705-e171530874fa tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] 10.222.0.50 "GET /compute/v2.1/servers/87dcedb5-91c7-4bc3-b46f-124ccffedf78" status: 200 len: 1521 microversion: 2.1 time: 0.159779 Sep 24 05:03:30.567385 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 202/435] 10.222.0.50 () {58 vars in 1236 bytes} [Sat Sep 24 05:03:30 2022] GET /compute/v2.1/servers/87dcedb5-91c7-4bc3-b46f-124ccffedf78 => generated 1521 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 05:03:31.590081 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-5a0abf6a-ce79-4233-8975-3fbc51bfd00e tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Calling method '>' {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:03:31.590696 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.compute.api [None req-5a0abf6a-ce79-4233-8975-3fbc51bfd00e tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] [instance: 87dcedb5-91c7-4bc3-b46f-124ccffedf78] Fetching instance by UUID {{(pid=120594) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:03:31.596653 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-5a0abf6a-ce79-4233-8975-3fbc51bfd00e tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:03:31.597135 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-5a0abf6a-ce79-4233-8975-3fbc51bfd00e tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:03:31.597749 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-5a0abf6a-ce79-4233-8975-3fbc51bfd00e tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:03:31.599064 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-5a0abf6a-ce79-4233-8975-3fbc51bfd00e tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:03:31.599750 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-5a0abf6a-ce79-4233-8975-3fbc51bfd00e tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:03:31.600222 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-5a0abf6a-ce79-4233-8975-3fbc51bfd00e tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:03:31.785970 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.policy [None req-5a0abf6a-ce79-4233-8975-3fbc51bfd00e tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cdd0da2c7bc4139bcd48ef36a2ee183', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a18a3756ba2b460d977f738a115ebfe0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:03:31.793612 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [None req-5a0abf6a-ce79-4233-8975-3fbc51bfd00e tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] 10.222.0.50 "GET /compute/v2.1/servers/87dcedb5-91c7-4bc3-b46f-124ccffedf78" status: 200 len: 1521 microversion: 2.1 time: 0.207331 Sep 24 05:03:31.794355 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 234/436] 10.222.0.50 () {58 vars in 1236 bytes} [Sat Sep 24 05:03:31 2022] GET /compute/v2.1/servers/87dcedb5-91c7-4bc3-b46f-124ccffedf78 => generated 1521 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 05:03:32.816554 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-1ca67af6-009e-4209-9da2-e8197053e03c tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Calling method '>' {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:03:32.817154 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.compute.api [None req-1ca67af6-009e-4209-9da2-e8197053e03c tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] [instance: 87dcedb5-91c7-4bc3-b46f-124ccffedf78] Fetching instance by UUID {{(pid=120593) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:03:32.824057 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-1ca67af6-009e-4209-9da2-e8197053e03c tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:03:32.824537 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-1ca67af6-009e-4209-9da2-e8197053e03c tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:03:32.824963 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-1ca67af6-009e-4209-9da2-e8197053e03c tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:03:32.826450 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-1ca67af6-009e-4209-9da2-e8197053e03c tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:03:32.827115 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-1ca67af6-009e-4209-9da2-e8197053e03c tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:03:32.827793 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-1ca67af6-009e-4209-9da2-e8197053e03c tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:03:32.985832 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-1ca67af6-009e-4209-9da2-e8197053e03c tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cdd0da2c7bc4139bcd48ef36a2ee183', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a18a3756ba2b460d977f738a115ebfe0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:03:32.994620 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-1ca67af6-009e-4209-9da2-e8197053e03c tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] 10.222.0.50 "GET /compute/v2.1/servers/87dcedb5-91c7-4bc3-b46f-124ccffedf78" status: 200 len: 1521 microversion: 2.1 time: 0.181803 Sep 24 05:03:32.995676 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 203/437] 10.222.0.50 () {58 vars in 1236 bytes} [Sat Sep 24 05:03:32 2022] GET /compute/v2.1/servers/87dcedb5-91c7-4bc3-b46f-124ccffedf78 => generated 1521 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 05:03:34.018763 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-5b1f05bb-bb04-4928-ba4a-a530941f9ad2 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Calling method '>' {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:03:34.019931 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.compute.api [None req-5b1f05bb-bb04-4928-ba4a-a530941f9ad2 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] [instance: 87dcedb5-91c7-4bc3-b46f-124ccffedf78] Fetching instance by UUID {{(pid=120594) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:03:34.027957 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-5b1f05bb-bb04-4928-ba4a-a530941f9ad2 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:03:34.028530 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-5b1f05bb-bb04-4928-ba4a-a530941f9ad2 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:03:34.028965 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-5b1f05bb-bb04-4928-ba4a-a530941f9ad2 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:03:34.029701 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-5b1f05bb-bb04-4928-ba4a-a530941f9ad2 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:03:34.030224 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-5b1f05bb-bb04-4928-ba4a-a530941f9ad2 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:03:34.030683 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-5b1f05bb-bb04-4928-ba4a-a530941f9ad2 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:03:34.218370 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.policy [None req-5b1f05bb-bb04-4928-ba4a-a530941f9ad2 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cdd0da2c7bc4139bcd48ef36a2ee183', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a18a3756ba2b460d977f738a115ebfe0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:03:34.226720 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [None req-5b1f05bb-bb04-4928-ba4a-a530941f9ad2 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] 10.222.0.50 "GET /compute/v2.1/servers/87dcedb5-91c7-4bc3-b46f-124ccffedf78" status: 200 len: 1521 microversion: 2.1 time: 0.212726 Sep 24 05:03:34.227489 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 235/438] 10.222.0.50 () {58 vars in 1236 bytes} [Sat Sep 24 05:03:34 2022] GET /compute/v2.1/servers/87dcedb5-91c7-4bc3-b46f-124ccffedf78 => generated 1521 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 05:03:35.251118 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-5169ffbc-6c17-4c3f-b9e1-58ccf3350fb5 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Calling method '>' {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:03:35.251723 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.compute.api [None req-5169ffbc-6c17-4c3f-b9e1-58ccf3350fb5 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] [instance: 87dcedb5-91c7-4bc3-b46f-124ccffedf78] Fetching instance by UUID {{(pid=120593) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:03:35.255088 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG dbcounter [-] [120593] Writing DB stats nova_api:SELECT=28 {{(pid=120593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 05:03:35.259216 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-5169ffbc-6c17-4c3f-b9e1-58ccf3350fb5 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:03:35.259954 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-5169ffbc-6c17-4c3f-b9e1-58ccf3350fb5 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:03:35.260549 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-5169ffbc-6c17-4c3f-b9e1-58ccf3350fb5 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:03:35.261258 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-5169ffbc-6c17-4c3f-b9e1-58ccf3350fb5 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:03:35.261872 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-5169ffbc-6c17-4c3f-b9e1-58ccf3350fb5 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:03:35.262325 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-5169ffbc-6c17-4c3f-b9e1-58ccf3350fb5 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:03:35.450551 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-5169ffbc-6c17-4c3f-b9e1-58ccf3350fb5 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cdd0da2c7bc4139bcd48ef36a2ee183', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a18a3756ba2b460d977f738a115ebfe0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:03:35.458360 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-5169ffbc-6c17-4c3f-b9e1-58ccf3350fb5 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] 10.222.0.50 "GET /compute/v2.1/servers/87dcedb5-91c7-4bc3-b46f-124ccffedf78" status: 200 len: 1521 microversion: 2.1 time: 0.211632 Sep 24 05:03:35.473533 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 204/439] 10.222.0.50 () {58 vars in 1236 bytes} [Sat Sep 24 05:03:35 2022] GET /compute/v2.1/servers/87dcedb5-91c7-4bc3-b46f-124ccffedf78 => generated 1521 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 05:03:36.480610 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-241351d0-2ee7-4038-b8e4-5296a1532b08 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Calling method '>' {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:03:36.481219 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.compute.api [None req-241351d0-2ee7-4038-b8e4-5296a1532b08 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] [instance: 87dcedb5-91c7-4bc3-b46f-124ccffedf78] Fetching instance by UUID {{(pid=120594) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:03:36.483077 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG dbcounter [-] [120594] Writing DB stats nova_api:SELECT=28 {{(pid=120594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 05:03:36.488553 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-241351d0-2ee7-4038-b8e4-5296a1532b08 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:03:36.489175 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-241351d0-2ee7-4038-b8e4-5296a1532b08 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:03:36.489495 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-241351d0-2ee7-4038-b8e4-5296a1532b08 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:03:36.490220 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-241351d0-2ee7-4038-b8e4-5296a1532b08 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:03:36.490739 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-241351d0-2ee7-4038-b8e4-5296a1532b08 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:03:36.491371 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-241351d0-2ee7-4038-b8e4-5296a1532b08 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:03:36.622543 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.policy [None req-241351d0-2ee7-4038-b8e4-5296a1532b08 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cdd0da2c7bc4139bcd48ef36a2ee183', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a18a3756ba2b460d977f738a115ebfe0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:03:36.631657 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [None req-241351d0-2ee7-4038-b8e4-5296a1532b08 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] 10.222.0.50 "GET /compute/v2.1/servers/87dcedb5-91c7-4bc3-b46f-124ccffedf78" status: 200 len: 1521 microversion: 2.1 time: 0.154887 Sep 24 05:03:36.632224 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 236/440] 10.222.0.50 () {58 vars in 1236 bytes} [Sat Sep 24 05:03:36 2022] GET /compute/v2.1/servers/87dcedb5-91c7-4bc3-b46f-124ccffedf78 => generated 1521 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 05:03:37.654935 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-0124ceea-5925-48f0-92b8-0fd6b7edf6ed tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Calling method '>' {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:03:37.659355 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.compute.api [None req-0124ceea-5925-48f0-92b8-0fd6b7edf6ed tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] [instance: 87dcedb5-91c7-4bc3-b46f-124ccffedf78] Fetching instance by UUID {{(pid=120593) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:03:37.670079 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-0124ceea-5925-48f0-92b8-0fd6b7edf6ed tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:03:37.670832 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-0124ceea-5925-48f0-92b8-0fd6b7edf6ed tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:03:37.671190 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-0124ceea-5925-48f0-92b8-0fd6b7edf6ed tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:03:37.671881 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-0124ceea-5925-48f0-92b8-0fd6b7edf6ed tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:03:37.672355 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-0124ceea-5925-48f0-92b8-0fd6b7edf6ed tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:03:37.672962 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-0124ceea-5925-48f0-92b8-0fd6b7edf6ed tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:03:37.818404 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-0124ceea-5925-48f0-92b8-0fd6b7edf6ed tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cdd0da2c7bc4139bcd48ef36a2ee183', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a18a3756ba2b460d977f738a115ebfe0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:03:37.828235 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-0124ceea-5925-48f0-92b8-0fd6b7edf6ed tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] 10.222.0.50 "GET /compute/v2.1/servers/87dcedb5-91c7-4bc3-b46f-124ccffedf78" status: 200 len: 1521 microversion: 2.1 time: 0.177393 Sep 24 05:03:37.841325 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 205/441] 10.222.0.50 () {58 vars in 1236 bytes} [Sat Sep 24 05:03:37 2022] GET /compute/v2.1/servers/87dcedb5-91c7-4bc3-b46f-124ccffedf78 => generated 1521 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 05:03:38.854067 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-5187cb63-ef78-47c3-8684-21ba05498e80 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Calling method '>' {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:03:38.854575 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.compute.api [None req-5187cb63-ef78-47c3-8684-21ba05498e80 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] [instance: 87dcedb5-91c7-4bc3-b46f-124ccffedf78] Fetching instance by UUID {{(pid=120594) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:03:38.861139 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-5187cb63-ef78-47c3-8684-21ba05498e80 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:03:38.861620 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-5187cb63-ef78-47c3-8684-21ba05498e80 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:03:38.862085 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-5187cb63-ef78-47c3-8684-21ba05498e80 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:03:38.862771 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-5187cb63-ef78-47c3-8684-21ba05498e80 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:03:38.863223 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-5187cb63-ef78-47c3-8684-21ba05498e80 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:03:38.863647 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-5187cb63-ef78-47c3-8684-21ba05498e80 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:03:38.988419 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.policy [None req-5187cb63-ef78-47c3-8684-21ba05498e80 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cdd0da2c7bc4139bcd48ef36a2ee183', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a18a3756ba2b460d977f738a115ebfe0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:03:38.997150 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [None req-5187cb63-ef78-47c3-8684-21ba05498e80 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] 10.222.0.50 "GET /compute/v2.1/servers/87dcedb5-91c7-4bc3-b46f-124ccffedf78" status: 200 len: 1521 microversion: 2.1 time: 0.146980 Sep 24 05:03:38.997917 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 237/442] 10.222.0.50 () {58 vars in 1236 bytes} [Sat Sep 24 05:03:38 2022] GET /compute/v2.1/servers/87dcedb5-91c7-4bc3-b46f-124ccffedf78 => generated 1521 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 05:03:40.021485 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-05ee69fd-09b3-47fa-bf71-e11bfab70f04 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Calling method '>' {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:03:40.022119 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.compute.api [None req-05ee69fd-09b3-47fa-bf71-e11bfab70f04 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] [instance: 87dcedb5-91c7-4bc3-b46f-124ccffedf78] Fetching instance by UUID {{(pid=120593) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:03:40.028504 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-05ee69fd-09b3-47fa-bf71-e11bfab70f04 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:03:40.029018 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-05ee69fd-09b3-47fa-bf71-e11bfab70f04 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:03:40.029452 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-05ee69fd-09b3-47fa-bf71-e11bfab70f04 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:03:40.030189 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-05ee69fd-09b3-47fa-bf71-e11bfab70f04 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:03:40.030645 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-05ee69fd-09b3-47fa-bf71-e11bfab70f04 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:03:40.031063 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-05ee69fd-09b3-47fa-bf71-e11bfab70f04 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:03:40.158954 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-05ee69fd-09b3-47fa-bf71-e11bfab70f04 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cdd0da2c7bc4139bcd48ef36a2ee183', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a18a3756ba2b460d977f738a115ebfe0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:03:40.166527 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-05ee69fd-09b3-47fa-bf71-e11bfab70f04 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] 10.222.0.50 "GET /compute/v2.1/servers/87dcedb5-91c7-4bc3-b46f-124ccffedf78" status: 200 len: 1501 microversion: 2.1 time: 0.149192 Sep 24 05:03:40.167092 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 206/443] 10.222.0.50 () {58 vars in 1236 bytes} [Sat Sep 24 05:03:40 2022] GET /compute/v2.1/servers/87dcedb5-91c7-4bc3-b46f-124ccffedf78 => generated 1501 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 05:03:40.188797 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-55c1049f-a827-452e-90ed-db83d5faa79a tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "5f23bb81-8b3f-4487-b7b9-5585209e8c06"}} {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 05:03:40.191263 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.compute.api [None req-55c1049f-a827-452e-90ed-db83d5faa79a tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] [instance: 87dcedb5-91c7-4bc3-b46f-124ccffedf78] Fetching instance by UUID {{(pid=120594) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:03:40.197113 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-55c1049f-a827-452e-90ed-db83d5faa79a tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:03:40.197583 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-55c1049f-a827-452e-90ed-db83d5faa79a tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:03:40.198060 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-55c1049f-a827-452e-90ed-db83d5faa79a tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:03:40.198740 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-55c1049f-a827-452e-90ed-db83d5faa79a tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:03:40.199183 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-55c1049f-a827-452e-90ed-db83d5faa79a tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:03:40.199594 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-55c1049f-a827-452e-90ed-db83d5faa79a tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:03:40.223382 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: INFO nova.api.openstack.wsgi [None req-55c1049f-a827-452e-90ed-db83d5faa79a tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] HTTP exception thrown: Cannot 'attach_volume' instance 87dcedb5-91c7-4bc3-b46f-124ccffedf78 while it is in vm_state rescued Sep 24 05:03:40.224944 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-55c1049f-a827-452e-90ed-db83d5faa79a tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Request method failure captured: Sep 24 05:03:40.224944 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: request: POST /compute/v2.1/servers/87dcedb5-91c7-4bc3-b46f-124ccffedf78/os-volume_attachments HTTP/1.1 Sep 24 05:03:40.224944 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: Accept: application/json Sep 24 05:03:40.224944 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: Accept-Encoding: identity Sep 24 05:03:40.224944 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: Connection: close Sep 24 05:03:40.224944 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: Content-Length: 74 Sep 24 05:03:40.224944 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: Content-Type: application/json Sep 24 05:03:40.224944 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: Host: 10.222.0.50 Sep 24 05:03:40.224944 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: Openstack-System-Scope: None Sep 24 05:03:40.224944 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: User-Agent: python-urllib3/1.26.12 Sep 24 05:03:40.224944 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: X-Auth-Token: gAAAAABjLo8HTzNG_FPeaRlb1iKtn70N4qXi3bCZUsBH5ev83dMKRgyc3ir4exWyX_HELoYhUZuaNsGC0Iz7uIZoAOnFSUT1gUYQNLBWBHD4Hr9Zo2LmNKYYpHEOSNBOqs6trhPvBX0Mbw8c_gmqJ1Foarii5zl7NKWXL_yy02zfSiE1i-m0pa8 Sep 24 05:03:40.224944 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: X-Domain-Id: None Sep 24 05:03:40.224944 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: X-Domain-Name: None Sep 24 05:03:40.224944 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: X-Identity-Status: Confirmed Sep 24 05:03:40.224944 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: X-Is-Admin-Project: True Sep 24 05:03:40.224944 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: X-Project-Domain-Id: default Sep 24 05:03:40.224944 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: X-Project-Domain-Name: Default Sep 24 05:03:40.224944 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: X-Project-Id: a18a3756ba2b460d977f738a115ebfe0 Sep 24 05:03:40.224944 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1841571325 Sep 24 05:03:40.224944 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: X-Role: member,reader Sep 24 05:03:40.224944 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: X-Roles: member,reader Sep 24 05:03:40.226393 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/a18a3756ba2b460d977f738a115ebfe0"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/a18a3756ba2b460d977f738a115ebfe0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/a18a3756ba2b460d977f738a115ebfe0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.50:8080", "publicURL": "http://10.222.0.50:8080/v1/AUTH_a18a3756ba2b460d977f738a115ebfe0"}]}] Sep 24 05:03:40.226393 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1841571325 Sep 24 05:03:40.226393 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: X-Tenant-Id: a18a3756ba2b460d977f738a115ebfe0 Sep 24 05:03:40.226393 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1841571325 Sep 24 05:03:40.226393 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: X-User: tempest-ServerRescueNegativeTestJSON-1841571325-project Sep 24 05:03:40.226393 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: X-User-Domain-Id: default Sep 24 05:03:40.226393 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: X-User-Domain-Name: Default Sep 24 05:03:40.226393 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: X-User-Id: 8cdd0da2c7bc4139bcd48ef36a2ee183 Sep 24 05:03:40.226393 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1841571325-project Sep 24 05:03:40.226393 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: Sep 24 05:03:40.226393 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: {"volumeAttachment": {"volumeId": "5f23bb81-8b3f-4487-b7b9-5585209e8c06"}} Sep 24 05:03:40.226393 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: method: > Sep 24 05:03:40.227128 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: exception: Cannot 'attach_volume' instance 87dcedb5-91c7-4bc3-b46f-124ccffedf78 while it is in vm_state rescued Sep 24 05:03:40.227128 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: action_args: {'server_id': '87dcedb5-91c7-4bc3-b46f-124ccffedf78', 'body': {'volumeAttachment': {'volumeId': '5f23bb81-8b3f-4487-b7b9-5585209e8c06'}}} Sep 24 05:03:40.227128 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 24 05:03:40.227128 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 05:03:40.227128 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Sep 24 05:03:40.227128 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Sep 24 05:03:40.227128 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 24 05:03:40.227128 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 24 05:03:40.227128 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Sep 24 05:03:40.227128 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Sep 24 05:03:40.227128 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 87dcedb5-91c7-4bc3-b46f-124ccffedf78 in vm_state rescued. Cannot attach_volume while the instance is in this state. Sep 24 05:03:40.227128 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi Sep 24 05:03:40.227128 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 05:03:40.227128 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi Sep 24 05:03:40.227128 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 05:03:40.227128 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 05:03:40.227128 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 05:03:40.227128 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 24 05:03:40.227128 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 24 05:03:40.228247 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 24 05:03:40.228247 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 24 05:03:40.228247 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 24 05:03:40.228247 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 24 05:03:40.228247 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 24 05:03:40.228247 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 24 05:03:40.228247 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 24 05:03:40.228247 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 24 05:03:40.228247 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create Sep 24 05:03:40.228247 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Sep 24 05:03:40.228247 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Sep 24 05:03:40.228247 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Sep 24 05:03:40.228247 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance 87dcedb5-91c7-4bc3-b46f-124ccffedf78 while it is in vm_state rescued Sep 24 05:03:40.228247 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi Sep 24 05:03:40.228247 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 05:03:40.228247 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi Sep 24 05:03:40.228247 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 05:03:40.228247 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 05:03:40.228247 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 05:03:40.229344 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 24 05:03:40.229344 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 24 05:03:40.229344 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance 87dcedb5-91c7-4bc3-b46f-124ccffedf78 while it is in vm_state rescued Sep 24 05:03:40.229344 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi Sep 24 05:03:40.229344 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-55c1049f-a827-452e-90ed-db83d5faa79a tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Returning 409 to user: Cannot 'attach_volume' instance 87dcedb5-91c7-4bc3-b46f-124ccffedf78 while it is in vm_state rescued {{(pid=120594) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 24 05:03:40.229344 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [None req-55c1049f-a827-452e-90ed-db83d5faa79a tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] 10.222.0.50 "POST /compute/v2.1/servers/87dcedb5-91c7-4bc3-b46f-124ccffedf78/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.042084 Sep 24 05:03:40.229344 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 238/444] 10.222.0.50 () {60 vars in 1323 bytes} [Sat Sep 24 05:03:40 2022] POST /compute/v2.1/servers/87dcedb5-91c7-4bc3-b46f-124ccffedf78/os-volume_attachments => generated 152 bytes in 43 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Sep 24 05:03:40.235574 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-ad5c2474-1f7d-4fe3-8521-b6c140194b15 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 05:03:40.236104 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.compute.api [None req-ad5c2474-1f7d-4fe3-8521-b6c140194b15 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] [instance: 87dcedb5-91c7-4bc3-b46f-124ccffedf78] Fetching instance by UUID {{(pid=120593) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:03:40.242161 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-ad5c2474-1f7d-4fe3-8521-b6c140194b15 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:03:40.242416 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-ad5c2474-1f7d-4fe3-8521-b6c140194b15 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:03:40.242846 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-ad5c2474-1f7d-4fe3-8521-b6c140194b15 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:03:40.243533 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-ad5c2474-1f7d-4fe3-8521-b6c140194b15 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:03:40.243983 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-ad5c2474-1f7d-4fe3-8521-b6c140194b15 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:03:40.244404 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-ad5c2474-1f7d-4fe3-8521-b6c140194b15 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:03:40.304706 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG dbcounter [-] [120593] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=120593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 05:03:40.315778 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-ad5c2474-1f7d-4fe3-8521-b6c140194b15 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] 10.222.0.50 "POST /compute/v2.1/servers/87dcedb5-91c7-4bc3-b46f-124ccffedf78/action" status: 202 len: 0 microversion: 2.1 time: 0.083859 Sep 24 05:03:40.317059 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 207/445] 10.222.0.50 () {60 vars in 1278 bytes} [Sat Sep 24 05:03:40 2022] POST /compute/v2.1/servers/87dcedb5-91c7-4bc3-b46f-124ccffedf78/action => generated 0 bytes in 86 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 24 05:03:40.324881 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-25aed672-92e6-4c32-a8d5-b872461c588d tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Calling method '>' {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:03:40.325658 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.compute.api [None req-25aed672-92e6-4c32-a8d5-b872461c588d tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] [instance: 87dcedb5-91c7-4bc3-b46f-124ccffedf78] Fetching instance by UUID {{(pid=120594) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:03:40.332396 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-25aed672-92e6-4c32-a8d5-b872461c588d tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:03:40.332883 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-25aed672-92e6-4c32-a8d5-b872461c588d tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:03:40.333332 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-25aed672-92e6-4c32-a8d5-b872461c588d tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:03:40.334115 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-25aed672-92e6-4c32-a8d5-b872461c588d tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:03:40.334565 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-25aed672-92e6-4c32-a8d5-b872461c588d tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:03:40.334978 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-25aed672-92e6-4c32-a8d5-b872461c588d tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:03:40.526635 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.policy [None req-25aed672-92e6-4c32-a8d5-b872461c588d tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cdd0da2c7bc4139bcd48ef36a2ee183', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a18a3756ba2b460d977f738a115ebfe0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:03:40.534973 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [None req-25aed672-92e6-4c32-a8d5-b872461c588d tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] 10.222.0.50 "GET /compute/v2.1/servers/87dcedb5-91c7-4bc3-b46f-124ccffedf78" status: 200 len: 1509 microversion: 2.1 time: 0.213843 Sep 24 05:03:40.536135 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 239/446] 10.222.0.50 () {58 vars in 1236 bytes} [Sat Sep 24 05:03:40 2022] GET /compute/v2.1/servers/87dcedb5-91c7-4bc3-b46f-124ccffedf78 => generated 1509 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 05:03:41.564967 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-62cde94f-324a-4b97-b919-6c4a5bae11d9 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Calling method '>' {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:03:41.565691 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.compute.api [None req-62cde94f-324a-4b97-b919-6c4a5bae11d9 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] [instance: 87dcedb5-91c7-4bc3-b46f-124ccffedf78] Fetching instance by UUID {{(pid=120593) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:03:41.573145 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-62cde94f-324a-4b97-b919-6c4a5bae11d9 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:03:41.573679 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-62cde94f-324a-4b97-b919-6c4a5bae11d9 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:03:41.574142 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-62cde94f-324a-4b97-b919-6c4a5bae11d9 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:03:41.574874 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-62cde94f-324a-4b97-b919-6c4a5bae11d9 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:03:41.575258 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-62cde94f-324a-4b97-b919-6c4a5bae11d9 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:03:41.575678 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-62cde94f-324a-4b97-b919-6c4a5bae11d9 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:03:41.726113 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-62cde94f-324a-4b97-b919-6c4a5bae11d9 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cdd0da2c7bc4139bcd48ef36a2ee183', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a18a3756ba2b460d977f738a115ebfe0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:03:41.733907 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-62cde94f-324a-4b97-b919-6c4a5bae11d9 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] 10.222.0.50 "GET /compute/v2.1/servers/87dcedb5-91c7-4bc3-b46f-124ccffedf78" status: 200 len: 1509 microversion: 2.1 time: 0.174340 Sep 24 05:03:41.734632 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 208/447] 10.222.0.50 () {58 vars in 1236 bytes} [Sat Sep 24 05:03:41 2022] GET /compute/v2.1/servers/87dcedb5-91c7-4bc3-b46f-124ccffedf78 => generated 1509 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 05:03:42.759057 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-9121030a-3b6e-4b05-bfbb-f8a8725048f9 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Calling method '>' {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:03:42.759675 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.compute.api [None req-9121030a-3b6e-4b05-bfbb-f8a8725048f9 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] [instance: 87dcedb5-91c7-4bc3-b46f-124ccffedf78] Fetching instance by UUID {{(pid=120594) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:03:42.765925 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-9121030a-3b6e-4b05-bfbb-f8a8725048f9 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:03:42.766439 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-9121030a-3b6e-4b05-bfbb-f8a8725048f9 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:03:42.766954 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-9121030a-3b6e-4b05-bfbb-f8a8725048f9 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:03:42.767726 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-9121030a-3b6e-4b05-bfbb-f8a8725048f9 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:03:42.768438 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-9121030a-3b6e-4b05-bfbb-f8a8725048f9 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:03:42.768864 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-9121030a-3b6e-4b05-bfbb-f8a8725048f9 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:03:42.900260 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.policy [None req-9121030a-3b6e-4b05-bfbb-f8a8725048f9 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cdd0da2c7bc4139bcd48ef36a2ee183', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a18a3756ba2b460d977f738a115ebfe0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:03:42.908067 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [None req-9121030a-3b6e-4b05-bfbb-f8a8725048f9 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] 10.222.0.50 "GET /compute/v2.1/servers/87dcedb5-91c7-4bc3-b46f-124ccffedf78" status: 200 len: 1509 microversion: 2.1 time: 0.152814 Sep 24 05:03:42.908561 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 240/448] 10.222.0.50 () {58 vars in 1236 bytes} [Sat Sep 24 05:03:42 2022] GET /compute/v2.1/servers/87dcedb5-91c7-4bc3-b46f-124ccffedf78 => generated 1509 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 24 05:03:43.931304 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-2db9ce20-ca78-44f2-b142-98b770d98e6d tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Calling method '>' {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:03:43.931830 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.compute.api [None req-2db9ce20-ca78-44f2-b142-98b770d98e6d tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] [instance: 87dcedb5-91c7-4bc3-b46f-124ccffedf78] Fetching instance by UUID {{(pid=120593) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:03:43.938665 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-2db9ce20-ca78-44f2-b142-98b770d98e6d tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:03:43.939141 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-2db9ce20-ca78-44f2-b142-98b770d98e6d tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:03:43.939577 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-2db9ce20-ca78-44f2-b142-98b770d98e6d tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:03:43.940266 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-2db9ce20-ca78-44f2-b142-98b770d98e6d tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:03:43.940715 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-2db9ce20-ca78-44f2-b142-98b770d98e6d tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:03:43.941138 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-2db9ce20-ca78-44f2-b142-98b770d98e6d tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:03:44.090653 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-2db9ce20-ca78-44f2-b142-98b770d98e6d tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cdd0da2c7bc4139bcd48ef36a2ee183', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a18a3756ba2b460d977f738a115ebfe0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:03:44.098478 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-2db9ce20-ca78-44f2-b142-98b770d98e6d tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] 10.222.0.50 "GET /compute/v2.1/servers/87dcedb5-91c7-4bc3-b46f-124ccffedf78" status: 200 len: 1509 microversion: 2.1 time: 0.171053 Sep 24 05:03:44.099051 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 209/449] 10.222.0.50 () {58 vars in 1236 bytes} [Sat Sep 24 05:03:43 2022] GET /compute/v2.1/servers/87dcedb5-91c7-4bc3-b46f-124ccffedf78 => generated 1509 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 05:03:45.122309 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-c1d02c34-2753-44b2-a001-958aa6f2615a tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Calling method '>' {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:03:45.123069 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.compute.api [None req-c1d02c34-2753-44b2-a001-958aa6f2615a tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] [instance: 87dcedb5-91c7-4bc3-b46f-124ccffedf78] Fetching instance by UUID {{(pid=120594) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:03:45.130282 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-c1d02c34-2753-44b2-a001-958aa6f2615a tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:03:45.130905 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-c1d02c34-2753-44b2-a001-958aa6f2615a tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:03:45.131420 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-c1d02c34-2753-44b2-a001-958aa6f2615a tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:03:45.132115 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-c1d02c34-2753-44b2-a001-958aa6f2615a tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:03:45.132568 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-c1d02c34-2753-44b2-a001-958aa6f2615a tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:03:45.132991 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-c1d02c34-2753-44b2-a001-958aa6f2615a tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:03:45.286624 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.policy [None req-c1d02c34-2753-44b2-a001-958aa6f2615a tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cdd0da2c7bc4139bcd48ef36a2ee183', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a18a3756ba2b460d977f738a115ebfe0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:03:45.295233 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [None req-c1d02c34-2753-44b2-a001-958aa6f2615a tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] 10.222.0.50 "GET /compute/v2.1/servers/87dcedb5-91c7-4bc3-b46f-124ccffedf78" status: 200 len: 1509 microversion: 2.1 time: 0.176493 Sep 24 05:03:45.298345 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 241/450] 10.222.0.50 () {58 vars in 1236 bytes} [Sat Sep 24 05:03:45 2022] GET /compute/v2.1/servers/87dcedb5-91c7-4bc3-b46f-124ccffedf78 => generated 1509 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 05:03:46.319372 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-df6473fe-0501-4068-a9e4-df202f6ba576 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Calling method '>' {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:03:46.319984 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.compute.api [None req-df6473fe-0501-4068-a9e4-df202f6ba576 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] [instance: 87dcedb5-91c7-4bc3-b46f-124ccffedf78] Fetching instance by UUID {{(pid=120593) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:03:46.326262 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-df6473fe-0501-4068-a9e4-df202f6ba576 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:03:46.326741 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-df6473fe-0501-4068-a9e4-df202f6ba576 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:03:46.327171 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-df6473fe-0501-4068-a9e4-df202f6ba576 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:03:46.327860 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-df6473fe-0501-4068-a9e4-df202f6ba576 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:03:46.328310 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-df6473fe-0501-4068-a9e4-df202f6ba576 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:03:46.329319 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-df6473fe-0501-4068-a9e4-df202f6ba576 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:03:46.462050 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-df6473fe-0501-4068-a9e4-df202f6ba576 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cdd0da2c7bc4139bcd48ef36a2ee183', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a18a3756ba2b460d977f738a115ebfe0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:03:46.471051 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-df6473fe-0501-4068-a9e4-df202f6ba576 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] 10.222.0.50 "GET /compute/v2.1/servers/87dcedb5-91c7-4bc3-b46f-124ccffedf78" status: 200 len: 1515 microversion: 2.1 time: 0.155317 Sep 24 05:03:46.471708 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 210/451] 10.222.0.50 () {58 vars in 1236 bytes} [Sat Sep 24 05:03:46 2022] GET /compute/v2.1/servers/87dcedb5-91c7-4bc3-b46f-124ccffedf78 => generated 1515 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 05:03:53.080490 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-f9c31aec-bdc2-440f-a40a-c5a70e99433c tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Action: 'create', calling method: .version_select at 0x7f79508c6670>, body: {"keypair": {"name": "tempest-keypair-859445215", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBL4VIWPh08jzkxEUxvXu2GUcM7dAO4Yqc7+dYHEUsr1UTFV4+h6noM7VxfXYDeIJvBjt6Ce1bJWj/6Trf8S8/GYbirvojUMdNqn7qtbexQXCl6UMJXFJvgp/uKHmXsNVHg=="}} {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 05:03:53.100972 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.quota [None req-f9c31aec-bdc2-440f-a40a-c5a70e99433c tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Getting quotas for project a18a3756ba2b460d977f738a115ebfe0. Resources: {'key_pairs'} {{(pid=120594) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 24 05:03:53.106113 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.quota [None req-f9c31aec-bdc2-440f-a40a-c5a70e99433c tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Getting quotas for user 8cdd0da2c7bc4139bcd48ef36a2ee183 and project a18a3756ba2b460d977f738a115ebfe0. Resources: {'key_pairs'} {{(pid=120594) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 24 05:03:53.149558 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [None req-f9c31aec-bdc2-440f-a40a-c5a70e99433c tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] 10.222.0.50 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.073476 Sep 24 05:03:53.151500 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 242/452] 10.222.0.50 () {60 vars in 1159 bytes} [Sat Sep 24 05:03:53 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 05:03:54.700667 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-a5c36364-f46c-4f79-b7c1-3780a644d5b1 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-759884751", "imageRef": "75ab730a-d8cc-4ea2-b58f-0f3eb476c976", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "002f39b7-19b2-4fdf-9ca2-a023fea0b5dc"}], "security_groups": [{"name": "tempest-securitygroup--230784186"}], "key_name": "tempest-keypair-859445215", "user_data": "}} {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 05:03:54.825094 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.network.neutron [None req-a5c36364-f46c-4f79-b7c1-3780a644d5b1 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] validate_networks() for [('002f39b7-19b2-4fdf-9ca2-a023fea0b5dc', None, None, None, None, None)] {{(pid=120593) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 24 05:03:55.251612 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.virt.hardware [None req-a5c36364-f46c-4f79-b7c1-3780a644d5b1 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Flavor limits 0:0:0 {{(pid=120593) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 24 05:03:55.252035 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.virt.hardware [None req-a5c36364-f46c-4f79-b7c1-3780a644d5b1 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Image limits 0:0:0 {{(pid=120593) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 24 05:03:55.252508 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.virt.hardware [None req-a5c36364-f46c-4f79-b7c1-3780a644d5b1 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Flavor pref 0:0:0 {{(pid=120593) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 24 05:03:55.253028 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.virt.hardware [None req-a5c36364-f46c-4f79-b7c1-3780a644d5b1 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Image pref 0:0:0 {{(pid=120593) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 24 05:03:55.253467 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.virt.hardware [None req-a5c36364-f46c-4f79-b7c1-3780a644d5b1 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120593) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 24 05:03:55.262290 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-a5c36364-f46c-4f79-b7c1-3780a644d5b1 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:03:55.262773 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-a5c36364-f46c-4f79-b7c1-3780a644d5b1 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:03:55.263206 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-a5c36364-f46c-4f79-b7c1-3780a644d5b1 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:03:55.263929 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-a5c36364-f46c-4f79-b7c1-3780a644d5b1 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:03:55.264572 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-a5c36364-f46c-4f79-b7c1-3780a644d5b1 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:03:55.264997 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-a5c36364-f46c-4f79-b7c1-3780a644d5b1 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:03:55.282394 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.quota [None req-a5c36364-f46c-4f79-b7c1-3780a644d5b1 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Getting quotas for project a18a3756ba2b460d977f738a115ebfe0. Resources: {'instances', 'ram', 'cores'} {{(pid=120593) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 24 05:03:55.286385 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.quota [None req-a5c36364-f46c-4f79-b7c1-3780a644d5b1 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Getting quotas for user 8cdd0da2c7bc4139bcd48ef36a2ee183 and project a18a3756ba2b460d977f738a115ebfe0. Resources: {'instances', 'ram', 'cores'} {{(pid=120593) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 24 05:03:55.297656 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.compute.api [None req-a5c36364-f46c-4f79-b7c1-3780a644d5b1 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Going to run 1 instances... {{(pid=120593) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 24 05:03:55.300003 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.compute.api [None req-a5c36364-f46c-4f79-b7c1-3780a644d5b1 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] [instance: 3e1c080b-492d-4c55-880a-14e89c938fce] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='75ab730a-d8cc-4ea2-b58f-0f3eb476c976',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120593) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 24 05:03:55.349131 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-a5c36364-f46c-4f79-b7c1-3780a644d5b1 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 202 len: 408 microversion: 2.1 time: 0.652765 Sep 24 05:03:55.349770 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 211/453] 10.222.0.50 () {60 vars in 1147 bytes} [Sat Sep 24 05:03:54 2022] POST /compute/v2.1/servers => generated 408 bytes in 654 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 24 05:03:55.357755 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG dbcounter [-] [120594] Writing DB stats nova_cell1:SELECT=68 {{(pid=120594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 05:03:55.362930 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-d15b75be-c535-4eb9-8e44-a083292a03a4 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Calling method '>' {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:03:55.363546 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.compute.api [None req-d15b75be-c535-4eb9-8e44-a083292a03a4 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] [instance: 3e1c080b-492d-4c55-880a-14e89c938fce] Fetching instance by UUID {{(pid=120594) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:03:55.420433 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.policy [None req-d15b75be-c535-4eb9-8e44-a083292a03a4 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cdd0da2c7bc4139bcd48ef36a2ee183', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a18a3756ba2b460d977f738a115ebfe0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:03:55.428377 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [None req-d15b75be-c535-4eb9-8e44-a083292a03a4 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] 10.222.0.50 "GET /compute/v2.1/servers/3e1c080b-492d-4c55-880a-14e89c938fce" status: 200 len: 1244 microversion: 2.1 time: 0.071334 Sep 24 05:03:55.429689 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 243/454] 10.222.0.50 () {58 vars in 1236 bytes} [Sat Sep 24 05:03:55 2022] GET /compute/v2.1/servers/3e1c080b-492d-4c55-880a-14e89c938fce => generated 1244 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 24 05:03:56.452175 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-a3647dc1-9ae3-4925-9e6b-237d1cd5b2f8 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Calling method '>' {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:03:56.452815 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.compute.api [None req-a3647dc1-9ae3-4925-9e6b-237d1cd5b2f8 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] [instance: 3e1c080b-492d-4c55-880a-14e89c938fce] Fetching instance by UUID {{(pid=120593) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:03:56.458903 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-a3647dc1-9ae3-4925-9e6b-237d1cd5b2f8 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:03:56.459377 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-a3647dc1-9ae3-4925-9e6b-237d1cd5b2f8 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:03:56.459815 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-a3647dc1-9ae3-4925-9e6b-237d1cd5b2f8 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:03:56.460527 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-a3647dc1-9ae3-4925-9e6b-237d1cd5b2f8 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:03:56.460975 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-a3647dc1-9ae3-4925-9e6b-237d1cd5b2f8 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:03:56.461394 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-a3647dc1-9ae3-4925-9e6b-237d1cd5b2f8 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:03:56.521881 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-a3647dc1-9ae3-4925-9e6b-237d1cd5b2f8 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cdd0da2c7bc4139bcd48ef36a2ee183', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a18a3756ba2b460d977f738a115ebfe0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:03:56.529303 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-a3647dc1-9ae3-4925-9e6b-237d1cd5b2f8 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] 10.222.0.50 "GET /compute/v2.1/servers/3e1c080b-492d-4c55-880a-14e89c938fce" status: 200 len: 1240 microversion: 2.1 time: 0.081499 Sep 24 05:03:56.529865 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 212/455] 10.222.0.50 () {58 vars in 1236 bytes} [Sat Sep 24 05:03:56 2022] GET /compute/v2.1/servers/3e1c080b-492d-4c55-880a-14e89c938fce => generated 1240 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 05:03:57.552992 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-d8dbbba7-f74e-49fb-8b9c-efacf0e8bcbf tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Calling method '>' {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:03:57.554250 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.compute.api [None req-d8dbbba7-f74e-49fb-8b9c-efacf0e8bcbf tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] [instance: 3e1c080b-492d-4c55-880a-14e89c938fce] Fetching instance by UUID {{(pid=120594) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:03:57.560355 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-d8dbbba7-f74e-49fb-8b9c-efacf0e8bcbf tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:03:57.560844 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-d8dbbba7-f74e-49fb-8b9c-efacf0e8bcbf tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:03:57.561916 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-d8dbbba7-f74e-49fb-8b9c-efacf0e8bcbf tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:03:57.562679 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-d8dbbba7-f74e-49fb-8b9c-efacf0e8bcbf tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:03:57.563682 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-d8dbbba7-f74e-49fb-8b9c-efacf0e8bcbf tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:03:57.564134 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-d8dbbba7-f74e-49fb-8b9c-efacf0e8bcbf tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:03:57.628469 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.policy [None req-d8dbbba7-f74e-49fb-8b9c-efacf0e8bcbf tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cdd0da2c7bc4139bcd48ef36a2ee183', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a18a3756ba2b460d977f738a115ebfe0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:03:57.645000 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [None req-d8dbbba7-f74e-49fb-8b9c-efacf0e8bcbf tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] 10.222.0.50 "GET /compute/v2.1/servers/3e1c080b-492d-4c55-880a-14e89c938fce" status: 200 len: 1240 microversion: 2.1 time: 0.096002 Sep 24 05:03:57.650488 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 244/456] 10.222.0.50 () {58 vars in 1236 bytes} [Sat Sep 24 05:03:57 2022] GET /compute/v2.1/servers/3e1c080b-492d-4c55-880a-14e89c938fce => generated 1240 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 05:03:58.669040 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-6216f61e-2a0e-4168-a33d-28ece04c0cd6 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Calling method '>' {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:03:58.669651 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.compute.api [None req-6216f61e-2a0e-4168-a33d-28ece04c0cd6 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] [instance: 3e1c080b-492d-4c55-880a-14e89c938fce] Fetching instance by UUID {{(pid=120593) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:03:58.676649 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-6216f61e-2a0e-4168-a33d-28ece04c0cd6 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:03:58.677132 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-6216f61e-2a0e-4168-a33d-28ece04c0cd6 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:03:58.677568 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-6216f61e-2a0e-4168-a33d-28ece04c0cd6 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:03:58.678450 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-6216f61e-2a0e-4168-a33d-28ece04c0cd6 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:03:58.678901 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-6216f61e-2a0e-4168-a33d-28ece04c0cd6 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:03:58.679344 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-6216f61e-2a0e-4168-a33d-28ece04c0cd6 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:03:58.743610 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-6216f61e-2a0e-4168-a33d-28ece04c0cd6 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cdd0da2c7bc4139bcd48ef36a2ee183', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a18a3756ba2b460d977f738a115ebfe0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:03:58.752654 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-6216f61e-2a0e-4168-a33d-28ece04c0cd6 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] 10.222.0.50 "GET /compute/v2.1/servers/3e1c080b-492d-4c55-880a-14e89c938fce" status: 200 len: 1302 microversion: 2.1 time: 0.088172 Sep 24 05:03:58.753231 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 213/457] 10.222.0.50 () {58 vars in 1236 bytes} [Sat Sep 24 05:03:58 2022] GET /compute/v2.1/servers/3e1c080b-492d-4c55-880a-14e89c938fce => generated 1302 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 05:03:59.775271 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-9d1e749e-7aaf-485a-8272-43d36f5ca201 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Calling method '>' {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:03:59.775878 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.compute.api [None req-9d1e749e-7aaf-485a-8272-43d36f5ca201 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] [instance: 3e1c080b-492d-4c55-880a-14e89c938fce] Fetching instance by UUID {{(pid=120594) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:03:59.782321 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-9d1e749e-7aaf-485a-8272-43d36f5ca201 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:03:59.782804 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-9d1e749e-7aaf-485a-8272-43d36f5ca201 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:03:59.783241 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-9d1e749e-7aaf-485a-8272-43d36f5ca201 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:03:59.783929 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-9d1e749e-7aaf-485a-8272-43d36f5ca201 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:03:59.784379 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-9d1e749e-7aaf-485a-8272-43d36f5ca201 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:03:59.784801 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-9d1e749e-7aaf-485a-8272-43d36f5ca201 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:03:59.918145 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.policy [None req-9d1e749e-7aaf-485a-8272-43d36f5ca201 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cdd0da2c7bc4139bcd48ef36a2ee183', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a18a3756ba2b460d977f738a115ebfe0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:03:59.926265 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [req-6e678e03-a5dd-4fcf-87d8-618f8cdb0827 req-a7ff6475-c04d-4141-b434-1c1caa6771ed service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3e1c080b-492d-4c55-880a-14e89c938fce", "tag": "a8325a52-865f-4aa2-a4eb-6cb94768def7"}]} {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 05:03:59.927599 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [None req-9d1e749e-7aaf-485a-8272-43d36f5ca201 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] 10.222.0.50 "GET /compute/v2.1/servers/3e1c080b-492d-4c55-880a-14e89c938fce" status: 200 len: 1369 microversion: 2.1 time: 0.156257 Sep 24 05:03:59.932488 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 245/458] 10.222.0.50 () {58 vars in 1236 bytes} [Sat Sep 24 05:03:59 2022] GET /compute/v2.1/servers/3e1c080b-492d-4c55-880a-14e89c938fce => generated 1369 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 05:03:59.938707 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [req-6e678e03-a5dd-4fcf-87d8-618f8cdb0827 req-a7ff6475-c04d-4141-b434-1c1caa6771ed service nova] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:03:59.939374 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [req-6e678e03-a5dd-4fcf-87d8-618f8cdb0827 req-a7ff6475-c04d-4141-b434-1c1caa6771ed service nova] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:03:59.939974 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [req-6e678e03-a5dd-4fcf-87d8-618f8cdb0827 req-a7ff6475-c04d-4141-b434-1c1caa6771ed service nova] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:03:59.952634 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.compute.server_external_events [req-6e678e03-a5dd-4fcf-87d8-618f8cdb0827 req-a7ff6475-c04d-4141-b434-1c1caa6771ed service nova] Creating event network-changed:a8325a52-865f-4aa2-a4eb-6cb94768def7 for instance 3e1c080b-492d-4c55-880a-14e89c938fce on hv-cinder-85918 Sep 24 05:03:59.957800 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [req-6e678e03-a5dd-4fcf-87d8-618f8cdb0827 req-a7ff6475-c04d-4141-b434-1c1caa6771ed service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046381 Sep 24 05:03:59.958628 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 214/459] 10.222.0.50 () {64 vars in 1317 bytes} [Sat Sep 24 05:03:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 05:04:00.951673 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-4d63220b-ac70-4257-9313-d632baab62a3 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Calling method '>' {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:04:00.952189 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.compute.api [None req-4d63220b-ac70-4257-9313-d632baab62a3 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] [instance: 3e1c080b-492d-4c55-880a-14e89c938fce] Fetching instance by UUID {{(pid=120594) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:04:00.958624 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-4d63220b-ac70-4257-9313-d632baab62a3 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:04:00.959104 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-4d63220b-ac70-4257-9313-d632baab62a3 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:04:00.959543 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-4d63220b-ac70-4257-9313-d632baab62a3 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:04:00.960228 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-4d63220b-ac70-4257-9313-d632baab62a3 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:04:00.960679 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-4d63220b-ac70-4257-9313-d632baab62a3 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:04:00.961101 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-4d63220b-ac70-4257-9313-d632baab62a3 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:04:01.086186 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.policy [None req-4d63220b-ac70-4257-9313-d632baab62a3 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cdd0da2c7bc4139bcd48ef36a2ee183', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a18a3756ba2b460d977f738a115ebfe0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:04:01.093628 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [None req-4d63220b-ac70-4257-9313-d632baab62a3 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] 10.222.0.50 "GET /compute/v2.1/servers/3e1c080b-492d-4c55-880a-14e89c938fce" status: 200 len: 1369 microversion: 2.1 time: 0.145906 Sep 24 05:04:01.094214 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 246/460] 10.222.0.50 () {58 vars in 1236 bytes} [Sat Sep 24 05:04:00 2022] GET /compute/v2.1/servers/3e1c080b-492d-4c55-880a-14e89c938fce => generated 1369 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 05:04:02.116851 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-add4d59b-606e-424a-92c4-2d2bd4d24649 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Calling method '>' {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:04:02.117552 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.compute.api [None req-add4d59b-606e-424a-92c4-2d2bd4d24649 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] [instance: 3e1c080b-492d-4c55-880a-14e89c938fce] Fetching instance by UUID {{(pid=120593) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:04:02.123654 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-add4d59b-606e-424a-92c4-2d2bd4d24649 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:04:02.124138 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-add4d59b-606e-424a-92c4-2d2bd4d24649 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:04:02.124577 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-add4d59b-606e-424a-92c4-2d2bd4d24649 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:04:02.125791 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-add4d59b-606e-424a-92c4-2d2bd4d24649 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:04:02.126263 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-add4d59b-606e-424a-92c4-2d2bd4d24649 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:04:02.126686 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-add4d59b-606e-424a-92c4-2d2bd4d24649 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:04:02.456058 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-add4d59b-606e-424a-92c4-2d2bd4d24649 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cdd0da2c7bc4139bcd48ef36a2ee183', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a18a3756ba2b460d977f738a115ebfe0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:04:02.463693 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-add4d59b-606e-424a-92c4-2d2bd4d24649 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] 10.222.0.50 "GET /compute/v2.1/servers/3e1c080b-492d-4c55-880a-14e89c938fce" status: 200 len: 1369 microversion: 2.1 time: 0.351525 Sep 24 05:04:02.464254 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 215/461] 10.222.0.50 () {58 vars in 1236 bytes} [Sat Sep 24 05:04:02 2022] GET /compute/v2.1/servers/3e1c080b-492d-4c55-880a-14e89c938fce => generated 1369 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 05:04:03.486559 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-c4214089-b6e1-4c30-ac4e-0ec0fc6df1a2 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Calling method '>' {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:04:03.487169 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.compute.api [None req-c4214089-b6e1-4c30-ac4e-0ec0fc6df1a2 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] [instance: 3e1c080b-492d-4c55-880a-14e89c938fce] Fetching instance by UUID {{(pid=120594) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:04:03.493044 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-c4214089-b6e1-4c30-ac4e-0ec0fc6df1a2 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:04:03.493530 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-c4214089-b6e1-4c30-ac4e-0ec0fc6df1a2 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:04:03.493966 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-c4214089-b6e1-4c30-ac4e-0ec0fc6df1a2 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:04:03.494679 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-c4214089-b6e1-4c30-ac4e-0ec0fc6df1a2 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:04:03.495129 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-c4214089-b6e1-4c30-ac4e-0ec0fc6df1a2 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:04:03.495554 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-c4214089-b6e1-4c30-ac4e-0ec0fc6df1a2 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:04:03.620278 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.policy [None req-c4214089-b6e1-4c30-ac4e-0ec0fc6df1a2 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cdd0da2c7bc4139bcd48ef36a2ee183', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a18a3756ba2b460d977f738a115ebfe0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:04:03.627948 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [None req-c4214089-b6e1-4c30-ac4e-0ec0fc6df1a2 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] 10.222.0.50 "GET /compute/v2.1/servers/3e1c080b-492d-4c55-880a-14e89c938fce" status: 200 len: 1369 microversion: 2.1 time: 0.145890 Sep 24 05:04:03.628509 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 247/462] 10.222.0.50 () {58 vars in 1236 bytes} [Sat Sep 24 05:04:03 2022] GET /compute/v2.1/servers/3e1c080b-492d-4c55-880a-14e89c938fce => generated 1369 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 05:04:04.650666 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-ff9adc13-cdc7-4f27-b0c6-f75329a1eb1e tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Calling method '>' {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:04:04.651264 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.compute.api [None req-ff9adc13-cdc7-4f27-b0c6-f75329a1eb1e tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] [instance: 3e1c080b-492d-4c55-880a-14e89c938fce] Fetching instance by UUID {{(pid=120593) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:04:04.659036 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-ff9adc13-cdc7-4f27-b0c6-f75329a1eb1e tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:04:04.659701 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-ff9adc13-cdc7-4f27-b0c6-f75329a1eb1e tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:04:04.660428 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-ff9adc13-cdc7-4f27-b0c6-f75329a1eb1e tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:04:04.661118 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-ff9adc13-cdc7-4f27-b0c6-f75329a1eb1e tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:04:04.661710 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-ff9adc13-cdc7-4f27-b0c6-f75329a1eb1e tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:04:04.662276 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-ff9adc13-cdc7-4f27-b0c6-f75329a1eb1e tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:04:04.791868 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-ff9adc13-cdc7-4f27-b0c6-f75329a1eb1e tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cdd0da2c7bc4139bcd48ef36a2ee183', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a18a3756ba2b460d977f738a115ebfe0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:04:04.799482 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-ff9adc13-cdc7-4f27-b0c6-f75329a1eb1e tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] 10.222.0.50 "GET /compute/v2.1/servers/3e1c080b-492d-4c55-880a-14e89c938fce" status: 200 len: 1369 microversion: 2.1 time: 0.152699 Sep 24 05:04:04.800053 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 216/463] 10.222.0.50 () {58 vars in 1236 bytes} [Sat Sep 24 05:04:04 2022] GET /compute/v2.1/servers/3e1c080b-492d-4c55-880a-14e89c938fce => generated 1369 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 05:04:05.822570 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-2cc18eb8-ec85-433a-a42d-14fca637f1f9 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Calling method '>' {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:04:05.823168 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.compute.api [None req-2cc18eb8-ec85-433a-a42d-14fca637f1f9 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] [instance: 3e1c080b-492d-4c55-880a-14e89c938fce] Fetching instance by UUID {{(pid=120594) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:04:05.825037 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG dbcounter [-] [120594] Writing DB stats nova_cell0:SELECT=6 {{(pid=120594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 05:04:05.831290 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-2cc18eb8-ec85-433a-a42d-14fca637f1f9 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:04:05.831773 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-2cc18eb8-ec85-433a-a42d-14fca637f1f9 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:04:05.832209 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-2cc18eb8-ec85-433a-a42d-14fca637f1f9 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:04:05.832896 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-2cc18eb8-ec85-433a-a42d-14fca637f1f9 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:04:05.833347 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-2cc18eb8-ec85-433a-a42d-14fca637f1f9 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:04:05.833773 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-2cc18eb8-ec85-433a-a42d-14fca637f1f9 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:04:05.963188 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.policy [None req-2cc18eb8-ec85-433a-a42d-14fca637f1f9 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cdd0da2c7bc4139bcd48ef36a2ee183', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a18a3756ba2b460d977f738a115ebfe0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:04:05.971288 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [None req-2cc18eb8-ec85-433a-a42d-14fca637f1f9 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] 10.222.0.50 "GET /compute/v2.1/servers/3e1c080b-492d-4c55-880a-14e89c938fce" status: 200 len: 1369 microversion: 2.1 time: 0.152592 Sep 24 05:04:05.971852 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 248/464] 10.222.0.50 () {58 vars in 1236 bytes} [Sat Sep 24 05:04:05 2022] GET /compute/v2.1/servers/3e1c080b-492d-4c55-880a-14e89c938fce => generated 1369 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 05:04:06.994192 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-28f85a9e-380d-4a90-ad37-d28230223739 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Calling method '>' {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:04:06.994866 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.compute.api [None req-28f85a9e-380d-4a90-ad37-d28230223739 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] [instance: 3e1c080b-492d-4c55-880a-14e89c938fce] Fetching instance by UUID {{(pid=120593) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:04:06.996843 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG dbcounter [-] [120593] Writing DB stats nova_cell0:SELECT=2 {{(pid=120593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 05:04:06.997483 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG dbcounter [-] [120593] Writing DB stats nova_cell0:SELECT=6 {{(pid=120593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 05:04:06.998583 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG dbcounter [-] [120593] Writing DB stats nova_api:SELECT=39,nova_api:INSERT=3 {{(pid=120593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 05:04:07.005741 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-28f85a9e-380d-4a90-ad37-d28230223739 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:04:07.006265 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-28f85a9e-380d-4a90-ad37-d28230223739 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:04:07.006701 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-28f85a9e-380d-4a90-ad37-d28230223739 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:04:07.007387 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-28f85a9e-380d-4a90-ad37-d28230223739 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:04:07.007827 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-28f85a9e-380d-4a90-ad37-d28230223739 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:04:07.008246 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-28f85a9e-380d-4a90-ad37-d28230223739 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:04:07.175371 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-28f85a9e-380d-4a90-ad37-d28230223739 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cdd0da2c7bc4139bcd48ef36a2ee183', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a18a3756ba2b460d977f738a115ebfe0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:04:07.184792 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-28f85a9e-380d-4a90-ad37-d28230223739 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] 10.222.0.50 "GET /compute/v2.1/servers/3e1c080b-492d-4c55-880a-14e89c938fce" status: 200 len: 1369 microversion: 2.1 time: 0.193691 Sep 24 05:04:07.185546 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 217/465] 10.222.0.50 () {58 vars in 1236 bytes} [Sat Sep 24 05:04:06 2022] GET /compute/v2.1/servers/3e1c080b-492d-4c55-880a-14e89c938fce => generated 1369 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 05:04:08.207578 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-f6dfaabe-7453-40cd-bde8-2324573e4f35 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Calling method '>' {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:04:08.208187 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.compute.api [None req-f6dfaabe-7453-40cd-bde8-2324573e4f35 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] [instance: 3e1c080b-492d-4c55-880a-14e89c938fce] Fetching instance by UUID {{(pid=120594) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:04:08.210101 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG dbcounter [-] [120594] Writing DB stats nova_api:SELECT=37,nova_api:INSERT=1 {{(pid=120594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 05:04:08.215460 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-f6dfaabe-7453-40cd-bde8-2324573e4f35 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:04:08.215933 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-f6dfaabe-7453-40cd-bde8-2324573e4f35 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:04:08.216362 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-f6dfaabe-7453-40cd-bde8-2324573e4f35 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:04:08.217045 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-f6dfaabe-7453-40cd-bde8-2324573e4f35 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:04:08.217616 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-f6dfaabe-7453-40cd-bde8-2324573e4f35 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:04:08.218059 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-f6dfaabe-7453-40cd-bde8-2324573e4f35 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:04:08.363464 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.policy [None req-f6dfaabe-7453-40cd-bde8-2324573e4f35 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cdd0da2c7bc4139bcd48ef36a2ee183', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a18a3756ba2b460d977f738a115ebfe0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:04:08.371298 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [None req-f6dfaabe-7453-40cd-bde8-2324573e4f35 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] 10.222.0.50 "GET /compute/v2.1/servers/3e1c080b-492d-4c55-880a-14e89c938fce" status: 200 len: 1369 microversion: 2.1 time: 0.167512 Sep 24 05:04:08.371865 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 249/466] 10.222.0.50 () {58 vars in 1236 bytes} [Sat Sep 24 05:04:08 2022] GET /compute/v2.1/servers/3e1c080b-492d-4c55-880a-14e89c938fce => generated 1369 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 05:04:09.402813 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-d8276b2f-4fe5-4e4c-9781-df8e64c3f4f2 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Calling method '>' {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:04:09.404070 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.compute.api [None req-d8276b2f-4fe5-4e4c-9781-df8e64c3f4f2 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] [instance: 3e1c080b-492d-4c55-880a-14e89c938fce] Fetching instance by UUID {{(pid=120593) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:04:09.425219 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-d8276b2f-4fe5-4e4c-9781-df8e64c3f4f2 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:04:09.426032 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-d8276b2f-4fe5-4e4c-9781-df8e64c3f4f2 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:04:09.427276 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-d8276b2f-4fe5-4e4c-9781-df8e64c3f4f2 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:04:09.428237 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-d8276b2f-4fe5-4e4c-9781-df8e64c3f4f2 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:04:09.428904 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-d8276b2f-4fe5-4e4c-9781-df8e64c3f4f2 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:04:09.429546 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-d8276b2f-4fe5-4e4c-9781-df8e64c3f4f2 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:04:09.616456 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-d8276b2f-4fe5-4e4c-9781-df8e64c3f4f2 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cdd0da2c7bc4139bcd48ef36a2ee183', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a18a3756ba2b460d977f738a115ebfe0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:04:09.625044 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-d8276b2f-4fe5-4e4c-9781-df8e64c3f4f2 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] 10.222.0.50 "GET /compute/v2.1/servers/3e1c080b-492d-4c55-880a-14e89c938fce" status: 200 len: 1369 microversion: 2.1 time: 0.234321 Sep 24 05:04:09.625889 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 218/467] 10.222.0.50 () {58 vars in 1236 bytes} [Sat Sep 24 05:04:09 2022] GET /compute/v2.1/servers/3e1c080b-492d-4c55-880a-14e89c938fce => generated 1369 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 05:04:10.652760 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-9202beb7-4960-4078-8723-f690f54bd4af tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Calling method '>' {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:04:10.657860 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.compute.api [None req-9202beb7-4960-4078-8723-f690f54bd4af tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] [instance: 3e1c080b-492d-4c55-880a-14e89c938fce] Fetching instance by UUID {{(pid=120594) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:04:10.670173 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-9202beb7-4960-4078-8723-f690f54bd4af tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:04:10.670778 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-9202beb7-4960-4078-8723-f690f54bd4af tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:04:10.671310 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-9202beb7-4960-4078-8723-f690f54bd4af tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:04:10.672108 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-9202beb7-4960-4078-8723-f690f54bd4af tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:04:10.672621 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-9202beb7-4960-4078-8723-f690f54bd4af tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:04:10.673108 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-9202beb7-4960-4078-8723-f690f54bd4af tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:04:10.833645 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.policy [None req-9202beb7-4960-4078-8723-f690f54bd4af tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cdd0da2c7bc4139bcd48ef36a2ee183', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a18a3756ba2b460d977f738a115ebfe0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:04:10.841848 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [None req-9202beb7-4960-4078-8723-f690f54bd4af tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] 10.222.0.50 "GET /compute/v2.1/servers/3e1c080b-492d-4c55-880a-14e89c938fce" status: 200 len: 1369 microversion: 2.1 time: 0.194426 Sep 24 05:04:10.842565 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 250/468] 10.222.0.50 () {58 vars in 1236 bytes} [Sat Sep 24 05:04:10 2022] GET /compute/v2.1/servers/3e1c080b-492d-4c55-880a-14e89c938fce => generated 1369 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 24 05:04:11.867599 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-c792ef61-7d04-4b85-8ba2-4ed853f91f60 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Calling method '>' {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:04:11.868209 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.compute.api [None req-c792ef61-7d04-4b85-8ba2-4ed853f91f60 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] [instance: 3e1c080b-492d-4c55-880a-14e89c938fce] Fetching instance by UUID {{(pid=120593) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:04:11.871131 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 24 05:04:11.871441 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: Sat Sep 24 05:04:11 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/3e1c080b-492d-4c55-880a-14e89c938fce (ip 10.222.0.50) !!! Sep 24 05:04:11.880514 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-c792ef61-7d04-4b85-8ba2-4ed853f91f60 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:04:11.880983 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-c792ef61-7d04-4b85-8ba2-4ed853f91f60 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:04:11.881416 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-c792ef61-7d04-4b85-8ba2-4ed853f91f60 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:04:11.882138 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-c792ef61-7d04-4b85-8ba2-4ed853f91f60 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:04:11.882591 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-c792ef61-7d04-4b85-8ba2-4ed853f91f60 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:04:11.883014 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-c792ef61-7d04-4b85-8ba2-4ed853f91f60 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:04:11.888025 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG dbcounter [-] [120593] Writing DB stats nova_cell1:SELECT=59 {{(pid=120593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 05:04:12.070448 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-c792ef61-7d04-4b85-8ba2-4ed853f91f60 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cdd0da2c7bc4139bcd48ef36a2ee183', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a18a3756ba2b460d977f738a115ebfe0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:04:12.079978 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-c792ef61-7d04-4b85-8ba2-4ed853f91f60 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] 10.222.0.50 "GET /compute/v2.1/servers/3e1c080b-492d-4c55-880a-14e89c938fce" status: 200 len: 1369 microversion: 2.1 time: 0.216168 Sep 24 05:04:12.096936 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 219/469] 10.222.0.50 () {58 vars in 1236 bytes} [Sat Sep 24 05:04:11 2022] GET /compute/v2.1/servers/3e1c080b-492d-4c55-880a-14e89c938fce => generated 1369 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 05:04:13.106061 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-7536cba7-ae2d-457b-a053-81a6791fd969 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Calling method '>' {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:04:13.106663 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.compute.api [None req-7536cba7-ae2d-457b-a053-81a6791fd969 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] [instance: 3e1c080b-492d-4c55-880a-14e89c938fce] Fetching instance by UUID {{(pid=120594) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:04:13.113141 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-7536cba7-ae2d-457b-a053-81a6791fd969 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:04:13.113633 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-7536cba7-ae2d-457b-a053-81a6791fd969 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:04:13.114154 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-7536cba7-ae2d-457b-a053-81a6791fd969 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:04:13.114849 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-7536cba7-ae2d-457b-a053-81a6791fd969 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:04:13.115496 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-7536cba7-ae2d-457b-a053-81a6791fd969 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:04:13.115916 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-7536cba7-ae2d-457b-a053-81a6791fd969 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:04:13.339475 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.policy [None req-7536cba7-ae2d-457b-a053-81a6791fd969 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cdd0da2c7bc4139bcd48ef36a2ee183', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a18a3756ba2b460d977f738a115ebfe0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:04:13.347194 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [None req-7536cba7-ae2d-457b-a053-81a6791fd969 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] 10.222.0.50 "GET /compute/v2.1/servers/3e1c080b-492d-4c55-880a-14e89c938fce" status: 200 len: 1369 microversion: 2.1 time: 0.244992 Sep 24 05:04:13.348000 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 251/470] 10.222.0.50 () {58 vars in 1236 bytes} [Sat Sep 24 05:04:13 2022] GET /compute/v2.1/servers/3e1c080b-492d-4c55-880a-14e89c938fce => generated 1369 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 05:04:14.369862 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-b46874b4-8bf3-4de4-812b-3bff5cb4a0b2 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Calling method '>' {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:04:14.370518 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.compute.api [None req-b46874b4-8bf3-4de4-812b-3bff5cb4a0b2 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] [instance: 3e1c080b-492d-4c55-880a-14e89c938fce] Fetching instance by UUID {{(pid=120593) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:04:14.379864 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-b46874b4-8bf3-4de4-812b-3bff5cb4a0b2 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:04:14.380606 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-b46874b4-8bf3-4de4-812b-3bff5cb4a0b2 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:04:14.381222 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-b46874b4-8bf3-4de4-812b-3bff5cb4a0b2 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:04:14.382876 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-b46874b4-8bf3-4de4-812b-3bff5cb4a0b2 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:04:14.383501 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-b46874b4-8bf3-4de4-812b-3bff5cb4a0b2 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:04:14.384668 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-b46874b4-8bf3-4de4-812b-3bff5cb4a0b2 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:04:14.661879 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-b46874b4-8bf3-4de4-812b-3bff5cb4a0b2 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cdd0da2c7bc4139bcd48ef36a2ee183', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a18a3756ba2b460d977f738a115ebfe0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:04:14.671464 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-b46874b4-8bf3-4de4-812b-3bff5cb4a0b2 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] 10.222.0.50 "GET /compute/v2.1/servers/3e1c080b-492d-4c55-880a-14e89c938fce" status: 200 len: 1369 microversion: 2.1 time: 0.305420 Sep 24 05:04:14.673845 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 220/471] 10.222.0.50 () {58 vars in 1236 bytes} [Sat Sep 24 05:04:14 2022] GET /compute/v2.1/servers/3e1c080b-492d-4c55-880a-14e89c938fce => generated 1369 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 05:04:15.532798 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [req-0a6f22ef-1374-498a-aacd-c66ebf0c1530 req-ea290183-a21c-47a8-b09a-92e56e9bef51 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3e1c080b-492d-4c55-880a-14e89c938fce", "name": "network-vif-plugged", "status": "completed", "tag": "a8325a52-865f-4aa2-a4eb-6cb94768def7"}]} {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 05:04:15.542792 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [req-0a6f22ef-1374-498a-aacd-c66ebf0c1530 req-ea290183-a21c-47a8-b09a-92e56e9bef51 service nova] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:04:15.544626 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [req-0a6f22ef-1374-498a-aacd-c66ebf0c1530 req-ea290183-a21c-47a8-b09a-92e56e9bef51 service nova] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:04:15.548950 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [req-0a6f22ef-1374-498a-aacd-c66ebf0c1530 req-ea290183-a21c-47a8-b09a-92e56e9bef51 service nova] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:04:15.561442 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: INFO nova.api.openstack.compute.server_external_events [req-0a6f22ef-1374-498a-aacd-c66ebf0c1530 req-ea290183-a21c-47a8-b09a-92e56e9bef51 service nova] Creating event network-vif-plugged:a8325a52-865f-4aa2-a4eb-6cb94768def7 for instance 3e1c080b-492d-4c55-880a-14e89c938fce on hv-cinder-85918 Sep 24 05:04:15.577436 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [req-0a6f22ef-1374-498a-aacd-c66ebf0c1530 req-ea290183-a21c-47a8-b09a-92e56e9bef51 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048787 Sep 24 05:04:15.578765 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 252/472] 10.222.0.50 () {64 vars in 1317 bytes} [Sat Sep 24 05:04:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 05:04:15.696101 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-e5d8078a-bac2-44c2-ad86-256a34fba697 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Calling method '>' {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:04:15.696713 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.compute.api [None req-e5d8078a-bac2-44c2-ad86-256a34fba697 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] [instance: 3e1c080b-492d-4c55-880a-14e89c938fce] Fetching instance by UUID {{(pid=120593) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:04:15.703631 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-e5d8078a-bac2-44c2-ad86-256a34fba697 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:04:15.713711 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-e5d8078a-bac2-44c2-ad86-256a34fba697 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:04:15.714921 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-e5d8078a-bac2-44c2-ad86-256a34fba697 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:04:15.715957 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-e5d8078a-bac2-44c2-ad86-256a34fba697 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:04:15.716703 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-e5d8078a-bac2-44c2-ad86-256a34fba697 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:04:15.717592 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-e5d8078a-bac2-44c2-ad86-256a34fba697 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:04:15.949060 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-e5d8078a-bac2-44c2-ad86-256a34fba697 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cdd0da2c7bc4139bcd48ef36a2ee183', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a18a3756ba2b460d977f738a115ebfe0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:04:15.964396 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-e5d8078a-bac2-44c2-ad86-256a34fba697 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] 10.222.0.50 "GET /compute/v2.1/servers/3e1c080b-492d-4c55-880a-14e89c938fce" status: 200 len: 1369 microversion: 2.1 time: 0.271169 Sep 24 05:04:15.967124 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 221/473] 10.222.0.50 () {58 vars in 1236 bytes} [Sat Sep 24 05:04:15 2022] GET /compute/v2.1/servers/3e1c080b-492d-4c55-880a-14e89c938fce => generated 1369 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 05:04:16.990334 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-e0922767-7a4f-4f13-9492-a531cd589df1 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Calling method '>' {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:04:16.992370 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.compute.api [None req-e0922767-7a4f-4f13-9492-a531cd589df1 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] [instance: 3e1c080b-492d-4c55-880a-14e89c938fce] Fetching instance by UUID {{(pid=120594) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:04:17.006223 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-e0922767-7a4f-4f13-9492-a531cd589df1 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:04:17.008613 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-e0922767-7a4f-4f13-9492-a531cd589df1 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:04:17.009407 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-e0922767-7a4f-4f13-9492-a531cd589df1 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:04:17.010657 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-e0922767-7a4f-4f13-9492-a531cd589df1 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:04:17.011547 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-e0922767-7a4f-4f13-9492-a531cd589df1 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:04:17.012380 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-e0922767-7a4f-4f13-9492-a531cd589df1 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:04:17.222626 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.policy [None req-e0922767-7a4f-4f13-9492-a531cd589df1 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cdd0da2c7bc4139bcd48ef36a2ee183', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a18a3756ba2b460d977f738a115ebfe0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:04:17.238373 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [None req-e0922767-7a4f-4f13-9492-a531cd589df1 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] 10.222.0.50 "GET /compute/v2.1/servers/3e1c080b-492d-4c55-880a-14e89c938fce" status: 200 len: 1369 microversion: 2.1 time: 0.252956 Sep 24 05:04:17.254797 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 253/474] 10.222.0.50 () {58 vars in 1236 bytes} [Sat Sep 24 05:04:16 2022] GET /compute/v2.1/servers/3e1c080b-492d-4c55-880a-14e89c938fce => generated 1369 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 05:04:18.264161 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-77d6d3b4-23d5-4762-8aef-1a5e37c9613a tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Calling method '>' {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:04:18.264769 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.compute.api [None req-77d6d3b4-23d5-4762-8aef-1a5e37c9613a tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] [instance: 3e1c080b-492d-4c55-880a-14e89c938fce] Fetching instance by UUID {{(pid=120593) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:04:18.277130 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-77d6d3b4-23d5-4762-8aef-1a5e37c9613a tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:04:18.277618 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-77d6d3b4-23d5-4762-8aef-1a5e37c9613a tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:04:18.278076 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-77d6d3b4-23d5-4762-8aef-1a5e37c9613a tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:04:18.278998 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-77d6d3b4-23d5-4762-8aef-1a5e37c9613a tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:04:18.279660 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-77d6d3b4-23d5-4762-8aef-1a5e37c9613a tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:04:18.281029 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-77d6d3b4-23d5-4762-8aef-1a5e37c9613a tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:04:18.519830 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-77d6d3b4-23d5-4762-8aef-1a5e37c9613a tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cdd0da2c7bc4139bcd48ef36a2ee183', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a18a3756ba2b460d977f738a115ebfe0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:04:18.527945 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-77d6d3b4-23d5-4762-8aef-1a5e37c9613a tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] 10.222.0.50 "GET /compute/v2.1/servers/3e1c080b-492d-4c55-880a-14e89c938fce" status: 200 len: 1564 microversion: 2.1 time: 0.268567 Sep 24 05:04:18.528534 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 222/475] 10.222.0.50 () {58 vars in 1236 bytes} [Sat Sep 24 05:04:18 2022] GET /compute/v2.1/servers/3e1c080b-492d-4c55-880a-14e89c938fce => generated 1564 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 05:04:18.551445 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-701d45ea-716b-4f14-9a43-975b90c8ae76 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Calling method '>' {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:04:18.552028 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.compute.api [None req-701d45ea-716b-4f14-9a43-975b90c8ae76 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] [instance: 3e1c080b-492d-4c55-880a-14e89c938fce] Fetching instance by UUID {{(pid=120594) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:04:18.566653 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-701d45ea-716b-4f14-9a43-975b90c8ae76 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:04:18.567155 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-701d45ea-716b-4f14-9a43-975b90c8ae76 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:04:18.567596 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-701d45ea-716b-4f14-9a43-975b90c8ae76 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:04:18.568326 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-701d45ea-716b-4f14-9a43-975b90c8ae76 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:04:18.568760 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-701d45ea-716b-4f14-9a43-975b90c8ae76 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:04:18.569258 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-701d45ea-716b-4f14-9a43-975b90c8ae76 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:04:18.678844 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [None req-701d45ea-716b-4f14-9a43-975b90c8ae76 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] 10.222.0.50 "GET /compute/v2.1/servers/3e1c080b-492d-4c55-880a-14e89c938fce/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.131724 Sep 24 05:04:18.679549 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 254/476] 10.222.0.50 () {58 vars in 1275 bytes} [Sat Sep 24 05:04:18 2022] GET /compute/v2.1/servers/3e1c080b-492d-4c55-880a-14e89c938fce/os-interface => generated 285 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 05:04:19.743858 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-57ba35bf-b113-4b5c-aa31-e966f1babc4e tempest-TestShelveInstance-1085488420 tempest-TestShelveInstance-1085488420-project] Action: 'create', calling method: .version_select at 0x7f7950833c10>, body: {"keypair": {"name": "tempest-TestShelveInstance-906986219", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJLfQ1Jl89OKwv8qasIlBzdyLgovU5+cRfSClYkJkzey3g77I2hf8ksk3KmBCAexYiYyCgTzPOByOMducREeZVErwXb2i0ZICafCzZHMCUGMYxS40jzAd78CejmTrAQOiw=="}} {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 05:04:19.760433 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.quota [None req-57ba35bf-b113-4b5c-aa31-e966f1babc4e tempest-TestShelveInstance-1085488420 tempest-TestShelveInstance-1085488420-project] Getting quotas for project cd3d02b11bdf45fe99687fda3d1078cd. Resources: {'key_pairs'} {{(pid=120593) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 24 05:04:19.764496 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.quota [None req-57ba35bf-b113-4b5c-aa31-e966f1babc4e tempest-TestShelveInstance-1085488420 tempest-TestShelveInstance-1085488420-project] Getting quotas for user c8fe3c5c28964b768b2c0023fc62f163 and project cd3d02b11bdf45fe99687fda3d1078cd. Resources: {'key_pairs'} {{(pid=120593) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 24 05:04:19.794957 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-57ba35bf-b113-4b5c-aa31-e966f1babc4e tempest-TestShelveInstance-1085488420 tempest-TestShelveInstance-1085488420-project] 10.222.0.50 "POST /compute/v2.1/os-keypairs" status: 200 len: 396 microversion: 2.1 time: 0.255022 Sep 24 05:04:19.795562 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 223/477] 10.222.0.50 () {60 vars in 1159 bytes} [Sat Sep 24 05:04:19 2022] POST /compute/v2.1/os-keypairs => generated 396 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 05:04:20.073036 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [req-bae0ac1c-ef70-46f5-ad09-7fdbcf6d70d8 req-b30e4bb4-bcef-43b6-958b-646ac9206243 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3e1c080b-492d-4c55-880a-14e89c938fce", "tag": "a8325a52-865f-4aa2-a4eb-6cb94768def7"}]} {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 05:04:20.086025 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [req-bae0ac1c-ef70-46f5-ad09-7fdbcf6d70d8 req-b30e4bb4-bcef-43b6-958b-646ac9206243 service nova] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:04:20.086767 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [req-bae0ac1c-ef70-46f5-ad09-7fdbcf6d70d8 req-b30e4bb4-bcef-43b6-958b-646ac9206243 service nova] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:04:20.087421 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [req-bae0ac1c-ef70-46f5-ad09-7fdbcf6d70d8 req-b30e4bb4-bcef-43b6-958b-646ac9206243 service nova] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:04:20.101636 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: INFO nova.api.openstack.compute.server_external_events [req-bae0ac1c-ef70-46f5-ad09-7fdbcf6d70d8 req-b30e4bb4-bcef-43b6-958b-646ac9206243 service nova] Creating event network-changed:a8325a52-865f-4aa2-a4eb-6cb94768def7 for instance 3e1c080b-492d-4c55-880a-14e89c938fce on hv-cinder-85918 Sep 24 05:04:20.107698 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [req-bae0ac1c-ef70-46f5-ad09-7fdbcf6d70d8 req-b30e4bb4-bcef-43b6-958b-646ac9206243 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038479 Sep 24 05:04:20.114188 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 255/478] 10.222.0.50 () {64 vars in 1317 bytes} [Sat Sep 24 05:04:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 05:04:25.502208 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-f5bad57f-1910-4c17-8be9-ae3e11ecb4d6 tempest-VolumesSnapshotTestJSON-4159203 tempest-VolumesSnapshotTestJSON-4159203-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-113067583", "imageRef": "75ab730a-d8cc-4ea2-b58f-0f3eb476c976", "flavorRef": "452", "networks": [{"uuid": "6614e23a-5f78-4605-8561-615096892491"}]}} {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 05:04:25.555569 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.network.neutron [None req-f5bad57f-1910-4c17-8be9-ae3e11ecb4d6 tempest-VolumesSnapshotTestJSON-4159203 tempest-VolumesSnapshotTestJSON-4159203-project] validate_networks() for [('6614e23a-5f78-4605-8561-615096892491', None, None, None, None, None)] {{(pid=120593) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 24 05:04:25.928725 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.virt.hardware [None req-f5bad57f-1910-4c17-8be9-ae3e11ecb4d6 tempest-VolumesSnapshotTestJSON-4159203 tempest-VolumesSnapshotTestJSON-4159203-project] Flavor limits 0:0:0 {{(pid=120593) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 24 05:04:25.929183 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.virt.hardware [None req-f5bad57f-1910-4c17-8be9-ae3e11ecb4d6 tempest-VolumesSnapshotTestJSON-4159203 tempest-VolumesSnapshotTestJSON-4159203-project] Image limits 0:0:0 {{(pid=120593) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 24 05:04:25.929873 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.virt.hardware [None req-f5bad57f-1910-4c17-8be9-ae3e11ecb4d6 tempest-VolumesSnapshotTestJSON-4159203 tempest-VolumesSnapshotTestJSON-4159203-project] Flavor pref 0:0:0 {{(pid=120593) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 24 05:04:25.930707 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.virt.hardware [None req-f5bad57f-1910-4c17-8be9-ae3e11ecb4d6 tempest-VolumesSnapshotTestJSON-4159203 tempest-VolumesSnapshotTestJSON-4159203-project] Image pref 0:0:0 {{(pid=120593) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 24 05:04:25.931299 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.virt.hardware [None req-f5bad57f-1910-4c17-8be9-ae3e11ecb4d6 tempest-VolumesSnapshotTestJSON-4159203 tempest-VolumesSnapshotTestJSON-4159203-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120593) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 24 05:04:25.949049 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-f5bad57f-1910-4c17-8be9-ae3e11ecb4d6 tempest-VolumesSnapshotTestJSON-4159203 tempest-VolumesSnapshotTestJSON-4159203-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:04:25.949591 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-f5bad57f-1910-4c17-8be9-ae3e11ecb4d6 tempest-VolumesSnapshotTestJSON-4159203 tempest-VolumesSnapshotTestJSON-4159203-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:04:25.950313 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-f5bad57f-1910-4c17-8be9-ae3e11ecb4d6 tempest-VolumesSnapshotTestJSON-4159203 tempest-VolumesSnapshotTestJSON-4159203-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:04:25.951434 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-f5bad57f-1910-4c17-8be9-ae3e11ecb4d6 tempest-VolumesSnapshotTestJSON-4159203 tempest-VolumesSnapshotTestJSON-4159203-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:04:25.952362 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-f5bad57f-1910-4c17-8be9-ae3e11ecb4d6 tempest-VolumesSnapshotTestJSON-4159203 tempest-VolumesSnapshotTestJSON-4159203-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:04:25.953083 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-f5bad57f-1910-4c17-8be9-ae3e11ecb4d6 tempest-VolumesSnapshotTestJSON-4159203 tempest-VolumesSnapshotTestJSON-4159203-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:04:25.974602 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.quota [None req-f5bad57f-1910-4c17-8be9-ae3e11ecb4d6 tempest-VolumesSnapshotTestJSON-4159203 tempest-VolumesSnapshotTestJSON-4159203-project] Getting quotas for project 0e942295e9b3478abd521c6f3e60e888. Resources: {'instances', 'ram', 'cores'} {{(pid=120593) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 24 05:04:25.979108 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.quota [None req-f5bad57f-1910-4c17-8be9-ae3e11ecb4d6 tempest-VolumesSnapshotTestJSON-4159203 tempest-VolumesSnapshotTestJSON-4159203-project] Getting quotas for user 358ce5f5c35f415eb79322ae6d187b1d and project 0e942295e9b3478abd521c6f3e60e888. Resources: {'instances', 'ram', 'cores'} {{(pid=120593) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 24 05:04:25.991512 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.compute.api [None req-f5bad57f-1910-4c17-8be9-ae3e11ecb4d6 tempest-VolumesSnapshotTestJSON-4159203 tempest-VolumesSnapshotTestJSON-4159203-project] Going to run 1 instances... {{(pid=120593) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 24 05:04:25.994223 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.compute.api [None req-f5bad57f-1910-4c17-8be9-ae3e11ecb4d6 tempest-VolumesSnapshotTestJSON-4159203 tempest-VolumesSnapshotTestJSON-4159203-project] [instance: 3ca6173c-2d6c-4e8f-84a7-92e40af4c8f0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='75ab730a-d8cc-4ea2-b58f-0f3eb476c976',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120593) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 24 05:04:26.042112 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-f5bad57f-1910-4c17-8be9-ae3e11ecb4d6 tempest-VolumesSnapshotTestJSON-4159203 tempest-VolumesSnapshotTestJSON-4159203-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.544232 Sep 24 05:04:26.042751 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 224/479] 10.222.0.50 () {60 vars in 1147 bytes} [Sat Sep 24 05:04:25 2022] POST /compute/v2.1/servers => generated 380 bytes in 546 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 24 05:04:26.052167 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 24 05:04:26.052713 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: Sat Sep 24 05:04:26 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/3ca6173c-2d6c-4e8f-84a7-92e40af4c8f0 (ip 10.222.0.50) !!! Sep 24 05:04:26.057983 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-46669f88-a8fa-45ac-a928-aa85392b2fa8 tempest-VolumesSnapshotTestJSON-4159203 tempest-VolumesSnapshotTestJSON-4159203-project] Calling method '>' {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:04:26.058712 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.compute.api [None req-46669f88-a8fa-45ac-a928-aa85392b2fa8 tempest-VolumesSnapshotTestJSON-4159203 tempest-VolumesSnapshotTestJSON-4159203-project] [instance: 3ca6173c-2d6c-4e8f-84a7-92e40af4c8f0] Fetching instance by UUID {{(pid=120594) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:04:26.131681 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.policy [None req-46669f88-a8fa-45ac-a928-aa85392b2fa8 tempest-VolumesSnapshotTestJSON-4159203 tempest-VolumesSnapshotTestJSON-4159203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '358ce5f5c35f415eb79322ae6d187b1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e942295e9b3478abd521c6f3e60e888', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:04:26.140447 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [None req-46669f88-a8fa-45ac-a928-aa85392b2fa8 tempest-VolumesSnapshotTestJSON-4159203 tempest-VolumesSnapshotTestJSON-4159203-project] 10.222.0.50 "GET /compute/v2.1/servers/3ca6173c-2d6c-4e8f-84a7-92e40af4c8f0" status: 200 len: 1218 microversion: 2.1 time: 0.089503 Sep 24 05:04:26.141616 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 256/480] 10.222.0.50 () {58 vars in 1236 bytes} [Sat Sep 24 05:04:26 2022] GET /compute/v2.1/servers/3ca6173c-2d6c-4e8f-84a7-92e40af4c8f0 => generated 1218 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 24 05:04:27.165107 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-1ae802df-307f-4d46-81a1-3ad056ef5603 tempest-VolumesSnapshotTestJSON-4159203 tempest-VolumesSnapshotTestJSON-4159203-project] Calling method '>' {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:04:27.165720 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.compute.api [None req-1ae802df-307f-4d46-81a1-3ad056ef5603 tempest-VolumesSnapshotTestJSON-4159203 tempest-VolumesSnapshotTestJSON-4159203-project] [instance: 3ca6173c-2d6c-4e8f-84a7-92e40af4c8f0] Fetching instance by UUID {{(pid=120593) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:04:27.171701 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-1ae802df-307f-4d46-81a1-3ad056ef5603 tempest-VolumesSnapshotTestJSON-4159203 tempest-VolumesSnapshotTestJSON-4159203-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:04:27.172684 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-1ae802df-307f-4d46-81a1-3ad056ef5603 tempest-VolumesSnapshotTestJSON-4159203 tempest-VolumesSnapshotTestJSON-4159203-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:04:27.173114 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-1ae802df-307f-4d46-81a1-3ad056ef5603 tempest-VolumesSnapshotTestJSON-4159203 tempest-VolumesSnapshotTestJSON-4159203-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:04:27.173829 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-1ae802df-307f-4d46-81a1-3ad056ef5603 tempest-VolumesSnapshotTestJSON-4159203 tempest-VolumesSnapshotTestJSON-4159203-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:04:27.174305 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-1ae802df-307f-4d46-81a1-3ad056ef5603 tempest-VolumesSnapshotTestJSON-4159203 tempest-VolumesSnapshotTestJSON-4159203-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:04:27.174725 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-1ae802df-307f-4d46-81a1-3ad056ef5603 tempest-VolumesSnapshotTestJSON-4159203 tempest-VolumesSnapshotTestJSON-4159203-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:04:27.238455 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-1ae802df-307f-4d46-81a1-3ad056ef5603 tempest-VolumesSnapshotTestJSON-4159203 tempest-VolumesSnapshotTestJSON-4159203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '358ce5f5c35f415eb79322ae6d187b1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e942295e9b3478abd521c6f3e60e888', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:04:27.246054 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-1ae802df-307f-4d46-81a1-3ad056ef5603 tempest-VolumesSnapshotTestJSON-4159203 tempest-VolumesSnapshotTestJSON-4159203-project] 10.222.0.50 "GET /compute/v2.1/servers/3ca6173c-2d6c-4e8f-84a7-92e40af4c8f0" status: 200 len: 1270 microversion: 2.1 time: 0.085256 Sep 24 05:04:27.246616 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 225/481] 10.222.0.50 () {58 vars in 1236 bytes} [Sat Sep 24 05:04:27 2022] GET /compute/v2.1/servers/3ca6173c-2d6c-4e8f-84a7-92e40af4c8f0 => generated 1270 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 05:04:28.270701 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-32ad7ce5-4e36-4d10-a11b-979ed218cb8a tempest-VolumesSnapshotTestJSON-4159203 tempest-VolumesSnapshotTestJSON-4159203-project] Calling method '>' {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:04:28.271549 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.compute.api [None req-32ad7ce5-4e36-4d10-a11b-979ed218cb8a tempest-VolumesSnapshotTestJSON-4159203 tempest-VolumesSnapshotTestJSON-4159203-project] [instance: 3ca6173c-2d6c-4e8f-84a7-92e40af4c8f0] Fetching instance by UUID {{(pid=120594) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:04:28.278465 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-32ad7ce5-4e36-4d10-a11b-979ed218cb8a tempest-VolumesSnapshotTestJSON-4159203 tempest-VolumesSnapshotTestJSON-4159203-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:04:28.279040 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-32ad7ce5-4e36-4d10-a11b-979ed218cb8a tempest-VolumesSnapshotTestJSON-4159203 tempest-VolumesSnapshotTestJSON-4159203-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:04:28.279548 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-32ad7ce5-4e36-4d10-a11b-979ed218cb8a tempest-VolumesSnapshotTestJSON-4159203 tempest-VolumesSnapshotTestJSON-4159203-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:04:28.280379 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-32ad7ce5-4e36-4d10-a11b-979ed218cb8a tempest-VolumesSnapshotTestJSON-4159203 tempest-VolumesSnapshotTestJSON-4159203-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:04:28.280849 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-32ad7ce5-4e36-4d10-a11b-979ed218cb8a tempest-VolumesSnapshotTestJSON-4159203 tempest-VolumesSnapshotTestJSON-4159203-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:04:28.281318 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-32ad7ce5-4e36-4d10-a11b-979ed218cb8a tempest-VolumesSnapshotTestJSON-4159203 tempest-VolumesSnapshotTestJSON-4159203-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:04:28.285500 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG dbcounter [-] [120594] Writing DB stats nova_cell1:SELECT=63 {{(pid=120594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 05:04:28.418246 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.policy [None req-32ad7ce5-4e36-4d10-a11b-979ed218cb8a tempest-VolumesSnapshotTestJSON-4159203 tempest-VolumesSnapshotTestJSON-4159203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '358ce5f5c35f415eb79322ae6d187b1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e942295e9b3478abd521c6f3e60e888', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:04:28.430365 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [None req-32ad7ce5-4e36-4d10-a11b-979ed218cb8a tempest-VolumesSnapshotTestJSON-4159203 tempest-VolumesSnapshotTestJSON-4159203-project] 10.222.0.50 "GET /compute/v2.1/servers/3ca6173c-2d6c-4e8f-84a7-92e40af4c8f0" status: 200 len: 1318 microversion: 2.1 time: 0.164620 Sep 24 05:04:28.442307 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 257/482] 10.222.0.50 () {58 vars in 1236 bytes} [Sat Sep 24 05:04:28 2022] GET /compute/v2.1/servers/3ca6173c-2d6c-4e8f-84a7-92e40af4c8f0 => generated 1318 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 05:04:28.804754 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [req-ea3cc5d4-9b8d-4aa9-8fa9-b982b6b33d43 req-1bfa0819-d99f-4d95-a8ab-9a68b218e66a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3ca6173c-2d6c-4e8f-84a7-92e40af4c8f0", "tag": "9c6dec80-2159-4921-9ea1-1aecb911e3c4"}]} {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 05:04:28.814799 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [req-ea3cc5d4-9b8d-4aa9-8fa9-b982b6b33d43 req-1bfa0819-d99f-4d95-a8ab-9a68b218e66a service nova] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:04:28.815561 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [req-ea3cc5d4-9b8d-4aa9-8fa9-b982b6b33d43 req-1bfa0819-d99f-4d95-a8ab-9a68b218e66a service nova] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:04:28.815995 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [req-ea3cc5d4-9b8d-4aa9-8fa9-b982b6b33d43 req-1bfa0819-d99f-4d95-a8ab-9a68b218e66a service nova] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:04:28.827214 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.compute.server_external_events [req-ea3cc5d4-9b8d-4aa9-8fa9-b982b6b33d43 req-1bfa0819-d99f-4d95-a8ab-9a68b218e66a service nova] Creating event network-changed:9c6dec80-2159-4921-9ea1-1aecb911e3c4 for instance 3ca6173c-2d6c-4e8f-84a7-92e40af4c8f0 on hv-cinder-85918 Sep 24 05:04:28.832518 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [req-ea3cc5d4-9b8d-4aa9-8fa9-b982b6b33d43 req-1bfa0819-d99f-4d95-a8ab-9a68b218e66a service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031712 Sep 24 05:04:28.833184 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 226/483] 10.222.0.50 () {64 vars in 1317 bytes} [Sat Sep 24 05:04:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 05:04:29.457918 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-da2ab90e-c635-4f93-ab88-cdd23b0233ad tempest-VolumesSnapshotTestJSON-4159203 tempest-VolumesSnapshotTestJSON-4159203-project] Calling method '>' {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:04:29.458617 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.compute.api [None req-da2ab90e-c635-4f93-ab88-cdd23b0233ad tempest-VolumesSnapshotTestJSON-4159203 tempest-VolumesSnapshotTestJSON-4159203-project] [instance: 3ca6173c-2d6c-4e8f-84a7-92e40af4c8f0] Fetching instance by UUID {{(pid=120594) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:04:29.464855 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-da2ab90e-c635-4f93-ab88-cdd23b0233ad tempest-VolumesSnapshotTestJSON-4159203 tempest-VolumesSnapshotTestJSON-4159203-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:04:29.465342 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-da2ab90e-c635-4f93-ab88-cdd23b0233ad tempest-VolumesSnapshotTestJSON-4159203 tempest-VolumesSnapshotTestJSON-4159203-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:04:29.465784 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-da2ab90e-c635-4f93-ab88-cdd23b0233ad tempest-VolumesSnapshotTestJSON-4159203 tempest-VolumesSnapshotTestJSON-4159203-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:04:29.466507 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-da2ab90e-c635-4f93-ab88-cdd23b0233ad tempest-VolumesSnapshotTestJSON-4159203 tempest-VolumesSnapshotTestJSON-4159203-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:04:29.466960 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-da2ab90e-c635-4f93-ab88-cdd23b0233ad tempest-VolumesSnapshotTestJSON-4159203 tempest-VolumesSnapshotTestJSON-4159203-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:04:29.467382 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-da2ab90e-c635-4f93-ab88-cdd23b0233ad tempest-VolumesSnapshotTestJSON-4159203 tempest-VolumesSnapshotTestJSON-4159203-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:04:29.598893 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.policy [None req-da2ab90e-c635-4f93-ab88-cdd23b0233ad tempest-VolumesSnapshotTestJSON-4159203 tempest-VolumesSnapshotTestJSON-4159203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '358ce5f5c35f415eb79322ae6d187b1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e942295e9b3478abd521c6f3e60e888', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:04:29.606374 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [None req-da2ab90e-c635-4f93-ab88-cdd23b0233ad tempest-VolumesSnapshotTestJSON-4159203 tempest-VolumesSnapshotTestJSON-4159203-project] 10.222.0.50 "GET /compute/v2.1/servers/3ca6173c-2d6c-4e8f-84a7-92e40af4c8f0" status: 200 len: 1318 microversion: 2.1 time: 0.152389 Sep 24 05:04:29.608761 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 258/484] 10.222.0.50 () {58 vars in 1236 bytes} [Sat Sep 24 05:04:29 2022] GET /compute/v2.1/servers/3ca6173c-2d6c-4e8f-84a7-92e40af4c8f0 => generated 1318 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 05:04:30.630580 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-92a0eac4-4577-4d7d-ac06-c387b9b08f1f tempest-VolumesSnapshotTestJSON-4159203 tempest-VolumesSnapshotTestJSON-4159203-project] Calling method '>' {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:04:30.631300 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.compute.api [None req-92a0eac4-4577-4d7d-ac06-c387b9b08f1f tempest-VolumesSnapshotTestJSON-4159203 tempest-VolumesSnapshotTestJSON-4159203-project] [instance: 3ca6173c-2d6c-4e8f-84a7-92e40af4c8f0] Fetching instance by UUID {{(pid=120593) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:04:30.637569 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-92a0eac4-4577-4d7d-ac06-c387b9b08f1f tempest-VolumesSnapshotTestJSON-4159203 tempest-VolumesSnapshotTestJSON-4159203-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:04:30.638079 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-92a0eac4-4577-4d7d-ac06-c387b9b08f1f tempest-VolumesSnapshotTestJSON-4159203 tempest-VolumesSnapshotTestJSON-4159203-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:04:30.638515 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-92a0eac4-4577-4d7d-ac06-c387b9b08f1f tempest-VolumesSnapshotTestJSON-4159203 tempest-VolumesSnapshotTestJSON-4159203-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:04:30.639207 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-92a0eac4-4577-4d7d-ac06-c387b9b08f1f tempest-VolumesSnapshotTestJSON-4159203 tempest-VolumesSnapshotTestJSON-4159203-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:04:30.639654 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-92a0eac4-4577-4d7d-ac06-c387b9b08f1f tempest-VolumesSnapshotTestJSON-4159203 tempest-VolumesSnapshotTestJSON-4159203-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:04:30.640071 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-92a0eac4-4577-4d7d-ac06-c387b9b08f1f tempest-VolumesSnapshotTestJSON-4159203 tempest-VolumesSnapshotTestJSON-4159203-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:04:30.774079 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-92a0eac4-4577-4d7d-ac06-c387b9b08f1f tempest-VolumesSnapshotTestJSON-4159203 tempest-VolumesSnapshotTestJSON-4159203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '358ce5f5c35f415eb79322ae6d187b1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e942295e9b3478abd521c6f3e60e888', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:04:30.786944 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-92a0eac4-4577-4d7d-ac06-c387b9b08f1f tempest-VolumesSnapshotTestJSON-4159203 tempest-VolumesSnapshotTestJSON-4159203-project] 10.222.0.50 "GET /compute/v2.1/servers/3ca6173c-2d6c-4e8f-84a7-92e40af4c8f0" status: 200 len: 1318 microversion: 2.1 time: 0.160950 Sep 24 05:04:30.787541 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 227/485] 10.222.0.50 () {58 vars in 1236 bytes} [Sat Sep 24 05:04:30 2022] GET /compute/v2.1/servers/3ca6173c-2d6c-4e8f-84a7-92e40af4c8f0 => generated 1318 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 05:04:31.814094 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-4cacc78c-322c-48f8-87cf-cc8c2abab2e4 tempest-VolumesSnapshotTestJSON-4159203 tempest-VolumesSnapshotTestJSON-4159203-project] Calling method '>' {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:04:31.814628 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.compute.api [None req-4cacc78c-322c-48f8-87cf-cc8c2abab2e4 tempest-VolumesSnapshotTestJSON-4159203 tempest-VolumesSnapshotTestJSON-4159203-project] [instance: 3ca6173c-2d6c-4e8f-84a7-92e40af4c8f0] Fetching instance by UUID {{(pid=120594) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:04:31.820746 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-4cacc78c-322c-48f8-87cf-cc8c2abab2e4 tempest-VolumesSnapshotTestJSON-4159203 tempest-VolumesSnapshotTestJSON-4159203-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:04:31.821220 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-4cacc78c-322c-48f8-87cf-cc8c2abab2e4 tempest-VolumesSnapshotTestJSON-4159203 tempest-VolumesSnapshotTestJSON-4159203-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:04:31.821648 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-4cacc78c-322c-48f8-87cf-cc8c2abab2e4 tempest-VolumesSnapshotTestJSON-4159203 tempest-VolumesSnapshotTestJSON-4159203-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:04:31.822433 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-4cacc78c-322c-48f8-87cf-cc8c2abab2e4 tempest-VolumesSnapshotTestJSON-4159203 tempest-VolumesSnapshotTestJSON-4159203-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:04:31.822890 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-4cacc78c-322c-48f8-87cf-cc8c2abab2e4 tempest-VolumesSnapshotTestJSON-4159203 tempest-VolumesSnapshotTestJSON-4159203-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:04:31.823382 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-4cacc78c-322c-48f8-87cf-cc8c2abab2e4 tempest-VolumesSnapshotTestJSON-4159203 tempest-VolumesSnapshotTestJSON-4159203-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:04:31.952237 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.policy [None req-4cacc78c-322c-48f8-87cf-cc8c2abab2e4 tempest-VolumesSnapshotTestJSON-4159203 tempest-VolumesSnapshotTestJSON-4159203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '358ce5f5c35f415eb79322ae6d187b1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e942295e9b3478abd521c6f3e60e888', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:04:31.960046 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [None req-4cacc78c-322c-48f8-87cf-cc8c2abab2e4 tempest-VolumesSnapshotTestJSON-4159203 tempest-VolumesSnapshotTestJSON-4159203-project] 10.222.0.50 "GET /compute/v2.1/servers/3ca6173c-2d6c-4e8f-84a7-92e40af4c8f0" status: 200 len: 1318 microversion: 2.1 time: 0.149832 Sep 24 05:04:31.960619 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 259/486] 10.222.0.50 () {58 vars in 1236 bytes} [Sat Sep 24 05:04:31 2022] GET /compute/v2.1/servers/3ca6173c-2d6c-4e8f-84a7-92e40af4c8f0 => generated 1318 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 24 05:04:32.982925 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-065f75b4-e14a-411b-839d-b1db6f1c4729 tempest-VolumesSnapshotTestJSON-4159203 tempest-VolumesSnapshotTestJSON-4159203-project] Calling method '>' {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:04:32.983532 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.compute.api [None req-065f75b4-e14a-411b-839d-b1db6f1c4729 tempest-VolumesSnapshotTestJSON-4159203 tempest-VolumesSnapshotTestJSON-4159203-project] [instance: 3ca6173c-2d6c-4e8f-84a7-92e40af4c8f0] Fetching instance by UUID {{(pid=120593) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:04:32.989958 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-065f75b4-e14a-411b-839d-b1db6f1c4729 tempest-VolumesSnapshotTestJSON-4159203 tempest-VolumesSnapshotTestJSON-4159203-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:04:32.990476 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-065f75b4-e14a-411b-839d-b1db6f1c4729 tempest-VolumesSnapshotTestJSON-4159203 tempest-VolumesSnapshotTestJSON-4159203-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:04:32.990908 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-065f75b4-e14a-411b-839d-b1db6f1c4729 tempest-VolumesSnapshotTestJSON-4159203 tempest-VolumesSnapshotTestJSON-4159203-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:04:32.991596 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-065f75b4-e14a-411b-839d-b1db6f1c4729 tempest-VolumesSnapshotTestJSON-4159203 tempest-VolumesSnapshotTestJSON-4159203-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:04:32.992047 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-065f75b4-e14a-411b-839d-b1db6f1c4729 tempest-VolumesSnapshotTestJSON-4159203 tempest-VolumesSnapshotTestJSON-4159203-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:04:32.992477 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-065f75b4-e14a-411b-839d-b1db6f1c4729 tempest-VolumesSnapshotTestJSON-4159203 tempest-VolumesSnapshotTestJSON-4159203-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:04:33.124818 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-065f75b4-e14a-411b-839d-b1db6f1c4729 tempest-VolumesSnapshotTestJSON-4159203 tempest-VolumesSnapshotTestJSON-4159203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '358ce5f5c35f415eb79322ae6d187b1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e942295e9b3478abd521c6f3e60e888', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:04:33.132632 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-065f75b4-e14a-411b-839d-b1db6f1c4729 tempest-VolumesSnapshotTestJSON-4159203 tempest-VolumesSnapshotTestJSON-4159203-project] 10.222.0.50 "GET /compute/v2.1/servers/3ca6173c-2d6c-4e8f-84a7-92e40af4c8f0" status: 200 len: 1318 microversion: 2.1 time: 0.153577 Sep 24 05:04:33.133184 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 228/487] 10.222.0.50 () {58 vars in 1236 bytes} [Sat Sep 24 05:04:32 2022] GET /compute/v2.1/servers/3ca6173c-2d6c-4e8f-84a7-92e40af4c8f0 => generated 1318 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 05:04:34.156674 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-9c72b01a-d641-4771-bd4e-9c8e4bc44555 tempest-VolumesSnapshotTestJSON-4159203 tempest-VolumesSnapshotTestJSON-4159203-project] Calling method '>' {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:04:34.157275 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.compute.api [None req-9c72b01a-d641-4771-bd4e-9c8e4bc44555 tempest-VolumesSnapshotTestJSON-4159203 tempest-VolumesSnapshotTestJSON-4159203-project] [instance: 3ca6173c-2d6c-4e8f-84a7-92e40af4c8f0] Fetching instance by UUID {{(pid=120594) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:04:34.163258 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-9c72b01a-d641-4771-bd4e-9c8e4bc44555 tempest-VolumesSnapshotTestJSON-4159203 tempest-VolumesSnapshotTestJSON-4159203-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:04:34.163741 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-9c72b01a-d641-4771-bd4e-9c8e4bc44555 tempest-VolumesSnapshotTestJSON-4159203 tempest-VolumesSnapshotTestJSON-4159203-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:04:34.164177 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-9c72b01a-d641-4771-bd4e-9c8e4bc44555 tempest-VolumesSnapshotTestJSON-4159203 tempest-VolumesSnapshotTestJSON-4159203-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:04:34.164891 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-9c72b01a-d641-4771-bd4e-9c8e4bc44555 tempest-VolumesSnapshotTestJSON-4159203 tempest-VolumesSnapshotTestJSON-4159203-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:04:34.165344 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-9c72b01a-d641-4771-bd4e-9c8e4bc44555 tempest-VolumesSnapshotTestJSON-4159203 tempest-VolumesSnapshotTestJSON-4159203-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:04:34.165941 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-9c72b01a-d641-4771-bd4e-9c8e4bc44555 tempest-VolumesSnapshotTestJSON-4159203 tempest-VolumesSnapshotTestJSON-4159203-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:04:34.300200 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.policy [None req-9c72b01a-d641-4771-bd4e-9c8e4bc44555 tempest-VolumesSnapshotTestJSON-4159203 tempest-VolumesSnapshotTestJSON-4159203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '358ce5f5c35f415eb79322ae6d187b1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e942295e9b3478abd521c6f3e60e888', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:04:34.307639 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [None req-9c72b01a-d641-4771-bd4e-9c8e4bc44555 tempest-VolumesSnapshotTestJSON-4159203 tempest-VolumesSnapshotTestJSON-4159203-project] 10.222.0.50 "GET /compute/v2.1/servers/3ca6173c-2d6c-4e8f-84a7-92e40af4c8f0" status: 200 len: 1318 microversion: 2.1 time: 0.154947 Sep 24 05:04:34.308202 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 260/488] 10.222.0.50 () {58 vars in 1236 bytes} [Sat Sep 24 05:04:34 2022] GET /compute/v2.1/servers/3ca6173c-2d6c-4e8f-84a7-92e40af4c8f0 => generated 1318 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 05:04:35.330990 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-1cb76a46-c00d-4eba-a266-29fc50b17cbb tempest-VolumesSnapshotTestJSON-4159203 tempest-VolumesSnapshotTestJSON-4159203-project] Calling method '>' {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:04:35.331592 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.compute.api [None req-1cb76a46-c00d-4eba-a266-29fc50b17cbb tempest-VolumesSnapshotTestJSON-4159203 tempest-VolumesSnapshotTestJSON-4159203-project] [instance: 3ca6173c-2d6c-4e8f-84a7-92e40af4c8f0] Fetching instance by UUID {{(pid=120593) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:04:35.337761 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-1cb76a46-c00d-4eba-a266-29fc50b17cbb tempest-VolumesSnapshotTestJSON-4159203 tempest-VolumesSnapshotTestJSON-4159203-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:04:35.338266 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-1cb76a46-c00d-4eba-a266-29fc50b17cbb tempest-VolumesSnapshotTestJSON-4159203 tempest-VolumesSnapshotTestJSON-4159203-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:04:35.338691 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-1cb76a46-c00d-4eba-a266-29fc50b17cbb tempest-VolumesSnapshotTestJSON-4159203 tempest-VolumesSnapshotTestJSON-4159203-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:04:35.339369 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-1cb76a46-c00d-4eba-a266-29fc50b17cbb tempest-VolumesSnapshotTestJSON-4159203 tempest-VolumesSnapshotTestJSON-4159203-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:04:35.339811 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-1cb76a46-c00d-4eba-a266-29fc50b17cbb tempest-VolumesSnapshotTestJSON-4159203 tempest-VolumesSnapshotTestJSON-4159203-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:04:35.340225 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-1cb76a46-c00d-4eba-a266-29fc50b17cbb tempest-VolumesSnapshotTestJSON-4159203 tempest-VolumesSnapshotTestJSON-4159203-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:04:35.474290 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-1cb76a46-c00d-4eba-a266-29fc50b17cbb tempest-VolumesSnapshotTestJSON-4159203 tempest-VolumesSnapshotTestJSON-4159203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '358ce5f5c35f415eb79322ae6d187b1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e942295e9b3478abd521c6f3e60e888', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:04:35.482273 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-1cb76a46-c00d-4eba-a266-29fc50b17cbb tempest-VolumesSnapshotTestJSON-4159203 tempest-VolumesSnapshotTestJSON-4159203-project] 10.222.0.50 "GET /compute/v2.1/servers/3ca6173c-2d6c-4e8f-84a7-92e40af4c8f0" status: 200 len: 1318 microversion: 2.1 time: 0.155607 Sep 24 05:04:35.482821 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 229/489] 10.222.0.50 () {58 vars in 1236 bytes} [Sat Sep 24 05:04:35 2022] GET /compute/v2.1/servers/3ca6173c-2d6c-4e8f-84a7-92e40af4c8f0 => generated 1318 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 05:04:36.505945 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-ff42bd22-260f-46b0-9599-74dc1e70491a tempest-VolumesSnapshotTestJSON-4159203 tempest-VolumesSnapshotTestJSON-4159203-project] Calling method '>' {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:04:36.507122 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.compute.api [None req-ff42bd22-260f-46b0-9599-74dc1e70491a tempest-VolumesSnapshotTestJSON-4159203 tempest-VolumesSnapshotTestJSON-4159203-project] [instance: 3ca6173c-2d6c-4e8f-84a7-92e40af4c8f0] Fetching instance by UUID {{(pid=120594) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:04:36.508967 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG dbcounter [-] [120594] Writing DB stats nova_cell0:SELECT=2 {{(pid=120594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 05:04:36.514109 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-ff42bd22-260f-46b0-9599-74dc1e70491a tempest-VolumesSnapshotTestJSON-4159203 tempest-VolumesSnapshotTestJSON-4159203-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:04:36.514591 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-ff42bd22-260f-46b0-9599-74dc1e70491a tempest-VolumesSnapshotTestJSON-4159203 tempest-VolumesSnapshotTestJSON-4159203-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:04:36.515028 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-ff42bd22-260f-46b0-9599-74dc1e70491a tempest-VolumesSnapshotTestJSON-4159203 tempest-VolumesSnapshotTestJSON-4159203-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:04:36.515714 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-ff42bd22-260f-46b0-9599-74dc1e70491a tempest-VolumesSnapshotTestJSON-4159203 tempest-VolumesSnapshotTestJSON-4159203-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:04:36.516165 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-ff42bd22-260f-46b0-9599-74dc1e70491a tempest-VolumesSnapshotTestJSON-4159203 tempest-VolumesSnapshotTestJSON-4159203-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:04:36.516586 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-ff42bd22-260f-46b0-9599-74dc1e70491a tempest-VolumesSnapshotTestJSON-4159203 tempest-VolumesSnapshotTestJSON-4159203-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:04:36.643560 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.policy [None req-ff42bd22-260f-46b0-9599-74dc1e70491a tempest-VolumesSnapshotTestJSON-4159203 tempest-VolumesSnapshotTestJSON-4159203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '358ce5f5c35f415eb79322ae6d187b1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e942295e9b3478abd521c6f3e60e888', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:04:36.651469 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [None req-ff42bd22-260f-46b0-9599-74dc1e70491a tempest-VolumesSnapshotTestJSON-4159203 tempest-VolumesSnapshotTestJSON-4159203-project] 10.222.0.50 "GET /compute/v2.1/servers/3ca6173c-2d6c-4e8f-84a7-92e40af4c8f0" status: 200 len: 1318 microversion: 2.1 time: 0.149327 Sep 24 05:04:36.652036 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 261/490] 10.222.0.50 () {58 vars in 1236 bytes} [Sat Sep 24 05:04:36 2022] GET /compute/v2.1/servers/3ca6173c-2d6c-4e8f-84a7-92e40af4c8f0 => generated 1318 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 05:04:37.537496 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [req-943850eb-1ba4-4780-a619-2d6101e6411e req-03b9ed12-617c-4d8d-ad87-a7dd3fb6e0e3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3ca6173c-2d6c-4e8f-84a7-92e40af4c8f0", "name": "network-vif-plugged", "status": "completed", "tag": "9c6dec80-2159-4921-9ea1-1aecb911e3c4"}]} {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 05:04:37.543383 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG dbcounter [-] [120593] Writing DB stats nova_cell0:SELECT=2 {{(pid=120593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 05:04:37.544380 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG dbcounter [-] [120593] Writing DB stats nova_cell0:SELECT=10 {{(pid=120593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 05:04:37.545854 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG dbcounter [-] [120593] Writing DB stats nova_api:SELECT=46,nova_api:INSERT=4 {{(pid=120593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 05:04:37.555608 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [req-943850eb-1ba4-4780-a619-2d6101e6411e req-03b9ed12-617c-4d8d-ad87-a7dd3fb6e0e3 service nova] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:04:37.556076 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [req-943850eb-1ba4-4780-a619-2d6101e6411e req-03b9ed12-617c-4d8d-ad87-a7dd3fb6e0e3 service nova] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:04:37.556500 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [req-943850eb-1ba4-4780-a619-2d6101e6411e req-03b9ed12-617c-4d8d-ad87-a7dd3fb6e0e3 service nova] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:04:37.567898 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.compute.server_external_events [req-943850eb-1ba4-4780-a619-2d6101e6411e req-03b9ed12-617c-4d8d-ad87-a7dd3fb6e0e3 service nova] Creating event network-vif-plugged:9c6dec80-2159-4921-9ea1-1aecb911e3c4 for instance 3ca6173c-2d6c-4e8f-84a7-92e40af4c8f0 on hv-cinder-85918 Sep 24 05:04:37.573070 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [req-943850eb-1ba4-4780-a619-2d6101e6411e req-03b9ed12-617c-4d8d-ad87-a7dd3fb6e0e3 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039199 Sep 24 05:04:37.574255 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 230/491] 10.222.0.50 () {64 vars in 1317 bytes} [Sat Sep 24 05:04:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 05:04:37.674797 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-e6fbb5f8-2588-45db-8a6b-daa76a2a14eb tempest-VolumesSnapshotTestJSON-4159203 tempest-VolumesSnapshotTestJSON-4159203-project] Calling method '>' {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:04:37.675404 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.compute.api [None req-e6fbb5f8-2588-45db-8a6b-daa76a2a14eb tempest-VolumesSnapshotTestJSON-4159203 tempest-VolumesSnapshotTestJSON-4159203-project] [instance: 3ca6173c-2d6c-4e8f-84a7-92e40af4c8f0] Fetching instance by UUID {{(pid=120594) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:04:37.681184 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-e6fbb5f8-2588-45db-8a6b-daa76a2a14eb tempest-VolumesSnapshotTestJSON-4159203 tempest-VolumesSnapshotTestJSON-4159203-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:04:37.681664 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-e6fbb5f8-2588-45db-8a6b-daa76a2a14eb tempest-VolumesSnapshotTestJSON-4159203 tempest-VolumesSnapshotTestJSON-4159203-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:04:37.682145 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-e6fbb5f8-2588-45db-8a6b-daa76a2a14eb tempest-VolumesSnapshotTestJSON-4159203 tempest-VolumesSnapshotTestJSON-4159203-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:04:37.682839 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-e6fbb5f8-2588-45db-8a6b-daa76a2a14eb tempest-VolumesSnapshotTestJSON-4159203 tempest-VolumesSnapshotTestJSON-4159203-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:04:37.683289 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-e6fbb5f8-2588-45db-8a6b-daa76a2a14eb tempest-VolumesSnapshotTestJSON-4159203 tempest-VolumesSnapshotTestJSON-4159203-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:04:37.683707 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-e6fbb5f8-2588-45db-8a6b-daa76a2a14eb tempest-VolumesSnapshotTestJSON-4159203 tempest-VolumesSnapshotTestJSON-4159203-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:04:37.813759 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.policy [None req-e6fbb5f8-2588-45db-8a6b-daa76a2a14eb tempest-VolumesSnapshotTestJSON-4159203 tempest-VolumesSnapshotTestJSON-4159203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '358ce5f5c35f415eb79322ae6d187b1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e942295e9b3478abd521c6f3e60e888', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:04:37.821288 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [None req-e6fbb5f8-2588-45db-8a6b-daa76a2a14eb tempest-VolumesSnapshotTestJSON-4159203 tempest-VolumesSnapshotTestJSON-4159203-project] 10.222.0.50 "GET /compute/v2.1/servers/3ca6173c-2d6c-4e8f-84a7-92e40af4c8f0" status: 200 len: 1318 microversion: 2.1 time: 0.150927 Sep 24 05:04:37.821839 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 262/492] 10.222.0.50 () {58 vars in 1236 bytes} [Sat Sep 24 05:04:37 2022] GET /compute/v2.1/servers/3ca6173c-2d6c-4e8f-84a7-92e40af4c8f0 => generated 1318 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 05:04:38.845647 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-1b6bd5db-472c-48b6-9ce2-564904f0a0ee tempest-VolumesSnapshotTestJSON-4159203 tempest-VolumesSnapshotTestJSON-4159203-project] Calling method '>' {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:04:38.846372 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.compute.api [None req-1b6bd5db-472c-48b6-9ce2-564904f0a0ee tempest-VolumesSnapshotTestJSON-4159203 tempest-VolumesSnapshotTestJSON-4159203-project] [instance: 3ca6173c-2d6c-4e8f-84a7-92e40af4c8f0] Fetching instance by UUID {{(pid=120593) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:04:38.852876 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-1b6bd5db-472c-48b6-9ce2-564904f0a0ee tempest-VolumesSnapshotTestJSON-4159203 tempest-VolumesSnapshotTestJSON-4159203-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:04:38.853634 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-1b6bd5db-472c-48b6-9ce2-564904f0a0ee tempest-VolumesSnapshotTestJSON-4159203 tempest-VolumesSnapshotTestJSON-4159203-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:04:38.854097 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-1b6bd5db-472c-48b6-9ce2-564904f0a0ee tempest-VolumesSnapshotTestJSON-4159203 tempest-VolumesSnapshotTestJSON-4159203-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:04:38.854785 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-1b6bd5db-472c-48b6-9ce2-564904f0a0ee tempest-VolumesSnapshotTestJSON-4159203 tempest-VolumesSnapshotTestJSON-4159203-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:04:38.855239 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-1b6bd5db-472c-48b6-9ce2-564904f0a0ee tempest-VolumesSnapshotTestJSON-4159203 tempest-VolumesSnapshotTestJSON-4159203-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:04:38.855662 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-1b6bd5db-472c-48b6-9ce2-564904f0a0ee tempest-VolumesSnapshotTestJSON-4159203 tempest-VolumesSnapshotTestJSON-4159203-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:04:38.981680 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-1b6bd5db-472c-48b6-9ce2-564904f0a0ee tempest-VolumesSnapshotTestJSON-4159203 tempest-VolumesSnapshotTestJSON-4159203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '358ce5f5c35f415eb79322ae6d187b1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e942295e9b3478abd521c6f3e60e888', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:04:38.989182 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-1b6bd5db-472c-48b6-9ce2-564904f0a0ee tempest-VolumesSnapshotTestJSON-4159203 tempest-VolumesSnapshotTestJSON-4159203-project] 10.222.0.50 "GET /compute/v2.1/servers/3ca6173c-2d6c-4e8f-84a7-92e40af4c8f0" status: 200 len: 1318 microversion: 2.1 time: 0.148532 Sep 24 05:04:38.989739 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 231/493] 10.222.0.50 () {58 vars in 1236 bytes} [Sat Sep 24 05:04:38 2022] GET /compute/v2.1/servers/3ca6173c-2d6c-4e8f-84a7-92e40af4c8f0 => generated 1318 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 05:04:40.011018 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-668e7f5b-969b-4e04-8a4b-b35b56d445f2 tempest-VolumesSnapshotTestJSON-4159203 tempest-VolumesSnapshotTestJSON-4159203-project] Calling method '>' {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:04:40.011662 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.compute.api [None req-668e7f5b-969b-4e04-8a4b-b35b56d445f2 tempest-VolumesSnapshotTestJSON-4159203 tempest-VolumesSnapshotTestJSON-4159203-project] [instance: 3ca6173c-2d6c-4e8f-84a7-92e40af4c8f0] Fetching instance by UUID {{(pid=120594) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:04:40.013602 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG dbcounter [-] [120594] Writing DB stats nova_api:SELECT=30 {{(pid=120594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 05:04:40.018941 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-668e7f5b-969b-4e04-8a4b-b35b56d445f2 tempest-VolumesSnapshotTestJSON-4159203 tempest-VolumesSnapshotTestJSON-4159203-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:04:40.019421 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-668e7f5b-969b-4e04-8a4b-b35b56d445f2 tempest-VolumesSnapshotTestJSON-4159203 tempest-VolumesSnapshotTestJSON-4159203-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:04:40.019856 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-668e7f5b-969b-4e04-8a4b-b35b56d445f2 tempest-VolumesSnapshotTestJSON-4159203 tempest-VolumesSnapshotTestJSON-4159203-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:04:40.020801 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-668e7f5b-969b-4e04-8a4b-b35b56d445f2 tempest-VolumesSnapshotTestJSON-4159203 tempest-VolumesSnapshotTestJSON-4159203-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:04:40.021249 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-668e7f5b-969b-4e04-8a4b-b35b56d445f2 tempest-VolumesSnapshotTestJSON-4159203 tempest-VolumesSnapshotTestJSON-4159203-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:04:40.021702 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-668e7f5b-969b-4e04-8a4b-b35b56d445f2 tempest-VolumesSnapshotTestJSON-4159203 tempest-VolumesSnapshotTestJSON-4159203-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:04:40.147159 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.policy [None req-668e7f5b-969b-4e04-8a4b-b35b56d445f2 tempest-VolumesSnapshotTestJSON-4159203 tempest-VolumesSnapshotTestJSON-4159203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '358ce5f5c35f415eb79322ae6d187b1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e942295e9b3478abd521c6f3e60e888', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:04:40.155773 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [None req-668e7f5b-969b-4e04-8a4b-b35b56d445f2 tempest-VolumesSnapshotTestJSON-4159203 tempest-VolumesSnapshotTestJSON-4159203-project] 10.222.0.50 "GET /compute/v2.1/servers/3ca6173c-2d6c-4e8f-84a7-92e40af4c8f0" status: 200 len: 1318 microversion: 2.1 time: 0.148521 Sep 24 05:04:40.157015 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 263/494] 10.222.0.50 () {58 vars in 1236 bytes} [Sat Sep 24 05:04:40 2022] GET /compute/v2.1/servers/3ca6173c-2d6c-4e8f-84a7-92e40af4c8f0 => generated 1318 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 05:04:41.186099 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-47c7c914-27c5-421d-9a09-38942fa8dcb9 tempest-VolumesSnapshotTestJSON-4159203 tempest-VolumesSnapshotTestJSON-4159203-project] Calling method '>' {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:04:41.186751 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.compute.api [None req-47c7c914-27c5-421d-9a09-38942fa8dcb9 tempest-VolumesSnapshotTestJSON-4159203 tempest-VolumesSnapshotTestJSON-4159203-project] [instance: 3ca6173c-2d6c-4e8f-84a7-92e40af4c8f0] Fetching instance by UUID {{(pid=120593) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:04:41.193820 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-47c7c914-27c5-421d-9a09-38942fa8dcb9 tempest-VolumesSnapshotTestJSON-4159203 tempest-VolumesSnapshotTestJSON-4159203-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:04:41.194338 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-47c7c914-27c5-421d-9a09-38942fa8dcb9 tempest-VolumesSnapshotTestJSON-4159203 tempest-VolumesSnapshotTestJSON-4159203-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:04:41.194774 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-47c7c914-27c5-421d-9a09-38942fa8dcb9 tempest-VolumesSnapshotTestJSON-4159203 tempest-VolumesSnapshotTestJSON-4159203-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:04:41.195460 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-47c7c914-27c5-421d-9a09-38942fa8dcb9 tempest-VolumesSnapshotTestJSON-4159203 tempest-VolumesSnapshotTestJSON-4159203-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:04:41.195911 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-47c7c914-27c5-421d-9a09-38942fa8dcb9 tempest-VolumesSnapshotTestJSON-4159203 tempest-VolumesSnapshotTestJSON-4159203-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:04:41.196342 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-47c7c914-27c5-421d-9a09-38942fa8dcb9 tempest-VolumesSnapshotTestJSON-4159203 tempest-VolumesSnapshotTestJSON-4159203-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:04:41.327586 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-47c7c914-27c5-421d-9a09-38942fa8dcb9 tempest-VolumesSnapshotTestJSON-4159203 tempest-VolumesSnapshotTestJSON-4159203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '358ce5f5c35f415eb79322ae6d187b1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e942295e9b3478abd521c6f3e60e888', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:04:41.335169 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-47c7c914-27c5-421d-9a09-38942fa8dcb9 tempest-VolumesSnapshotTestJSON-4159203 tempest-VolumesSnapshotTestJSON-4159203-project] 10.222.0.50 "GET /compute/v2.1/servers/3ca6173c-2d6c-4e8f-84a7-92e40af4c8f0" status: 200 len: 1507 microversion: 2.1 time: 0.154594 Sep 24 05:04:41.335730 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 232/495] 10.222.0.50 () {58 vars in 1236 bytes} [Sat Sep 24 05:04:41 2022] GET /compute/v2.1/servers/3ca6173c-2d6c-4e8f-84a7-92e40af4c8f0 => generated 1507 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 05:04:46.544091 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-16b01faf-3375-4729-92bb-457c552192f0 tempest-TestShelveInstance-1085488420 tempest-TestShelveInstance-1085488420-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-857925", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-906986219", "security_groups": [{"name": "tempest-secgroup-smoke-74811002"}], "networks": [{"uuid": "96921dc0-8a1d-4ce2-9352-455dac08d2de"}], "block_device_mapping_v2": [{"uuid": "6cd6b971-cf83-414c-a932-3fff4b5b2151", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 05:04:46.661650 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.network.neutron [None req-16b01faf-3375-4729-92bb-457c552192f0 tempest-TestShelveInstance-1085488420 tempest-TestShelveInstance-1085488420-project] validate_networks() for [('96921dc0-8a1d-4ce2-9352-455dac08d2de', None, None, None, None, None)] {{(pid=120594) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 24 05:04:47.037732 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.virt.hardware [None req-16b01faf-3375-4729-92bb-457c552192f0 tempest-TestShelveInstance-1085488420 tempest-TestShelveInstance-1085488420-project] Flavor limits 0:0:0 {{(pid=120594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 24 05:04:47.038169 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.virt.hardware [None req-16b01faf-3375-4729-92bb-457c552192f0 tempest-TestShelveInstance-1085488420 tempest-TestShelveInstance-1085488420-project] Image limits 0:0:0 {{(pid=120594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 24 05:04:47.038640 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.virt.hardware [None req-16b01faf-3375-4729-92bb-457c552192f0 tempest-TestShelveInstance-1085488420 tempest-TestShelveInstance-1085488420-project] Flavor pref 0:0:0 {{(pid=120594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 24 05:04:47.039041 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.virt.hardware [None req-16b01faf-3375-4729-92bb-457c552192f0 tempest-TestShelveInstance-1085488420 tempest-TestShelveInstance-1085488420-project] Image pref 0:0:0 {{(pid=120594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 24 05:04:47.039446 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.virt.hardware [None req-16b01faf-3375-4729-92bb-457c552192f0 tempest-TestShelveInstance-1085488420 tempest-TestShelveInstance-1085488420-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 24 05:04:47.048036 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-16b01faf-3375-4729-92bb-457c552192f0 tempest-TestShelveInstance-1085488420 tempest-TestShelveInstance-1085488420-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:04:47.048515 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-16b01faf-3375-4729-92bb-457c552192f0 tempest-TestShelveInstance-1085488420 tempest-TestShelveInstance-1085488420-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:04:47.048941 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-16b01faf-3375-4729-92bb-457c552192f0 tempest-TestShelveInstance-1085488420 tempest-TestShelveInstance-1085488420-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:04:47.049657 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-16b01faf-3375-4729-92bb-457c552192f0 tempest-TestShelveInstance-1085488420 tempest-TestShelveInstance-1085488420-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:04:47.050136 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-16b01faf-3375-4729-92bb-457c552192f0 tempest-TestShelveInstance-1085488420 tempest-TestShelveInstance-1085488420-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:04:47.050581 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-16b01faf-3375-4729-92bb-457c552192f0 tempest-TestShelveInstance-1085488420 tempest-TestShelveInstance-1085488420-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:04:47.068888 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.quota [None req-16b01faf-3375-4729-92bb-457c552192f0 tempest-TestShelveInstance-1085488420 tempest-TestShelveInstance-1085488420-project] Getting quotas for project cd3d02b11bdf45fe99687fda3d1078cd. Resources: {'instances', 'ram', 'cores'} {{(pid=120594) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 24 05:04:47.072762 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.quota [None req-16b01faf-3375-4729-92bb-457c552192f0 tempest-TestShelveInstance-1085488420 tempest-TestShelveInstance-1085488420-project] Getting quotas for user c8fe3c5c28964b768b2c0023fc62f163 and project cd3d02b11bdf45fe99687fda3d1078cd. Resources: {'instances', 'ram', 'cores'} {{(pid=120594) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 24 05:04:47.131861 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.compute.api [None req-16b01faf-3375-4729-92bb-457c552192f0 tempest-TestShelveInstance-1085488420 tempest-TestShelveInstance-1085488420-project] Going to run 1 instances... {{(pid=120594) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 24 05:04:47.133977 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.compute.api [None req-16b01faf-3375-4729-92bb-457c552192f0 tempest-TestShelveInstance-1085488420 tempest-TestShelveInstance-1085488420-project] [instance: 60d69c7d-69e4-4b2a-b41c-692867a6e28d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='6cd6b971-cf83-414c-a932-3fff4b5b2151',volume_size=None,volume_type=None)] {{(pid=120594) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 24 05:04:47.266167 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [None req-16b01faf-3375-4729-92bb-457c552192f0 tempest-TestShelveInstance-1085488420 tempest-TestShelveInstance-1085488420-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 202 len: 404 microversion: 2.1 time: 0.725793 Sep 24 05:04:47.266813 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 264/496] 10.222.0.50 () {60 vars in 1147 bytes} [Sat Sep 24 05:04:46 2022] POST /compute/v2.1/servers => generated 404 bytes in 727 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 24 05:04:47.278571 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-3f689ff0-dff8-4c96-8782-6174fd536fa7 tempest-TestShelveInstance-1085488420 tempest-TestShelveInstance-1085488420-project] Calling method '>' {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:04:47.279318 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.compute.api [None req-3f689ff0-dff8-4c96-8782-6174fd536fa7 tempest-TestShelveInstance-1085488420 tempest-TestShelveInstance-1085488420-project] [instance: 60d69c7d-69e4-4b2a-b41c-692867a6e28d] Fetching instance by UUID {{(pid=120593) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:04:47.333105 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-3f689ff0-dff8-4c96-8782-6174fd536fa7 tempest-TestShelveInstance-1085488420 tempest-TestShelveInstance-1085488420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8fe3c5c28964b768b2c0023fc62f163', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd3d02b11bdf45fe99687fda3d1078cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:04:47.339953 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-3f689ff0-dff8-4c96-8782-6174fd536fa7 tempest-TestShelveInstance-1085488420 tempest-TestShelveInstance-1085488420-project] 10.222.0.50 "GET /compute/v2.1/servers/60d69c7d-69e4-4b2a-b41c-692867a6e28d" status: 200 len: 1084 microversion: 2.1 time: 0.065400 Sep 24 05:04:47.340515 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 233/497] 10.222.0.50 () {58 vars in 1236 bytes} [Sat Sep 24 05:04:47 2022] GET /compute/v2.1/servers/60d69c7d-69e4-4b2a-b41c-692867a6e28d => generated 1084 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 05:04:48.365825 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-269b1047-5f3a-4939-882b-b33b066a2fe7 tempest-TestShelveInstance-1085488420 tempest-TestShelveInstance-1085488420-project] Calling method '>' {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:04:48.366439 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.compute.api [None req-269b1047-5f3a-4939-882b-b33b066a2fe7 tempest-TestShelveInstance-1085488420 tempest-TestShelveInstance-1085488420-project] [instance: 60d69c7d-69e4-4b2a-b41c-692867a6e28d] Fetching instance by UUID {{(pid=120594) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:04:48.374415 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-269b1047-5f3a-4939-882b-b33b066a2fe7 tempest-TestShelveInstance-1085488420 tempest-TestShelveInstance-1085488420-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:04:48.374888 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-269b1047-5f3a-4939-882b-b33b066a2fe7 tempest-TestShelveInstance-1085488420 tempest-TestShelveInstance-1085488420-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:04:48.375801 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-269b1047-5f3a-4939-882b-b33b066a2fe7 tempest-TestShelveInstance-1085488420 tempest-TestShelveInstance-1085488420-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:04:48.376481 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-269b1047-5f3a-4939-882b-b33b066a2fe7 tempest-TestShelveInstance-1085488420 tempest-TestShelveInstance-1085488420-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:04:48.376924 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-269b1047-5f3a-4939-882b-b33b066a2fe7 tempest-TestShelveInstance-1085488420 tempest-TestShelveInstance-1085488420-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:04:48.377334 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-269b1047-5f3a-4939-882b-b33b066a2fe7 tempest-TestShelveInstance-1085488420 tempest-TestShelveInstance-1085488420-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:04:48.445463 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.policy [None req-269b1047-5f3a-4939-882b-b33b066a2fe7 tempest-TestShelveInstance-1085488420 tempest-TestShelveInstance-1085488420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8fe3c5c28964b768b2c0023fc62f163', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd3d02b11bdf45fe99687fda3d1078cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:04:48.454243 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [None req-269b1047-5f3a-4939-882b-b33b066a2fe7 tempest-TestShelveInstance-1085488420 tempest-TestShelveInstance-1085488420-project] 10.222.0.50 "GET /compute/v2.1/servers/60d69c7d-69e4-4b2a-b41c-692867a6e28d" status: 200 len: 1126 microversion: 2.1 time: 0.091961 Sep 24 05:04:48.454829 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 265/498] 10.222.0.50 () {58 vars in 1236 bytes} [Sat Sep 24 05:04:48 2022] GET /compute/v2.1/servers/60d69c7d-69e4-4b2a-b41c-692867a6e28d => generated 1126 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 05:04:49.476753 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-e46f0a4f-a52b-4e86-842a-3d571735aa87 tempest-TestShelveInstance-1085488420 tempest-TestShelveInstance-1085488420-project] Calling method '>' {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:04:49.477627 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.compute.api [None req-e46f0a4f-a52b-4e86-842a-3d571735aa87 tempest-TestShelveInstance-1085488420 tempest-TestShelveInstance-1085488420-project] [instance: 60d69c7d-69e4-4b2a-b41c-692867a6e28d] Fetching instance by UUID {{(pid=120593) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:04:49.484157 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-e46f0a4f-a52b-4e86-842a-3d571735aa87 tempest-TestShelveInstance-1085488420 tempest-TestShelveInstance-1085488420-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:04:49.484779 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-e46f0a4f-a52b-4e86-842a-3d571735aa87 tempest-TestShelveInstance-1085488420 tempest-TestShelveInstance-1085488420-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:04:49.485216 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-e46f0a4f-a52b-4e86-842a-3d571735aa87 tempest-TestShelveInstance-1085488420 tempest-TestShelveInstance-1085488420-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:04:49.486022 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-e46f0a4f-a52b-4e86-842a-3d571735aa87 tempest-TestShelveInstance-1085488420 tempest-TestShelveInstance-1085488420-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:04:49.486449 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-e46f0a4f-a52b-4e86-842a-3d571735aa87 tempest-TestShelveInstance-1085488420 tempest-TestShelveInstance-1085488420-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:04:49.487575 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-e46f0a4f-a52b-4e86-842a-3d571735aa87 tempest-TestShelveInstance-1085488420 tempest-TestShelveInstance-1085488420-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:04:49.491906 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG dbcounter [-] [120593] Writing DB stats nova_cell1:SELECT=66 {{(pid=120593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 05:04:49.553814 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-e46f0a4f-a52b-4e86-842a-3d571735aa87 tempest-TestShelveInstance-1085488420 tempest-TestShelveInstance-1085488420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8fe3c5c28964b768b2c0023fc62f163', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd3d02b11bdf45fe99687fda3d1078cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:04:49.562546 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-e46f0a4f-a52b-4e86-842a-3d571735aa87 tempest-TestShelveInstance-1085488420 tempest-TestShelveInstance-1085488420-project] 10.222.0.50 "GET /compute/v2.1/servers/60d69c7d-69e4-4b2a-b41c-692867a6e28d" status: 200 len: 1200 microversion: 2.1 time: 0.089688 Sep 24 05:04:49.563101 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 234/499] 10.222.0.50 () {58 vars in 1236 bytes} [Sat Sep 24 05:04:49 2022] GET /compute/v2.1/servers/60d69c7d-69e4-4b2a-b41c-692867a6e28d => generated 1200 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 05:04:50.584717 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-9e7b0d1f-6b18-40c8-880e-84d35c776bfa tempest-TestShelveInstance-1085488420 tempest-TestShelveInstance-1085488420-project] Calling method '>' {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:04:50.585325 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.compute.api [None req-9e7b0d1f-6b18-40c8-880e-84d35c776bfa tempest-TestShelveInstance-1085488420 tempest-TestShelveInstance-1085488420-project] [instance: 60d69c7d-69e4-4b2a-b41c-692867a6e28d] Fetching instance by UUID {{(pid=120594) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:04:50.591573 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-9e7b0d1f-6b18-40c8-880e-84d35c776bfa tempest-TestShelveInstance-1085488420 tempest-TestShelveInstance-1085488420-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:04:50.592076 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-9e7b0d1f-6b18-40c8-880e-84d35c776bfa tempest-TestShelveInstance-1085488420 tempest-TestShelveInstance-1085488420-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:04:50.592523 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-9e7b0d1f-6b18-40c8-880e-84d35c776bfa tempest-TestShelveInstance-1085488420 tempest-TestShelveInstance-1085488420-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:04:50.593264 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-9e7b0d1f-6b18-40c8-880e-84d35c776bfa tempest-TestShelveInstance-1085488420 tempest-TestShelveInstance-1085488420-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:04:50.593696 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-9e7b0d1f-6b18-40c8-880e-84d35c776bfa tempest-TestShelveInstance-1085488420 tempest-TestShelveInstance-1085488420-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:04:50.594652 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-9e7b0d1f-6b18-40c8-880e-84d35c776bfa tempest-TestShelveInstance-1085488420 tempest-TestShelveInstance-1085488420-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:04:50.731135 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.policy [None req-9e7b0d1f-6b18-40c8-880e-84d35c776bfa tempest-TestShelveInstance-1085488420 tempest-TestShelveInstance-1085488420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8fe3c5c28964b768b2c0023fc62f163', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd3d02b11bdf45fe99687fda3d1078cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:04:50.739345 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [None req-9e7b0d1f-6b18-40c8-880e-84d35c776bfa tempest-TestShelveInstance-1085488420 tempest-TestShelveInstance-1085488420-project] 10.222.0.50 "GET /compute/v2.1/servers/60d69c7d-69e4-4b2a-b41c-692867a6e28d" status: 200 len: 1254 microversion: 2.1 time: 0.158508 Sep 24 05:04:50.739904 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 266/500] 10.222.0.50 () {58 vars in 1236 bytes} [Sat Sep 24 05:04:50 2022] GET /compute/v2.1/servers/60d69c7d-69e4-4b2a-b41c-692867a6e28d => generated 1254 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 05:04:50.779922 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [req-3a22aac4-e268-49a4-919c-465b3cfacb53 req-f9029d2b-4697-4b15-b0fb-4f17acbe1784 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "60d69c7d-69e4-4b2a-b41c-692867a6e28d", "tag": "fab1bdaa-696a-4cf2-b4c6-ca1ee5692022"}]} {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 05:04:50.793163 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [req-3a22aac4-e268-49a4-919c-465b3cfacb53 req-f9029d2b-4697-4b15-b0fb-4f17acbe1784 service nova] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:04:50.793655 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [req-3a22aac4-e268-49a4-919c-465b3cfacb53 req-f9029d2b-4697-4b15-b0fb-4f17acbe1784 service nova] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:04:50.794219 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [req-3a22aac4-e268-49a4-919c-465b3cfacb53 req-f9029d2b-4697-4b15-b0fb-4f17acbe1784 service nova] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:04:50.812122 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.compute.server_external_events [req-3a22aac4-e268-49a4-919c-465b3cfacb53 req-f9029d2b-4697-4b15-b0fb-4f17acbe1784 service nova] Creating event network-changed:fab1bdaa-696a-4cf2-b4c6-ca1ee5692022 for instance 60d69c7d-69e4-4b2a-b41c-692867a6e28d on hv-cinder-85918 Sep 24 05:04:50.817835 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [req-3a22aac4-e268-49a4-919c-465b3cfacb53 req-f9029d2b-4697-4b15-b0fb-4f17acbe1784 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041413 Sep 24 05:04:50.818269 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 235/501] 10.222.0.50 () {64 vars in 1317 bytes} [Sat Sep 24 05:04:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 05:04:51.762644 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-3c1d4c4c-ee0f-4dd1-b15f-49c6d7f2a651 tempest-TestShelveInstance-1085488420 tempest-TestShelveInstance-1085488420-project] Calling method '>' {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:04:51.763253 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.compute.api [None req-3c1d4c4c-ee0f-4dd1-b15f-49c6d7f2a651 tempest-TestShelveInstance-1085488420 tempest-TestShelveInstance-1085488420-project] [instance: 60d69c7d-69e4-4b2a-b41c-692867a6e28d] Fetching instance by UUID {{(pid=120594) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:04:51.769285 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-3c1d4c4c-ee0f-4dd1-b15f-49c6d7f2a651 tempest-TestShelveInstance-1085488420 tempest-TestShelveInstance-1085488420-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:04:51.769759 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-3c1d4c4c-ee0f-4dd1-b15f-49c6d7f2a651 tempest-TestShelveInstance-1085488420 tempest-TestShelveInstance-1085488420-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:04:51.770222 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-3c1d4c4c-ee0f-4dd1-b15f-49c6d7f2a651 tempest-TestShelveInstance-1085488420 tempest-TestShelveInstance-1085488420-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:04:51.771170 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-3c1d4c4c-ee0f-4dd1-b15f-49c6d7f2a651 tempest-TestShelveInstance-1085488420 tempest-TestShelveInstance-1085488420-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:04:51.771616 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-3c1d4c4c-ee0f-4dd1-b15f-49c6d7f2a651 tempest-TestShelveInstance-1085488420 tempest-TestShelveInstance-1085488420-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:04:51.772034 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-3c1d4c4c-ee0f-4dd1-b15f-49c6d7f2a651 tempest-TestShelveInstance-1085488420 tempest-TestShelveInstance-1085488420-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:04:51.905393 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.policy [None req-3c1d4c4c-ee0f-4dd1-b15f-49c6d7f2a651 tempest-TestShelveInstance-1085488420 tempest-TestShelveInstance-1085488420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8fe3c5c28964b768b2c0023fc62f163', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd3d02b11bdf45fe99687fda3d1078cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:04:51.913106 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [None req-3c1d4c4c-ee0f-4dd1-b15f-49c6d7f2a651 tempest-TestShelveInstance-1085488420 tempest-TestShelveInstance-1085488420-project] 10.222.0.50 "GET /compute/v2.1/servers/60d69c7d-69e4-4b2a-b41c-692867a6e28d" status: 200 len: 1254 microversion: 2.1 time: 0.154361 Sep 24 05:04:51.913664 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 267/502] 10.222.0.50 () {58 vars in 1236 bytes} [Sat Sep 24 05:04:51 2022] GET /compute/v2.1/servers/60d69c7d-69e4-4b2a-b41c-692867a6e28d => generated 1254 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 05:04:52.937102 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-1927e684-2564-49b8-b6ee-e3f87af94bed tempest-TestShelveInstance-1085488420 tempest-TestShelveInstance-1085488420-project] Calling method '>' {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:04:52.937713 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.compute.api [None req-1927e684-2564-49b8-b6ee-e3f87af94bed tempest-TestShelveInstance-1085488420 tempest-TestShelveInstance-1085488420-project] [instance: 60d69c7d-69e4-4b2a-b41c-692867a6e28d] Fetching instance by UUID {{(pid=120593) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:04:52.944852 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-1927e684-2564-49b8-b6ee-e3f87af94bed tempest-TestShelveInstance-1085488420 tempest-TestShelveInstance-1085488420-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:04:52.945331 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-1927e684-2564-49b8-b6ee-e3f87af94bed tempest-TestShelveInstance-1085488420 tempest-TestShelveInstance-1085488420-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:04:52.945761 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-1927e684-2564-49b8-b6ee-e3f87af94bed tempest-TestShelveInstance-1085488420 tempest-TestShelveInstance-1085488420-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:04:52.946472 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-1927e684-2564-49b8-b6ee-e3f87af94bed tempest-TestShelveInstance-1085488420 tempest-TestShelveInstance-1085488420-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:04:52.946920 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-1927e684-2564-49b8-b6ee-e3f87af94bed tempest-TestShelveInstance-1085488420 tempest-TestShelveInstance-1085488420-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:04:52.947343 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-1927e684-2564-49b8-b6ee-e3f87af94bed tempest-TestShelveInstance-1085488420 tempest-TestShelveInstance-1085488420-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:04:53.075740 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-1927e684-2564-49b8-b6ee-e3f87af94bed tempest-TestShelveInstance-1085488420 tempest-TestShelveInstance-1085488420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8fe3c5c28964b768b2c0023fc62f163', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd3d02b11bdf45fe99687fda3d1078cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:04:53.084010 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-1927e684-2564-49b8-b6ee-e3f87af94bed tempest-TestShelveInstance-1085488420 tempest-TestShelveInstance-1085488420-project] 10.222.0.50 "GET /compute/v2.1/servers/60d69c7d-69e4-4b2a-b41c-692867a6e28d" status: 200 len: 1254 microversion: 2.1 time: 0.151234 Sep 24 05:04:53.084568 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 236/503] 10.222.0.50 () {58 vars in 1236 bytes} [Sat Sep 24 05:04:52 2022] GET /compute/v2.1/servers/60d69c7d-69e4-4b2a-b41c-692867a6e28d => generated 1254 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 05:04:54.106780 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-f9c80476-15a3-4d9f-a5e5-fc4c326e8865 tempest-TestShelveInstance-1085488420 tempest-TestShelveInstance-1085488420-project] Calling method '>' {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:04:54.107325 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.compute.api [None req-f9c80476-15a3-4d9f-a5e5-fc4c326e8865 tempest-TestShelveInstance-1085488420 tempest-TestShelveInstance-1085488420-project] [instance: 60d69c7d-69e4-4b2a-b41c-692867a6e28d] Fetching instance by UUID {{(pid=120594) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:04:54.113423 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-f9c80476-15a3-4d9f-a5e5-fc4c326e8865 tempest-TestShelveInstance-1085488420 tempest-TestShelveInstance-1085488420-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:04:54.113895 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-f9c80476-15a3-4d9f-a5e5-fc4c326e8865 tempest-TestShelveInstance-1085488420 tempest-TestShelveInstance-1085488420-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:04:54.114348 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-f9c80476-15a3-4d9f-a5e5-fc4c326e8865 tempest-TestShelveInstance-1085488420 tempest-TestShelveInstance-1085488420-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:04:54.115025 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-f9c80476-15a3-4d9f-a5e5-fc4c326e8865 tempest-TestShelveInstance-1085488420 tempest-TestShelveInstance-1085488420-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:04:54.115467 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-f9c80476-15a3-4d9f-a5e5-fc4c326e8865 tempest-TestShelveInstance-1085488420 tempest-TestShelveInstance-1085488420-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:04:54.115889 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-f9c80476-15a3-4d9f-a5e5-fc4c326e8865 tempest-TestShelveInstance-1085488420 tempest-TestShelveInstance-1085488420-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:04:54.243722 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.policy [None req-f9c80476-15a3-4d9f-a5e5-fc4c326e8865 tempest-TestShelveInstance-1085488420 tempest-TestShelveInstance-1085488420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8fe3c5c28964b768b2c0023fc62f163', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd3d02b11bdf45fe99687fda3d1078cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:04:54.251627 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [None req-f9c80476-15a3-4d9f-a5e5-fc4c326e8865 tempest-TestShelveInstance-1085488420 tempest-TestShelveInstance-1085488420-project] 10.222.0.50 "GET /compute/v2.1/servers/60d69c7d-69e4-4b2a-b41c-692867a6e28d" status: 200 len: 1254 microversion: 2.1 time: 0.148805 Sep 24 05:04:54.252697 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 268/504] 10.222.0.50 () {58 vars in 1236 bytes} [Sat Sep 24 05:04:54 2022] GET /compute/v2.1/servers/60d69c7d-69e4-4b2a-b41c-692867a6e28d => generated 1254 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 05:04:55.276285 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-9c57befa-ea5b-4a35-b564-693a610bbadf tempest-TestShelveInstance-1085488420 tempest-TestShelveInstance-1085488420-project] Calling method '>' {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:04:55.276926 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.compute.api [None req-9c57befa-ea5b-4a35-b564-693a610bbadf tempest-TestShelveInstance-1085488420 tempest-TestShelveInstance-1085488420-project] [instance: 60d69c7d-69e4-4b2a-b41c-692867a6e28d] Fetching instance by UUID {{(pid=120593) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:04:55.284304 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-9c57befa-ea5b-4a35-b564-693a610bbadf tempest-TestShelveInstance-1085488420 tempest-TestShelveInstance-1085488420-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:04:55.284797 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-9c57befa-ea5b-4a35-b564-693a610bbadf tempest-TestShelveInstance-1085488420 tempest-TestShelveInstance-1085488420-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:04:55.285234 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-9c57befa-ea5b-4a35-b564-693a610bbadf tempest-TestShelveInstance-1085488420 tempest-TestShelveInstance-1085488420-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:04:55.285944 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-9c57befa-ea5b-4a35-b564-693a610bbadf tempest-TestShelveInstance-1085488420 tempest-TestShelveInstance-1085488420-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:04:55.286434 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-9c57befa-ea5b-4a35-b564-693a610bbadf tempest-TestShelveInstance-1085488420 tempest-TestShelveInstance-1085488420-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:04:55.286861 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-9c57befa-ea5b-4a35-b564-693a610bbadf tempest-TestShelveInstance-1085488420 tempest-TestShelveInstance-1085488420-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:04:55.424753 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-9c57befa-ea5b-4a35-b564-693a610bbadf tempest-TestShelveInstance-1085488420 tempest-TestShelveInstance-1085488420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8fe3c5c28964b768b2c0023fc62f163', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd3d02b11bdf45fe99687fda3d1078cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:04:55.432801 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-9c57befa-ea5b-4a35-b564-693a610bbadf tempest-TestShelveInstance-1085488420 tempest-TestShelveInstance-1085488420-project] 10.222.0.50 "GET /compute/v2.1/servers/60d69c7d-69e4-4b2a-b41c-692867a6e28d" status: 200 len: 1254 microversion: 2.1 time: 0.160502 Sep 24 05:04:55.433449 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 237/505] 10.222.0.50 () {58 vars in 1236 bytes} [Sat Sep 24 05:04:55 2022] GET /compute/v2.1/servers/60d69c7d-69e4-4b2a-b41c-692867a6e28d => generated 1254 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 05:04:56.455373 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-4311520e-9247-49d7-8f56-8ecca1bacae3 tempest-TestShelveInstance-1085488420 tempest-TestShelveInstance-1085488420-project] Calling method '>' {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:04:56.456483 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.compute.api [None req-4311520e-9247-49d7-8f56-8ecca1bacae3 tempest-TestShelveInstance-1085488420 tempest-TestShelveInstance-1085488420-project] [instance: 60d69c7d-69e4-4b2a-b41c-692867a6e28d] Fetching instance by UUID {{(pid=120594) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:04:56.462302 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-4311520e-9247-49d7-8f56-8ecca1bacae3 tempest-TestShelveInstance-1085488420 tempest-TestShelveInstance-1085488420-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:04:56.462771 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-4311520e-9247-49d7-8f56-8ecca1bacae3 tempest-TestShelveInstance-1085488420 tempest-TestShelveInstance-1085488420-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:04:56.463197 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-4311520e-9247-49d7-8f56-8ecca1bacae3 tempest-TestShelveInstance-1085488420 tempest-TestShelveInstance-1085488420-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:04:56.463909 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-4311520e-9247-49d7-8f56-8ecca1bacae3 tempest-TestShelveInstance-1085488420 tempest-TestShelveInstance-1085488420-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:04:56.464351 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-4311520e-9247-49d7-8f56-8ecca1bacae3 tempest-TestShelveInstance-1085488420 tempest-TestShelveInstance-1085488420-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:04:56.464761 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-4311520e-9247-49d7-8f56-8ecca1bacae3 tempest-TestShelveInstance-1085488420 tempest-TestShelveInstance-1085488420-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:04:56.594617 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.policy [None req-4311520e-9247-49d7-8f56-8ecca1bacae3 tempest-TestShelveInstance-1085488420 tempest-TestShelveInstance-1085488420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8fe3c5c28964b768b2c0023fc62f163', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd3d02b11bdf45fe99687fda3d1078cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:04:56.602229 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [None req-4311520e-9247-49d7-8f56-8ecca1bacae3 tempest-TestShelveInstance-1085488420 tempest-TestShelveInstance-1085488420-project] 10.222.0.50 "GET /compute/v2.1/servers/60d69c7d-69e4-4b2a-b41c-692867a6e28d" status: 200 len: 1254 microversion: 2.1 time: 0.150630 Sep 24 05:04:56.602787 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 269/506] 10.222.0.50 () {58 vars in 1236 bytes} [Sat Sep 24 05:04:56 2022] GET /compute/v2.1/servers/60d69c7d-69e4-4b2a-b41c-692867a6e28d => generated 1254 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 05:04:57.624609 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-ccf09944-d632-47a1-9019-77e47911b314 tempest-TestShelveInstance-1085488420 tempest-TestShelveInstance-1085488420-project] Calling method '>' {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:04:57.625216 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.compute.api [None req-ccf09944-d632-47a1-9019-77e47911b314 tempest-TestShelveInstance-1085488420 tempest-TestShelveInstance-1085488420-project] [instance: 60d69c7d-69e4-4b2a-b41c-692867a6e28d] Fetching instance by UUID {{(pid=120593) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:04:57.627591 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG dbcounter [-] [120593] Writing DB stats nova_cell0:SELECT=2 {{(pid=120593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 05:04:57.633115 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-ccf09944-d632-47a1-9019-77e47911b314 tempest-TestShelveInstance-1085488420 tempest-TestShelveInstance-1085488420-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:04:57.633598 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-ccf09944-d632-47a1-9019-77e47911b314 tempest-TestShelveInstance-1085488420 tempest-TestShelveInstance-1085488420-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:04:57.634056 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-ccf09944-d632-47a1-9019-77e47911b314 tempest-TestShelveInstance-1085488420 tempest-TestShelveInstance-1085488420-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:04:57.635094 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-ccf09944-d632-47a1-9019-77e47911b314 tempest-TestShelveInstance-1085488420 tempest-TestShelveInstance-1085488420-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:04:57.635557 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-ccf09944-d632-47a1-9019-77e47911b314 tempest-TestShelveInstance-1085488420 tempest-TestShelveInstance-1085488420-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:04:57.635984 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-ccf09944-d632-47a1-9019-77e47911b314 tempest-TestShelveInstance-1085488420 tempest-TestShelveInstance-1085488420-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:04:57.967884 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-ccf09944-d632-47a1-9019-77e47911b314 tempest-TestShelveInstance-1085488420 tempest-TestShelveInstance-1085488420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8fe3c5c28964b768b2c0023fc62f163', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd3d02b11bdf45fe99687fda3d1078cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:04:57.976154 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-ccf09944-d632-47a1-9019-77e47911b314 tempest-TestShelveInstance-1085488420 tempest-TestShelveInstance-1085488420-project] 10.222.0.50 "GET /compute/v2.1/servers/60d69c7d-69e4-4b2a-b41c-692867a6e28d" status: 200 len: 1254 microversion: 2.1 time: 0.355419 Sep 24 05:04:57.976713 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 238/507] 10.222.0.50 () {58 vars in 1236 bytes} [Sat Sep 24 05:04:57 2022] GET /compute/v2.1/servers/60d69c7d-69e4-4b2a-b41c-692867a6e28d => generated 1254 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 05:04:58.998346 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-af130d4f-8d0c-4fe0-ab8a-d6e5084c02b1 tempest-TestShelveInstance-1085488420 tempest-TestShelveInstance-1085488420-project] Calling method '>' {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:04:58.998886 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.compute.api [None req-af130d4f-8d0c-4fe0-ab8a-d6e5084c02b1 tempest-TestShelveInstance-1085488420 tempest-TestShelveInstance-1085488420-project] [instance: 60d69c7d-69e4-4b2a-b41c-692867a6e28d] Fetching instance by UUID {{(pid=120594) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:04:59.000721 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG dbcounter [-] [120594] Writing DB stats nova_cell0:SELECT=2 {{(pid=120594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 05:04:59.001492 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG dbcounter [-] [120594] Writing DB stats nova_cell0:SELECT=6 {{(pid=120594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 05:04:59.007589 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-af130d4f-8d0c-4fe0-ab8a-d6e5084c02b1 tempest-TestShelveInstance-1085488420 tempest-TestShelveInstance-1085488420-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:04:59.008066 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-af130d4f-8d0c-4fe0-ab8a-d6e5084c02b1 tempest-TestShelveInstance-1085488420 tempest-TestShelveInstance-1085488420-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:04:59.008496 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-af130d4f-8d0c-4fe0-ab8a-d6e5084c02b1 tempest-TestShelveInstance-1085488420 tempest-TestShelveInstance-1085488420-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:04:59.009171 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-af130d4f-8d0c-4fe0-ab8a-d6e5084c02b1 tempest-TestShelveInstance-1085488420 tempest-TestShelveInstance-1085488420-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:04:59.009613 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-af130d4f-8d0c-4fe0-ab8a-d6e5084c02b1 tempest-TestShelveInstance-1085488420 tempest-TestShelveInstance-1085488420-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:04:59.010052 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-af130d4f-8d0c-4fe0-ab8a-d6e5084c02b1 tempest-TestShelveInstance-1085488420 tempest-TestShelveInstance-1085488420-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:04:59.014023 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG dbcounter [-] [120594] Writing DB stats nova_cell1:SELECT=74 {{(pid=120594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 05:04:59.137854 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.policy [None req-af130d4f-8d0c-4fe0-ab8a-d6e5084c02b1 tempest-TestShelveInstance-1085488420 tempest-TestShelveInstance-1085488420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8fe3c5c28964b768b2c0023fc62f163', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd3d02b11bdf45fe99687fda3d1078cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:04:59.145501 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [None req-af130d4f-8d0c-4fe0-ab8a-d6e5084c02b1 tempest-TestShelveInstance-1085488420 tempest-TestShelveInstance-1085488420-project] 10.222.0.50 "GET /compute/v2.1/servers/60d69c7d-69e4-4b2a-b41c-692867a6e28d" status: 200 len: 1254 microversion: 2.1 time: 0.151215 Sep 24 05:04:59.146364 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 270/508] 10.222.0.50 () {58 vars in 1236 bytes} [Sat Sep 24 05:04:58 2022] GET /compute/v2.1/servers/60d69c7d-69e4-4b2a-b41c-692867a6e28d => generated 1254 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 05:05:00.168019 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-8c277658-2e37-4361-8715-1fdbbd63012c tempest-TestShelveInstance-1085488420 tempest-TestShelveInstance-1085488420-project] Calling method '>' {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:05:00.168616 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.compute.api [None req-8c277658-2e37-4361-8715-1fdbbd63012c tempest-TestShelveInstance-1085488420 tempest-TestShelveInstance-1085488420-project] [instance: 60d69c7d-69e4-4b2a-b41c-692867a6e28d] Fetching instance by UUID {{(pid=120593) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:05:00.175161 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-8c277658-2e37-4361-8715-1fdbbd63012c tempest-TestShelveInstance-1085488420 tempest-TestShelveInstance-1085488420-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:05:00.175633 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-8c277658-2e37-4361-8715-1fdbbd63012c tempest-TestShelveInstance-1085488420 tempest-TestShelveInstance-1085488420-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:05:00.176061 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-8c277658-2e37-4361-8715-1fdbbd63012c tempest-TestShelveInstance-1085488420 tempest-TestShelveInstance-1085488420-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:05:00.176736 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-8c277658-2e37-4361-8715-1fdbbd63012c tempest-TestShelveInstance-1085488420 tempest-TestShelveInstance-1085488420-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:05:00.177177 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-8c277658-2e37-4361-8715-1fdbbd63012c tempest-TestShelveInstance-1085488420 tempest-TestShelveInstance-1085488420-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:05:00.177592 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-8c277658-2e37-4361-8715-1fdbbd63012c tempest-TestShelveInstance-1085488420 tempest-TestShelveInstance-1085488420-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:05:00.307476 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-8c277658-2e37-4361-8715-1fdbbd63012c tempest-TestShelveInstance-1085488420 tempest-TestShelveInstance-1085488420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8fe3c5c28964b768b2c0023fc62f163', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd3d02b11bdf45fe99687fda3d1078cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:05:00.315572 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-8c277658-2e37-4361-8715-1fdbbd63012c tempest-TestShelveInstance-1085488420 tempest-TestShelveInstance-1085488420-project] 10.222.0.50 "GET /compute/v2.1/servers/60d69c7d-69e4-4b2a-b41c-692867a6e28d" status: 200 len: 1254 microversion: 2.1 time: 0.150901 Sep 24 05:05:00.316122 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 239/509] 10.222.0.50 () {58 vars in 1236 bytes} [Sat Sep 24 05:05:00 2022] GET /compute/v2.1/servers/60d69c7d-69e4-4b2a-b41c-692867a6e28d => generated 1254 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 05:05:01.338360 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-cfac6785-2744-44dc-84b0-f1590d68d2bb tempest-TestShelveInstance-1085488420 tempest-TestShelveInstance-1085488420-project] Calling method '>' {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:05:01.339003 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.compute.api [None req-cfac6785-2744-44dc-84b0-f1590d68d2bb tempest-TestShelveInstance-1085488420 tempest-TestShelveInstance-1085488420-project] [instance: 60d69c7d-69e4-4b2a-b41c-692867a6e28d] Fetching instance by UUID {{(pid=120594) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:05:01.344846 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-cfac6785-2744-44dc-84b0-f1590d68d2bb tempest-TestShelveInstance-1085488420 tempest-TestShelveInstance-1085488420-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:05:01.345320 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-cfac6785-2744-44dc-84b0-f1590d68d2bb tempest-TestShelveInstance-1085488420 tempest-TestShelveInstance-1085488420-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:05:01.345750 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-cfac6785-2744-44dc-84b0-f1590d68d2bb tempest-TestShelveInstance-1085488420 tempest-TestShelveInstance-1085488420-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:05:01.346468 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-cfac6785-2744-44dc-84b0-f1590d68d2bb tempest-TestShelveInstance-1085488420 tempest-TestShelveInstance-1085488420-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:05:01.346919 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-cfac6785-2744-44dc-84b0-f1590d68d2bb tempest-TestShelveInstance-1085488420 tempest-TestShelveInstance-1085488420-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:05:01.347334 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-cfac6785-2744-44dc-84b0-f1590d68d2bb tempest-TestShelveInstance-1085488420 tempest-TestShelveInstance-1085488420-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:05:01.475255 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.policy [None req-cfac6785-2744-44dc-84b0-f1590d68d2bb tempest-TestShelveInstance-1085488420 tempest-TestShelveInstance-1085488420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8fe3c5c28964b768b2c0023fc62f163', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd3d02b11bdf45fe99687fda3d1078cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:05:01.483242 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [None req-cfac6785-2744-44dc-84b0-f1590d68d2bb tempest-TestShelveInstance-1085488420 tempest-TestShelveInstance-1085488420-project] 10.222.0.50 "GET /compute/v2.1/servers/60d69c7d-69e4-4b2a-b41c-692867a6e28d" status: 200 len: 1254 microversion: 2.1 time: 0.148820 Sep 24 05:05:01.483818 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 271/510] 10.222.0.50 () {58 vars in 1236 bytes} [Sat Sep 24 05:05:01 2022] GET /compute/v2.1/servers/60d69c7d-69e4-4b2a-b41c-692867a6e28d => generated 1254 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 05:05:02.506786 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-fa274c10-37ff-4f36-bddd-8bf9f48df7e5 tempest-TestShelveInstance-1085488420 tempest-TestShelveInstance-1085488420-project] Calling method '>' {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:05:02.507299 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.compute.api [None req-fa274c10-37ff-4f36-bddd-8bf9f48df7e5 tempest-TestShelveInstance-1085488420 tempest-TestShelveInstance-1085488420-project] [instance: 60d69c7d-69e4-4b2a-b41c-692867a6e28d] Fetching instance by UUID {{(pid=120593) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:05:02.513581 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-fa274c10-37ff-4f36-bddd-8bf9f48df7e5 tempest-TestShelveInstance-1085488420 tempest-TestShelveInstance-1085488420-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:05:02.514084 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-fa274c10-37ff-4f36-bddd-8bf9f48df7e5 tempest-TestShelveInstance-1085488420 tempest-TestShelveInstance-1085488420-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:05:02.514515 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-fa274c10-37ff-4f36-bddd-8bf9f48df7e5 tempest-TestShelveInstance-1085488420 tempest-TestShelveInstance-1085488420-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:05:02.515192 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-fa274c10-37ff-4f36-bddd-8bf9f48df7e5 tempest-TestShelveInstance-1085488420 tempest-TestShelveInstance-1085488420-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:05:02.515638 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-fa274c10-37ff-4f36-bddd-8bf9f48df7e5 tempest-TestShelveInstance-1085488420 tempest-TestShelveInstance-1085488420-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:05:02.516052 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-fa274c10-37ff-4f36-bddd-8bf9f48df7e5 tempest-TestShelveInstance-1085488420 tempest-TestShelveInstance-1085488420-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:05:02.650849 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-fa274c10-37ff-4f36-bddd-8bf9f48df7e5 tempest-TestShelveInstance-1085488420 tempest-TestShelveInstance-1085488420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8fe3c5c28964b768b2c0023fc62f163', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd3d02b11bdf45fe99687fda3d1078cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:05:02.659163 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-fa274c10-37ff-4f36-bddd-8bf9f48df7e5 tempest-TestShelveInstance-1085488420 tempest-TestShelveInstance-1085488420-project] 10.222.0.50 "GET /compute/v2.1/servers/60d69c7d-69e4-4b2a-b41c-692867a6e28d" status: 200 len: 1254 microversion: 2.1 time: 0.156786 Sep 24 05:05:02.659742 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 240/511] 10.222.0.50 () {58 vars in 1236 bytes} [Sat Sep 24 05:05:02 2022] GET /compute/v2.1/servers/60d69c7d-69e4-4b2a-b41c-692867a6e28d => generated 1254 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 05:05:03.682723 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-7f0e3d53-65fa-494f-8dea-9e999ac50021 tempest-TestShelveInstance-1085488420 tempest-TestShelveInstance-1085488420-project] Calling method '>' {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:05:03.683324 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.compute.api [None req-7f0e3d53-65fa-494f-8dea-9e999ac50021 tempest-TestShelveInstance-1085488420 tempest-TestShelveInstance-1085488420-project] [instance: 60d69c7d-69e4-4b2a-b41c-692867a6e28d] Fetching instance by UUID {{(pid=120594) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:05:03.689149 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-7f0e3d53-65fa-494f-8dea-9e999ac50021 tempest-TestShelveInstance-1085488420 tempest-TestShelveInstance-1085488420-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:05:03.689619 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-7f0e3d53-65fa-494f-8dea-9e999ac50021 tempest-TestShelveInstance-1085488420 tempest-TestShelveInstance-1085488420-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:05:03.690071 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-7f0e3d53-65fa-494f-8dea-9e999ac50021 tempest-TestShelveInstance-1085488420 tempest-TestShelveInstance-1085488420-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:05:03.691353 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-7f0e3d53-65fa-494f-8dea-9e999ac50021 tempest-TestShelveInstance-1085488420 tempest-TestShelveInstance-1085488420-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:05:03.691794 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-7f0e3d53-65fa-494f-8dea-9e999ac50021 tempest-TestShelveInstance-1085488420 tempest-TestShelveInstance-1085488420-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:05:03.692210 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-7f0e3d53-65fa-494f-8dea-9e999ac50021 tempest-TestShelveInstance-1085488420 tempest-TestShelveInstance-1085488420-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:05:03.818880 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.policy [None req-7f0e3d53-65fa-494f-8dea-9e999ac50021 tempest-TestShelveInstance-1085488420 tempest-TestShelveInstance-1085488420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8fe3c5c28964b768b2c0023fc62f163', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd3d02b11bdf45fe99687fda3d1078cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:05:03.826360 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [None req-7f0e3d53-65fa-494f-8dea-9e999ac50021 tempest-TestShelveInstance-1085488420 tempest-TestShelveInstance-1085488420-project] 10.222.0.50 "GET /compute/v2.1/servers/60d69c7d-69e4-4b2a-b41c-692867a6e28d" status: 200 len: 1254 microversion: 2.1 time: 0.147436 Sep 24 05:05:03.826921 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 272/512] 10.222.0.50 () {58 vars in 1236 bytes} [Sat Sep 24 05:05:03 2022] GET /compute/v2.1/servers/60d69c7d-69e4-4b2a-b41c-692867a6e28d => generated 1254 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 05:05:04.063693 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [req-355e8043-dac7-44a2-971d-47fba126a9d5 req-106b10cf-36e4-40e2-b38b-63d6e6e3c7e8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "60d69c7d-69e4-4b2a-b41c-692867a6e28d", "name": "network-vif-plugged", "status": "completed", "tag": "fab1bdaa-696a-4cf2-b4c6-ca1ee5692022"}]} {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 05:05:04.074209 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [req-355e8043-dac7-44a2-971d-47fba126a9d5 req-106b10cf-36e4-40e2-b38b-63d6e6e3c7e8 service nova] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:05:04.074685 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [req-355e8043-dac7-44a2-971d-47fba126a9d5 req-106b10cf-36e4-40e2-b38b-63d6e6e3c7e8 service nova] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:05:04.075107 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [req-355e8043-dac7-44a2-971d-47fba126a9d5 req-106b10cf-36e4-40e2-b38b-63d6e6e3c7e8 service nova] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:05:04.086233 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.compute.server_external_events [req-355e8043-dac7-44a2-971d-47fba126a9d5 req-106b10cf-36e4-40e2-b38b-63d6e6e3c7e8 service nova] Creating event network-vif-plugged:fab1bdaa-696a-4cf2-b4c6-ca1ee5692022 for instance 60d69c7d-69e4-4b2a-b41c-692867a6e28d on hv-cinder-85918 Sep 24 05:05:04.091063 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [req-355e8043-dac7-44a2-971d-47fba126a9d5 req-106b10cf-36e4-40e2-b38b-63d6e6e3c7e8 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031078 Sep 24 05:05:04.091638 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 241/513] 10.222.0.50 () {64 vars in 1317 bytes} [Sat Sep 24 05:05:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 05:05:04.849265 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-7c223b70-a1a7-43e3-9805-2af5ea78a3ae tempest-TestShelveInstance-1085488420 tempest-TestShelveInstance-1085488420-project] Calling method '>' {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:05:04.849870 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.compute.api [None req-7c223b70-a1a7-43e3-9805-2af5ea78a3ae tempest-TestShelveInstance-1085488420 tempest-TestShelveInstance-1085488420-project] [instance: 60d69c7d-69e4-4b2a-b41c-692867a6e28d] Fetching instance by UUID {{(pid=120594) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:05:04.855773 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-7c223b70-a1a7-43e3-9805-2af5ea78a3ae tempest-TestShelveInstance-1085488420 tempest-TestShelveInstance-1085488420-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:05:04.856251 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-7c223b70-a1a7-43e3-9805-2af5ea78a3ae tempest-TestShelveInstance-1085488420 tempest-TestShelveInstance-1085488420-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:05:04.856683 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-7c223b70-a1a7-43e3-9805-2af5ea78a3ae tempest-TestShelveInstance-1085488420 tempest-TestShelveInstance-1085488420-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:05:04.857372 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-7c223b70-a1a7-43e3-9805-2af5ea78a3ae tempest-TestShelveInstance-1085488420 tempest-TestShelveInstance-1085488420-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:05:04.857815 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-7c223b70-a1a7-43e3-9805-2af5ea78a3ae tempest-TestShelveInstance-1085488420 tempest-TestShelveInstance-1085488420-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:05:04.858261 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-7c223b70-a1a7-43e3-9805-2af5ea78a3ae tempest-TestShelveInstance-1085488420 tempest-TestShelveInstance-1085488420-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:05:04.986332 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.policy [None req-7c223b70-a1a7-43e3-9805-2af5ea78a3ae tempest-TestShelveInstance-1085488420 tempest-TestShelveInstance-1085488420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8fe3c5c28964b768b2c0023fc62f163', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd3d02b11bdf45fe99687fda3d1078cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:05:04.994618 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [None req-7c223b70-a1a7-43e3-9805-2af5ea78a3ae tempest-TestShelveInstance-1085488420 tempest-TestShelveInstance-1085488420-project] 10.222.0.50 "GET /compute/v2.1/servers/60d69c7d-69e4-4b2a-b41c-692867a6e28d" status: 200 len: 1254 microversion: 2.1 time: 0.149751 Sep 24 05:05:04.995178 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 273/514] 10.222.0.50 () {58 vars in 1236 bytes} [Sat Sep 24 05:05:04 2022] GET /compute/v2.1/servers/60d69c7d-69e4-4b2a-b41c-692867a6e28d => generated 1254 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 05:05:06.017526 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-fb8776dd-e7b0-40cb-b542-6192ffb3ab4f tempest-TestShelveInstance-1085488420 tempest-TestShelveInstance-1085488420-project] Calling method '>' {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:05:06.018789 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.compute.api [None req-fb8776dd-e7b0-40cb-b542-6192ffb3ab4f tempest-TestShelveInstance-1085488420 tempest-TestShelveInstance-1085488420-project] [instance: 60d69c7d-69e4-4b2a-b41c-692867a6e28d] Fetching instance by UUID {{(pid=120593) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:05:06.024967 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-fb8776dd-e7b0-40cb-b542-6192ffb3ab4f tempest-TestShelveInstance-1085488420 tempest-TestShelveInstance-1085488420-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:05:06.025445 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-fb8776dd-e7b0-40cb-b542-6192ffb3ab4f tempest-TestShelveInstance-1085488420 tempest-TestShelveInstance-1085488420-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:05:06.025874 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-fb8776dd-e7b0-40cb-b542-6192ffb3ab4f tempest-TestShelveInstance-1085488420 tempest-TestShelveInstance-1085488420-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:05:06.026579 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-fb8776dd-e7b0-40cb-b542-6192ffb3ab4f tempest-TestShelveInstance-1085488420 tempest-TestShelveInstance-1085488420-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:05:06.027028 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-fb8776dd-e7b0-40cb-b542-6192ffb3ab4f tempest-TestShelveInstance-1085488420 tempest-TestShelveInstance-1085488420-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:05:06.027447 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-fb8776dd-e7b0-40cb-b542-6192ffb3ab4f tempest-TestShelveInstance-1085488420 tempest-TestShelveInstance-1085488420-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:05:06.158541 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-fb8776dd-e7b0-40cb-b542-6192ffb3ab4f tempest-TestShelveInstance-1085488420 tempest-TestShelveInstance-1085488420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8fe3c5c28964b768b2c0023fc62f163', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd3d02b11bdf45fe99687fda3d1078cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:05:06.166783 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-fb8776dd-e7b0-40cb-b542-6192ffb3ab4f tempest-TestShelveInstance-1085488420 tempest-TestShelveInstance-1085488420-project] 10.222.0.50 "GET /compute/v2.1/servers/60d69c7d-69e4-4b2a-b41c-692867a6e28d" status: 200 len: 1254 microversion: 2.1 time: 0.153957 Sep 24 05:05:06.167329 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 242/515] 10.222.0.50 () {58 vars in 1236 bytes} [Sat Sep 24 05:05:06 2022] GET /compute/v2.1/servers/60d69c7d-69e4-4b2a-b41c-692867a6e28d => generated 1254 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 05:05:07.189614 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-842e09eb-ec3d-481f-a3c1-4040942c356e tempest-TestShelveInstance-1085488420 tempest-TestShelveInstance-1085488420-project] Calling method '>' {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:05:07.190253 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.compute.api [None req-842e09eb-ec3d-481f-a3c1-4040942c356e tempest-TestShelveInstance-1085488420 tempest-TestShelveInstance-1085488420-project] [instance: 60d69c7d-69e4-4b2a-b41c-692867a6e28d] Fetching instance by UUID {{(pid=120594) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:05:07.196138 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-842e09eb-ec3d-481f-a3c1-4040942c356e tempest-TestShelveInstance-1085488420 tempest-TestShelveInstance-1085488420-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:05:07.196610 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-842e09eb-ec3d-481f-a3c1-4040942c356e tempest-TestShelveInstance-1085488420 tempest-TestShelveInstance-1085488420-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:05:07.197039 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-842e09eb-ec3d-481f-a3c1-4040942c356e tempest-TestShelveInstance-1085488420 tempest-TestShelveInstance-1085488420-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:05:07.197718 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-842e09eb-ec3d-481f-a3c1-4040942c356e tempest-TestShelveInstance-1085488420 tempest-TestShelveInstance-1085488420-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:05:07.198196 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-842e09eb-ec3d-481f-a3c1-4040942c356e tempest-TestShelveInstance-1085488420 tempest-TestShelveInstance-1085488420-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:05:07.198614 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-842e09eb-ec3d-481f-a3c1-4040942c356e tempest-TestShelveInstance-1085488420 tempest-TestShelveInstance-1085488420-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:05:07.324890 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.policy [None req-842e09eb-ec3d-481f-a3c1-4040942c356e tempest-TestShelveInstance-1085488420 tempest-TestShelveInstance-1085488420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8fe3c5c28964b768b2c0023fc62f163', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd3d02b11bdf45fe99687fda3d1078cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:05:07.332958 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [None req-842e09eb-ec3d-481f-a3c1-4040942c356e tempest-TestShelveInstance-1085488420 tempest-TestShelveInstance-1085488420-project] 10.222.0.50 "GET /compute/v2.1/servers/60d69c7d-69e4-4b2a-b41c-692867a6e28d" status: 200 len: 1437 microversion: 2.1 time: 0.146678 Sep 24 05:05:07.333516 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 274/516] 10.222.0.50 () {58 vars in 1236 bytes} [Sat Sep 24 05:05:07 2022] GET /compute/v2.1/servers/60d69c7d-69e4-4b2a-b41c-692867a6e28d => generated 1437 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 05:05:07.355812 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-a019617b-326f-4084-8d20-6460259ab366 tempest-TestShelveInstance-1085488420 tempest-TestShelveInstance-1085488420-project] Calling method '>' {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:05:07.356414 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.compute.api [None req-a019617b-326f-4084-8d20-6460259ab366 tempest-TestShelveInstance-1085488420 tempest-TestShelveInstance-1085488420-project] [instance: 60d69c7d-69e4-4b2a-b41c-692867a6e28d] Fetching instance by UUID {{(pid=120593) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:05:07.362731 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-a019617b-326f-4084-8d20-6460259ab366 tempest-TestShelveInstance-1085488420 tempest-TestShelveInstance-1085488420-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:05:07.363222 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-a019617b-326f-4084-8d20-6460259ab366 tempest-TestShelveInstance-1085488420 tempest-TestShelveInstance-1085488420-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:05:07.363628 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-a019617b-326f-4084-8d20-6460259ab366 tempest-TestShelveInstance-1085488420 tempest-TestShelveInstance-1085488420-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:05:07.364300 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-a019617b-326f-4084-8d20-6460259ab366 tempest-TestShelveInstance-1085488420 tempest-TestShelveInstance-1085488420-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:05:07.364744 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-a019617b-326f-4084-8d20-6460259ab366 tempest-TestShelveInstance-1085488420 tempest-TestShelveInstance-1085488420-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:05:07.365159 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-a019617b-326f-4084-8d20-6460259ab366 tempest-TestShelveInstance-1085488420 tempest-TestShelveInstance-1085488420-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:05:07.495900 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-a019617b-326f-4084-8d20-6460259ab366 tempest-TestShelveInstance-1085488420 tempest-TestShelveInstance-1085488420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8fe3c5c28964b768b2c0023fc62f163', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd3d02b11bdf45fe99687fda3d1078cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:05:07.503473 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-a019617b-326f-4084-8d20-6460259ab366 tempest-TestShelveInstance-1085488420 tempest-TestShelveInstance-1085488420-project] 10.222.0.50 "GET /compute/v2.1/servers/60d69c7d-69e4-4b2a-b41c-692867a6e28d" status: 200 len: 1437 microversion: 2.1 time: 0.151417 Sep 24 05:05:07.504044 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 243/517] 10.222.0.50 () {58 vars in 1236 bytes} [Sat Sep 24 05:05:07 2022] GET /compute/v2.1/servers/60d69c7d-69e4-4b2a-b41c-692867a6e28d => generated 1437 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 05:05:08.125736 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-387a4813-9dbb-4364-9674-028754696d2e tempest-VolumesSnapshotTestJSON-4159203 tempest-VolumesSnapshotTestJSON-4159203-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "3e93d75e-4fe0-4ae2-ab66-2004a6bf276c", "device": "/dev/sdb"}} {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 05:05:08.128790 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.compute.api [None req-387a4813-9dbb-4364-9674-028754696d2e tempest-VolumesSnapshotTestJSON-4159203 tempest-VolumesSnapshotTestJSON-4159203-project] [instance: 3ca6173c-2d6c-4e8f-84a7-92e40af4c8f0] Fetching instance by UUID {{(pid=120594) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:05:08.135312 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-387a4813-9dbb-4364-9674-028754696d2e tempest-VolumesSnapshotTestJSON-4159203 tempest-VolumesSnapshotTestJSON-4159203-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:05:08.135933 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-387a4813-9dbb-4364-9674-028754696d2e tempest-VolumesSnapshotTestJSON-4159203 tempest-VolumesSnapshotTestJSON-4159203-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:05:08.136436 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-387a4813-9dbb-4364-9674-028754696d2e tempest-VolumesSnapshotTestJSON-4159203 tempest-VolumesSnapshotTestJSON-4159203-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:05:08.137281 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-387a4813-9dbb-4364-9674-028754696d2e tempest-VolumesSnapshotTestJSON-4159203 tempest-VolumesSnapshotTestJSON-4159203-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:05:08.137790 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-387a4813-9dbb-4364-9674-028754696d2e tempest-VolumesSnapshotTestJSON-4159203 tempest-VolumesSnapshotTestJSON-4159203-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:05:08.138304 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-387a4813-9dbb-4364-9674-028754696d2e tempest-VolumesSnapshotTestJSON-4159203 tempest-VolumesSnapshotTestJSON-4159203-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:05:08.409483 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [None req-387a4813-9dbb-4364-9674-028754696d2e tempest-VolumesSnapshotTestJSON-4159203 tempest-VolumesSnapshotTestJSON-4159203-project] 10.222.0.50 "POST /compute/v2.1/servers/3ca6173c-2d6c-4e8f-84a7-92e40af4c8f0/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.287961 Sep 24 05:05:08.411525 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 275/518] 10.222.0.50 () {60 vars in 1323 bytes} [Sat Sep 24 05:05:08 2022] POST /compute/v2.1/servers/3ca6173c-2d6c-4e8f-84a7-92e40af4c8f0/os-volume_attachments => generated 194 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 24 05:05:09.211293 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [req-a1801e01-ac4f-4da6-9428-88fe4f3abc4c req-a53737bf-5acf-486c-9b8c-1666ec7eeb2d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "60d69c7d-69e4-4b2a-b41c-692867a6e28d", "tag": "fab1bdaa-696a-4cf2-b4c6-ca1ee5692022"}]} {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 05:05:09.217623 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG dbcounter [-] [120593] Writing DB stats nova_api:SELECT=30 {{(pid=120593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 05:05:09.221618 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [req-a1801e01-ac4f-4da6-9428-88fe4f3abc4c req-a53737bf-5acf-486c-9b8c-1666ec7eeb2d service nova] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:05:09.222128 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [req-a1801e01-ac4f-4da6-9428-88fe4f3abc4c req-a53737bf-5acf-486c-9b8c-1666ec7eeb2d service nova] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:05:09.222554 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [req-a1801e01-ac4f-4da6-9428-88fe4f3abc4c req-a53737bf-5acf-486c-9b8c-1666ec7eeb2d service nova] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:05:09.233814 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.compute.server_external_events [req-a1801e01-ac4f-4da6-9428-88fe4f3abc4c req-a53737bf-5acf-486c-9b8c-1666ec7eeb2d service nova] Creating event network-changed:fab1bdaa-696a-4cf2-b4c6-ca1ee5692022 for instance 60d69c7d-69e4-4b2a-b41c-692867a6e28d on hv-cinder-85918 Sep 24 05:05:09.238803 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [req-a1801e01-ac4f-4da6-9428-88fe4f3abc4c req-a53737bf-5acf-486c-9b8c-1666ec7eeb2d service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031668 Sep 24 05:05:09.239632 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 244/519] 10.222.0.50 () {64 vars in 1317 bytes} [Sat Sep 24 05:05:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 05:05:12.644228 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-686367a1-3c84-4c2b-953b-7cf68931c5d8 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Calling method '>' {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:05:12.644815 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.compute.api [None req-686367a1-3c84-4c2b-953b-7cf68931c5d8 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] [instance: 08fb826b-e891-46c4-990d-ca03cf3f4222] Fetching instance by UUID {{(pid=120594) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:05:12.647050 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG dbcounter [-] [120594] Writing DB stats nova_api:SELECT=39,nova_api:INSERT=3 {{(pid=120594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 05:05:12.653252 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-686367a1-3c84-4c2b-953b-7cf68931c5d8 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:05:12.653734 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-686367a1-3c84-4c2b-953b-7cf68931c5d8 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:05:12.654200 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-686367a1-3c84-4c2b-953b-7cf68931c5d8 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:05:12.654900 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-686367a1-3c84-4c2b-953b-7cf68931c5d8 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:05:12.655364 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-686367a1-3c84-4c2b-953b-7cf68931c5d8 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:05:12.655768 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-686367a1-3c84-4c2b-953b-7cf68931c5d8 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:05:12.680721 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [None req-686367a1-3c84-4c2b-953b-7cf68931c5d8 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] 10.222.0.50 "GET /compute/v2.1/servers/08fb826b-e891-46c4-990d-ca03cf3f4222/ips" status: 200 len: 151 microversion: 2.20 time: 0.041212 Sep 24 05:05:12.681238 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 276/520] 10.222.0.50 () {60 vars in 1289 bytes} [Sat Sep 24 05:05:12 2022] GET /compute/v2.1/servers/08fb826b-e891-46c4-990d-ca03cf3f4222/ips => generated 151 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 24 05:05:14.825223 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-02d8277c-73d4-439f-b68b-f1aaef50ccf8 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 05:05:14.826188 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.compute.api [None req-02d8277c-73d4-439f-b68b-f1aaef50ccf8 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] [instance: 08fb826b-e891-46c4-990d-ca03cf3f4222] Fetching instance by UUID {{(pid=120593) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:05:14.832474 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-02d8277c-73d4-439f-b68b-f1aaef50ccf8 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:05:14.833450 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-02d8277c-73d4-439f-b68b-f1aaef50ccf8 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:05:14.833930 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-02d8277c-73d4-439f-b68b-f1aaef50ccf8 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:05:14.834654 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-02d8277c-73d4-439f-b68b-f1aaef50ccf8 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:05:14.835240 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-02d8277c-73d4-439f-b68b-f1aaef50ccf8 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:05:14.835734 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-02d8277c-73d4-439f-b68b-f1aaef50ccf8 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:05:14.858702 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.objects.instance [None req-02d8277c-73d4-439f-b68b-f1aaef50ccf8 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Lazy-loading 'flavor' on Instance uuid 08fb826b-e891-46c4-990d-ca03cf3f4222 {{(pid=120593) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 24 05:05:15.046360 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-02d8277c-73d4-439f-b68b-f1aaef50ccf8 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] 10.222.0.50 "POST /compute/v2.1/servers/08fb826b-e891-46c4-990d-ca03cf3f4222/action" status: 202 len: 0 microversion: 2.20 time: 0.226421 Sep 24 05:05:15.046921 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 245/521] 10.222.0.50 () {62 vars in 1319 bytes} [Sat Sep 24 05:05:14 2022] POST /compute/v2.1/servers/08fb826b-e891-46c4-990d-ca03cf3f4222/action => generated 0 bytes in 228 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Sep 24 05:05:15.055096 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-2ade8725-db7a-4252-9d7b-d688e95896d1 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Calling method '>' {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:05:15.055697 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.compute.api [None req-2ade8725-db7a-4252-9d7b-d688e95896d1 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] [instance: 08fb826b-e891-46c4-990d-ca03cf3f4222] Fetching instance by UUID {{(pid=120594) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:05:15.062112 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-2ade8725-db7a-4252-9d7b-d688e95896d1 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:05:15.062592 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-2ade8725-db7a-4252-9d7b-d688e95896d1 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:05:15.063022 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-2ade8725-db7a-4252-9d7b-d688e95896d1 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:05:15.063717 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-2ade8725-db7a-4252-9d7b-d688e95896d1 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:05:15.064158 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-2ade8725-db7a-4252-9d7b-d688e95896d1 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:05:15.064574 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-2ade8725-db7a-4252-9d7b-d688e95896d1 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:05:15.192556 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.policy [None req-2ade8725-db7a-4252-9d7b-d688e95896d1 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0948754217fc4ff2ba0241fa35feaf90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1aaf20f480a423ea5feca81585aeeed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:05:15.200739 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.policy [None req-2ade8725-db7a-4252-9d7b-d688e95896d1 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0948754217fc4ff2ba0241fa35feaf90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1aaf20f480a423ea5feca81585aeeed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:05:15.202196 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.policy [None req-2ade8725-db7a-4252-9d7b-d688e95896d1 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0948754217fc4ff2ba0241fa35feaf90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1aaf20f480a423ea5feca81585aeeed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:05:15.203332 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [None req-2ade8725-db7a-4252-9d7b-d688e95896d1 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] 10.222.0.50 "GET /compute/v2.1/servers/08fb826b-e891-46c4-990d-ca03cf3f4222" status: 200 len: 1720 microversion: 2.20 time: 0.152110 Sep 24 05:05:15.203881 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 277/522] 10.222.0.50 () {60 vars in 1277 bytes} [Sat Sep 24 05:05:15 2022] GET /compute/v2.1/servers/08fb826b-e891-46c4-990d-ca03cf3f4222 => generated 1720 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 05:05:16.232749 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-8a2b4e63-38c4-481d-adbc-aa8a6b8fe8b8 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Calling method '>' {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:05:16.233477 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.compute.api [None req-8a2b4e63-38c4-481d-adbc-aa8a6b8fe8b8 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] [instance: 08fb826b-e891-46c4-990d-ca03cf3f4222] Fetching instance by UUID {{(pid=120593) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:05:16.241781 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-8a2b4e63-38c4-481d-adbc-aa8a6b8fe8b8 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:05:16.242302 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-8a2b4e63-38c4-481d-adbc-aa8a6b8fe8b8 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:05:16.242734 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-8a2b4e63-38c4-481d-adbc-aa8a6b8fe8b8 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:05:16.243413 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-8a2b4e63-38c4-481d-adbc-aa8a6b8fe8b8 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:05:16.243853 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-8a2b4e63-38c4-481d-adbc-aa8a6b8fe8b8 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:05:16.244282 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-8a2b4e63-38c4-481d-adbc-aa8a6b8fe8b8 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:05:16.369061 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-8a2b4e63-38c4-481d-adbc-aa8a6b8fe8b8 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0948754217fc4ff2ba0241fa35feaf90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1aaf20f480a423ea5feca81585aeeed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:05:16.376969 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-8a2b4e63-38c4-481d-adbc-aa8a6b8fe8b8 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0948754217fc4ff2ba0241fa35feaf90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1aaf20f480a423ea5feca81585aeeed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:05:16.378412 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-8a2b4e63-38c4-481d-adbc-aa8a6b8fe8b8 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0948754217fc4ff2ba0241fa35feaf90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1aaf20f480a423ea5feca81585aeeed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:05:16.379544 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-8a2b4e63-38c4-481d-adbc-aa8a6b8fe8b8 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] 10.222.0.50 "GET /compute/v2.1/servers/08fb826b-e891-46c4-990d-ca03cf3f4222" status: 200 len: 1720 microversion: 2.20 time: 0.151559 Sep 24 05:05:16.380093 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 246/523] 10.222.0.50 () {60 vars in 1277 bytes} [Sat Sep 24 05:05:16 2022] GET /compute/v2.1/servers/08fb826b-e891-46c4-990d-ca03cf3f4222 => generated 1720 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 05:05:17.404747 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-a12fb52a-be01-4358-a7a2-51e470ddad14 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Calling method '>' {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:05:17.405299 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.compute.api [None req-a12fb52a-be01-4358-a7a2-51e470ddad14 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] [instance: 08fb826b-e891-46c4-990d-ca03cf3f4222] Fetching instance by UUID {{(pid=120594) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:05:17.412239 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-a12fb52a-be01-4358-a7a2-51e470ddad14 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:05:17.412715 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-a12fb52a-be01-4358-a7a2-51e470ddad14 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:05:17.413147 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-a12fb52a-be01-4358-a7a2-51e470ddad14 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:05:17.413830 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-a12fb52a-be01-4358-a7a2-51e470ddad14 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:05:17.414308 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-a12fb52a-be01-4358-a7a2-51e470ddad14 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:05:17.414732 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-a12fb52a-be01-4358-a7a2-51e470ddad14 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:05:17.546165 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.policy [None req-a12fb52a-be01-4358-a7a2-51e470ddad14 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0948754217fc4ff2ba0241fa35feaf90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1aaf20f480a423ea5feca81585aeeed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:05:17.554981 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.policy [None req-a12fb52a-be01-4358-a7a2-51e470ddad14 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0948754217fc4ff2ba0241fa35feaf90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1aaf20f480a423ea5feca81585aeeed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:05:17.556422 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.policy [None req-a12fb52a-be01-4358-a7a2-51e470ddad14 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0948754217fc4ff2ba0241fa35feaf90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1aaf20f480a423ea5feca81585aeeed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:05:17.557599 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [None req-a12fb52a-be01-4358-a7a2-51e470ddad14 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] 10.222.0.50 "GET /compute/v2.1/servers/08fb826b-e891-46c4-990d-ca03cf3f4222" status: 200 len: 1720 microversion: 2.20 time: 0.156850 Sep 24 05:05:17.558210 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 278/524] 10.222.0.50 () {60 vars in 1277 bytes} [Sat Sep 24 05:05:17 2022] GET /compute/v2.1/servers/08fb826b-e891-46c4-990d-ca03cf3f4222 => generated 1720 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 05:05:18.582760 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-2d72ffb8-3bef-4c39-8127-1ce9d92ce2fa tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Calling method '>' {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:05:18.583366 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.compute.api [None req-2d72ffb8-3bef-4c39-8127-1ce9d92ce2fa tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] [instance: 08fb826b-e891-46c4-990d-ca03cf3f4222] Fetching instance by UUID {{(pid=120593) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:05:18.589520 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-2d72ffb8-3bef-4c39-8127-1ce9d92ce2fa tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:05:18.590015 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-2d72ffb8-3bef-4c39-8127-1ce9d92ce2fa tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:05:18.590454 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-2d72ffb8-3bef-4c39-8127-1ce9d92ce2fa tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:05:18.591167 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-2d72ffb8-3bef-4c39-8127-1ce9d92ce2fa tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:05:18.591642 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-2d72ffb8-3bef-4c39-8127-1ce9d92ce2fa tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:05:18.592062 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-2d72ffb8-3bef-4c39-8127-1ce9d92ce2fa tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:05:18.718859 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-2d72ffb8-3bef-4c39-8127-1ce9d92ce2fa tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0948754217fc4ff2ba0241fa35feaf90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1aaf20f480a423ea5feca81585aeeed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:05:18.727141 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-2d72ffb8-3bef-4c39-8127-1ce9d92ce2fa tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0948754217fc4ff2ba0241fa35feaf90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1aaf20f480a423ea5feca81585aeeed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:05:18.728561 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-2d72ffb8-3bef-4c39-8127-1ce9d92ce2fa tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0948754217fc4ff2ba0241fa35feaf90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1aaf20f480a423ea5feca81585aeeed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:05:18.729810 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-2d72ffb8-3bef-4c39-8127-1ce9d92ce2fa tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] 10.222.0.50 "GET /compute/v2.1/servers/08fb826b-e891-46c4-990d-ca03cf3f4222" status: 200 len: 1720 microversion: 2.20 time: 0.151138 Sep 24 05:05:18.730397 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 247/525] 10.222.0.50 () {60 vars in 1277 bytes} [Sat Sep 24 05:05:18 2022] GET /compute/v2.1/servers/08fb826b-e891-46c4-990d-ca03cf3f4222 => generated 1720 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 05:05:19.755600 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-8391f354-47b5-4e1d-a6ac-93472a567389 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Calling method '>' {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:05:19.756204 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.compute.api [None req-8391f354-47b5-4e1d-a6ac-93472a567389 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] [instance: 08fb826b-e891-46c4-990d-ca03cf3f4222] Fetching instance by UUID {{(pid=120594) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:05:19.762546 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-8391f354-47b5-4e1d-a6ac-93472a567389 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:05:19.763019 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-8391f354-47b5-4e1d-a6ac-93472a567389 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:05:19.763445 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-8391f354-47b5-4e1d-a6ac-93472a567389 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:05:19.764114 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-8391f354-47b5-4e1d-a6ac-93472a567389 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:05:19.764578 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-8391f354-47b5-4e1d-a6ac-93472a567389 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:05:19.764989 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-8391f354-47b5-4e1d-a6ac-93472a567389 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:05:19.893643 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.policy [None req-8391f354-47b5-4e1d-a6ac-93472a567389 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0948754217fc4ff2ba0241fa35feaf90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1aaf20f480a423ea5feca81585aeeed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:05:19.902108 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.policy [None req-8391f354-47b5-4e1d-a6ac-93472a567389 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0948754217fc4ff2ba0241fa35feaf90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1aaf20f480a423ea5feca81585aeeed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:05:19.903595 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.policy [None req-8391f354-47b5-4e1d-a6ac-93472a567389 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0948754217fc4ff2ba0241fa35feaf90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1aaf20f480a423ea5feca81585aeeed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:05:19.904671 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [None req-8391f354-47b5-4e1d-a6ac-93472a567389 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] 10.222.0.50 "GET /compute/v2.1/servers/08fb826b-e891-46c4-990d-ca03cf3f4222" status: 200 len: 1720 microversion: 2.20 time: 0.153389 Sep 24 05:05:19.905224 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 279/526] 10.222.0.50 () {60 vars in 1277 bytes} [Sat Sep 24 05:05:19 2022] GET /compute/v2.1/servers/08fb826b-e891-46c4-990d-ca03cf3f4222 => generated 1720 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 24 05:05:20.930114 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-d99ddc47-cc00-4523-b996-134979e9ec75 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Calling method '>' {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:05:20.930649 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.compute.api [None req-d99ddc47-cc00-4523-b996-134979e9ec75 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] [instance: 08fb826b-e891-46c4-990d-ca03cf3f4222] Fetching instance by UUID {{(pid=120593) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:05:20.937164 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-d99ddc47-cc00-4523-b996-134979e9ec75 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:05:20.937639 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-d99ddc47-cc00-4523-b996-134979e9ec75 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:05:20.938103 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-d99ddc47-cc00-4523-b996-134979e9ec75 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:05:20.938825 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-d99ddc47-cc00-4523-b996-134979e9ec75 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:05:20.939267 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-d99ddc47-cc00-4523-b996-134979e9ec75 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:05:20.939680 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-d99ddc47-cc00-4523-b996-134979e9ec75 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:05:20.943726 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG dbcounter [-] [120593] Writing DB stats nova_cell1:SELECT=81,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 05:05:21.067990 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-d99ddc47-cc00-4523-b996-134979e9ec75 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0948754217fc4ff2ba0241fa35feaf90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1aaf20f480a423ea5feca81585aeeed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:05:21.075929 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-d99ddc47-cc00-4523-b996-134979e9ec75 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0948754217fc4ff2ba0241fa35feaf90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1aaf20f480a423ea5feca81585aeeed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:05:21.077360 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-d99ddc47-cc00-4523-b996-134979e9ec75 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0948754217fc4ff2ba0241fa35feaf90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1aaf20f480a423ea5feca81585aeeed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:05:21.078536 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-d99ddc47-cc00-4523-b996-134979e9ec75 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] 10.222.0.50 "GET /compute/v2.1/servers/08fb826b-e891-46c4-990d-ca03cf3f4222" status: 200 len: 1720 microversion: 2.20 time: 0.152562 Sep 24 05:05:21.079092 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 248/527] 10.222.0.50 () {60 vars in 1277 bytes} [Sat Sep 24 05:05:20 2022] GET /compute/v2.1/servers/08fb826b-e891-46c4-990d-ca03cf3f4222 => generated 1720 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 05:05:22.103963 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-b621da9a-eab2-446f-92c0-790070762d35 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Calling method '>' {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:05:22.104565 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.compute.api [None req-b621da9a-eab2-446f-92c0-790070762d35 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] [instance: 08fb826b-e891-46c4-990d-ca03cf3f4222] Fetching instance by UUID {{(pid=120594) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:05:22.110827 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-b621da9a-eab2-446f-92c0-790070762d35 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:05:22.111301 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-b621da9a-eab2-446f-92c0-790070762d35 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:05:22.111727 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-b621da9a-eab2-446f-92c0-790070762d35 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:05:22.112401 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-b621da9a-eab2-446f-92c0-790070762d35 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:05:22.112843 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-b621da9a-eab2-446f-92c0-790070762d35 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:05:22.113257 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-b621da9a-eab2-446f-92c0-790070762d35 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:05:22.242800 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.policy [None req-b621da9a-eab2-446f-92c0-790070762d35 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0948754217fc4ff2ba0241fa35feaf90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1aaf20f480a423ea5feca81585aeeed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:05:22.251328 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.policy [None req-b621da9a-eab2-446f-92c0-790070762d35 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0948754217fc4ff2ba0241fa35feaf90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1aaf20f480a423ea5feca81585aeeed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:05:22.252770 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.policy [None req-b621da9a-eab2-446f-92c0-790070762d35 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0948754217fc4ff2ba0241fa35feaf90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1aaf20f480a423ea5feca81585aeeed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:05:22.253948 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [None req-b621da9a-eab2-446f-92c0-790070762d35 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] 10.222.0.50 "GET /compute/v2.1/servers/08fb826b-e891-46c4-990d-ca03cf3f4222" status: 200 len: 1720 microversion: 2.20 time: 0.153881 Sep 24 05:05:22.255106 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 280/528] 10.222.0.50 () {60 vars in 1277 bytes} [Sat Sep 24 05:05:22 2022] GET /compute/v2.1/servers/08fb826b-e891-46c4-990d-ca03cf3f4222 => generated 1720 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 05:05:23.280235 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-50760b06-b021-4b84-a631-27617c071359 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Calling method '>' {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:05:23.280834 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.compute.api [None req-50760b06-b021-4b84-a631-27617c071359 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] [instance: 08fb826b-e891-46c4-990d-ca03cf3f4222] Fetching instance by UUID {{(pid=120593) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:05:23.287197 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-50760b06-b021-4b84-a631-27617c071359 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:05:23.287674 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-50760b06-b021-4b84-a631-27617c071359 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:05:23.288108 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-50760b06-b021-4b84-a631-27617c071359 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:05:23.288788 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-50760b06-b021-4b84-a631-27617c071359 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:05:23.289233 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-50760b06-b021-4b84-a631-27617c071359 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:05:23.289652 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-50760b06-b021-4b84-a631-27617c071359 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:05:23.421205 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-50760b06-b021-4b84-a631-27617c071359 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0948754217fc4ff2ba0241fa35feaf90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1aaf20f480a423ea5feca81585aeeed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:05:23.430798 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-50760b06-b021-4b84-a631-27617c071359 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0948754217fc4ff2ba0241fa35feaf90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1aaf20f480a423ea5feca81585aeeed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:05:23.432232 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-50760b06-b021-4b84-a631-27617c071359 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0948754217fc4ff2ba0241fa35feaf90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1aaf20f480a423ea5feca81585aeeed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:05:23.433377 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-50760b06-b021-4b84-a631-27617c071359 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] 10.222.0.50 "GET /compute/v2.1/servers/08fb826b-e891-46c4-990d-ca03cf3f4222" status: 200 len: 1720 microversion: 2.20 time: 0.157061 Sep 24 05:05:23.433937 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 249/529] 10.222.0.50 () {60 vars in 1277 bytes} [Sat Sep 24 05:05:23 2022] GET /compute/v2.1/servers/08fb826b-e891-46c4-990d-ca03cf3f4222 => generated 1720 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 05:05:24.458696 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-9c57fc20-6c07-4618-b479-49fbde2d8ba8 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Calling method '>' {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:05:24.459300 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.compute.api [None req-9c57fc20-6c07-4618-b479-49fbde2d8ba8 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] [instance: 08fb826b-e891-46c4-990d-ca03cf3f4222] Fetching instance by UUID {{(pid=120594) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:05:24.465787 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-9c57fc20-6c07-4618-b479-49fbde2d8ba8 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:05:24.466288 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-9c57fc20-6c07-4618-b479-49fbde2d8ba8 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:05:24.466720 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-9c57fc20-6c07-4618-b479-49fbde2d8ba8 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:05:24.467403 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-9c57fc20-6c07-4618-b479-49fbde2d8ba8 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:05:24.467848 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-9c57fc20-6c07-4618-b479-49fbde2d8ba8 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:05:24.468266 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-9c57fc20-6c07-4618-b479-49fbde2d8ba8 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:05:24.596700 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.policy [None req-9c57fc20-6c07-4618-b479-49fbde2d8ba8 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0948754217fc4ff2ba0241fa35feaf90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1aaf20f480a423ea5feca81585aeeed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:05:24.604771 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.policy [None req-9c57fc20-6c07-4618-b479-49fbde2d8ba8 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0948754217fc4ff2ba0241fa35feaf90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1aaf20f480a423ea5feca81585aeeed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:05:24.606263 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.policy [None req-9c57fc20-6c07-4618-b479-49fbde2d8ba8 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0948754217fc4ff2ba0241fa35feaf90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1aaf20f480a423ea5feca81585aeeed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:05:24.607396 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [None req-9c57fc20-6c07-4618-b479-49fbde2d8ba8 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] 10.222.0.50 "GET /compute/v2.1/servers/08fb826b-e891-46c4-990d-ca03cf3f4222" status: 200 len: 1720 microversion: 2.20 time: 0.153250 Sep 24 05:05:24.607955 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 281/530] 10.222.0.50 () {60 vars in 1277 bytes} [Sat Sep 24 05:05:24 2022] GET /compute/v2.1/servers/08fb826b-e891-46c4-990d-ca03cf3f4222 => generated 1720 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 05:05:25.633144 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-2c359ad4-df5e-4a8b-a255-936ad2ff6a4b tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Calling method '>' {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:05:25.633745 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.compute.api [None req-2c359ad4-df5e-4a8b-a255-936ad2ff6a4b tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] [instance: 08fb826b-e891-46c4-990d-ca03cf3f4222] Fetching instance by UUID {{(pid=120593) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:05:25.640217 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-2c359ad4-df5e-4a8b-a255-936ad2ff6a4b tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:05:25.640694 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-2c359ad4-df5e-4a8b-a255-936ad2ff6a4b tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:05:25.641126 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-2c359ad4-df5e-4a8b-a255-936ad2ff6a4b tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:05:25.641811 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-2c359ad4-df5e-4a8b-a255-936ad2ff6a4b tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:05:25.642293 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-2c359ad4-df5e-4a8b-a255-936ad2ff6a4b tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:05:25.642714 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-2c359ad4-df5e-4a8b-a255-936ad2ff6a4b tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:05:25.776403 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-2c359ad4-df5e-4a8b-a255-936ad2ff6a4b tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0948754217fc4ff2ba0241fa35feaf90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1aaf20f480a423ea5feca81585aeeed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:05:25.784458 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-2c359ad4-df5e-4a8b-a255-936ad2ff6a4b tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0948754217fc4ff2ba0241fa35feaf90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1aaf20f480a423ea5feca81585aeeed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:05:25.785896 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-2c359ad4-df5e-4a8b-a255-936ad2ff6a4b tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0948754217fc4ff2ba0241fa35feaf90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1aaf20f480a423ea5feca81585aeeed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:05:25.787067 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-2c359ad4-df5e-4a8b-a255-936ad2ff6a4b tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] 10.222.0.50 "GET /compute/v2.1/servers/08fb826b-e891-46c4-990d-ca03cf3f4222" status: 200 len: 1720 microversion: 2.20 time: 0.157965 Sep 24 05:05:25.787626 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 250/531] 10.222.0.50 () {60 vars in 1277 bytes} [Sat Sep 24 05:05:25 2022] GET /compute/v2.1/servers/08fb826b-e891-46c4-990d-ca03cf3f4222 => generated 1720 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 05:05:26.811058 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-22c5dd5c-d49e-4ef6-8f0f-58693a81e711 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Calling method '>' {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:05:26.811696 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.compute.api [None req-22c5dd5c-d49e-4ef6-8f0f-58693a81e711 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] [instance: 08fb826b-e891-46c4-990d-ca03cf3f4222] Fetching instance by UUID {{(pid=120594) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:05:26.817883 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-22c5dd5c-d49e-4ef6-8f0f-58693a81e711 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:05:26.818393 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-22c5dd5c-d49e-4ef6-8f0f-58693a81e711 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:05:26.818821 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-22c5dd5c-d49e-4ef6-8f0f-58693a81e711 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:05:26.819501 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-22c5dd5c-d49e-4ef6-8f0f-58693a81e711 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:05:26.819942 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-22c5dd5c-d49e-4ef6-8f0f-58693a81e711 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:05:26.820355 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-22c5dd5c-d49e-4ef6-8f0f-58693a81e711 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:05:26.945046 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.policy [None req-22c5dd5c-d49e-4ef6-8f0f-58693a81e711 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0948754217fc4ff2ba0241fa35feaf90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1aaf20f480a423ea5feca81585aeeed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:05:26.952982 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.policy [None req-22c5dd5c-d49e-4ef6-8f0f-58693a81e711 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0948754217fc4ff2ba0241fa35feaf90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1aaf20f480a423ea5feca81585aeeed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:05:26.954433 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.policy [None req-22c5dd5c-d49e-4ef6-8f0f-58693a81e711 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0948754217fc4ff2ba0241fa35feaf90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1aaf20f480a423ea5feca81585aeeed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:05:26.955552 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [None req-22c5dd5c-d49e-4ef6-8f0f-58693a81e711 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] 10.222.0.50 "GET /compute/v2.1/servers/08fb826b-e891-46c4-990d-ca03cf3f4222" status: 200 len: 1720 microversion: 2.20 time: 0.148358 Sep 24 05:05:26.956103 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 282/532] 10.222.0.50 () {60 vars in 1277 bytes} [Sat Sep 24 05:05:26 2022] GET /compute/v2.1/servers/08fb826b-e891-46c4-990d-ca03cf3f4222 => generated 1720 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 24 05:05:27.981764 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-31b949a0-6b28-418b-ac8b-7b55a1b693e6 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Calling method '>' {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:05:27.982403 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.compute.api [None req-31b949a0-6b28-418b-ac8b-7b55a1b693e6 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] [instance: 08fb826b-e891-46c4-990d-ca03cf3f4222] Fetching instance by UUID {{(pid=120593) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:05:27.988718 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-31b949a0-6b28-418b-ac8b-7b55a1b693e6 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:05:27.989189 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-31b949a0-6b28-418b-ac8b-7b55a1b693e6 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:05:27.989619 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-31b949a0-6b28-418b-ac8b-7b55a1b693e6 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:05:27.990325 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-31b949a0-6b28-418b-ac8b-7b55a1b693e6 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:05:27.990776 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-31b949a0-6b28-418b-ac8b-7b55a1b693e6 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:05:27.991190 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-31b949a0-6b28-418b-ac8b-7b55a1b693e6 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:05:28.119455 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-31b949a0-6b28-418b-ac8b-7b55a1b693e6 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0948754217fc4ff2ba0241fa35feaf90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1aaf20f480a423ea5feca81585aeeed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:05:28.127403 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-31b949a0-6b28-418b-ac8b-7b55a1b693e6 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0948754217fc4ff2ba0241fa35feaf90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1aaf20f480a423ea5feca81585aeeed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:05:28.128829 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-31b949a0-6b28-418b-ac8b-7b55a1b693e6 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0948754217fc4ff2ba0241fa35feaf90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1aaf20f480a423ea5feca81585aeeed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:05:28.130524 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-31b949a0-6b28-418b-ac8b-7b55a1b693e6 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] 10.222.0.50 "GET /compute/v2.1/servers/08fb826b-e891-46c4-990d-ca03cf3f4222" status: 200 len: 1720 microversion: 2.20 time: 0.152667 Sep 24 05:05:28.131079 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 251/533] 10.222.0.50 () {60 vars in 1277 bytes} [Sat Sep 24 05:05:27 2022] GET /compute/v2.1/servers/08fb826b-e891-46c4-990d-ca03cf3f4222 => generated 1720 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 05:05:29.156044 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-02033157-09d0-4eef-871a-432ef3d7a7e5 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Calling method '>' {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:05:29.156650 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.compute.api [None req-02033157-09d0-4eef-871a-432ef3d7a7e5 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] [instance: 08fb826b-e891-46c4-990d-ca03cf3f4222] Fetching instance by UUID {{(pid=120594) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:05:29.163022 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-02033157-09d0-4eef-871a-432ef3d7a7e5 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:05:29.163499 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-02033157-09d0-4eef-871a-432ef3d7a7e5 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:05:29.163930 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-02033157-09d0-4eef-871a-432ef3d7a7e5 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:05:29.164610 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-02033157-09d0-4eef-871a-432ef3d7a7e5 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:05:29.165064 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-02033157-09d0-4eef-871a-432ef3d7a7e5 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:05:29.165484 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-02033157-09d0-4eef-871a-432ef3d7a7e5 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:05:29.167994 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG dbcounter [-] [120594] Writing DB stats nova_cell1:SELECT=81,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 05:05:29.292703 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.policy [None req-02033157-09d0-4eef-871a-432ef3d7a7e5 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0948754217fc4ff2ba0241fa35feaf90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1aaf20f480a423ea5feca81585aeeed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:05:29.304231 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.policy [None req-02033157-09d0-4eef-871a-432ef3d7a7e5 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0948754217fc4ff2ba0241fa35feaf90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1aaf20f480a423ea5feca81585aeeed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:05:29.305784 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.policy [None req-02033157-09d0-4eef-871a-432ef3d7a7e5 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0948754217fc4ff2ba0241fa35feaf90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1aaf20f480a423ea5feca81585aeeed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:05:29.307046 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [None req-02033157-09d0-4eef-871a-432ef3d7a7e5 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] 10.222.0.50 "GET /compute/v2.1/servers/08fb826b-e891-46c4-990d-ca03cf3f4222" status: 200 len: 1720 microversion: 2.20 time: 0.154898 Sep 24 05:05:29.307608 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 283/534] 10.222.0.50 () {60 vars in 1277 bytes} [Sat Sep 24 05:05:29 2022] GET /compute/v2.1/servers/08fb826b-e891-46c4-990d-ca03cf3f4222 => generated 1720 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 05:05:30.332501 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-2f47dab4-bddd-4af9-af36-f215d14d3429 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Calling method '>' {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:05:30.333145 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.compute.api [None req-2f47dab4-bddd-4af9-af36-f215d14d3429 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] [instance: 08fb826b-e891-46c4-990d-ca03cf3f4222] Fetching instance by UUID {{(pid=120593) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:05:30.340302 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-2f47dab4-bddd-4af9-af36-f215d14d3429 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:05:30.340780 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-2f47dab4-bddd-4af9-af36-f215d14d3429 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:05:30.341217 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-2f47dab4-bddd-4af9-af36-f215d14d3429 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:05:30.341935 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-2f47dab4-bddd-4af9-af36-f215d14d3429 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:05:30.342417 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-2f47dab4-bddd-4af9-af36-f215d14d3429 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:05:30.342840 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-2f47dab4-bddd-4af9-af36-f215d14d3429 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:05:30.468087 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-2f47dab4-bddd-4af9-af36-f215d14d3429 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0948754217fc4ff2ba0241fa35feaf90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1aaf20f480a423ea5feca81585aeeed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:05:30.476175 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-2f47dab4-bddd-4af9-af36-f215d14d3429 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0948754217fc4ff2ba0241fa35feaf90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1aaf20f480a423ea5feca81585aeeed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:05:30.477612 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-2f47dab4-bddd-4af9-af36-f215d14d3429 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0948754217fc4ff2ba0241fa35feaf90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1aaf20f480a423ea5feca81585aeeed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:05:30.478788 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-2f47dab4-bddd-4af9-af36-f215d14d3429 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] 10.222.0.50 "GET /compute/v2.1/servers/08fb826b-e891-46c4-990d-ca03cf3f4222" status: 200 len: 1720 microversion: 2.20 time: 0.150226 Sep 24 05:05:30.479347 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 252/535] 10.222.0.50 () {60 vars in 1277 bytes} [Sat Sep 24 05:05:30 2022] GET /compute/v2.1/servers/08fb826b-e891-46c4-990d-ca03cf3f4222 => generated 1720 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 05:05:31.503596 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-a094fec8-d560-4b00-be90-8447365d5f97 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Calling method '>' {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:05:31.504242 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.compute.api [None req-a094fec8-d560-4b00-be90-8447365d5f97 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] [instance: 08fb826b-e891-46c4-990d-ca03cf3f4222] Fetching instance by UUID {{(pid=120594) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:05:31.510502 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-a094fec8-d560-4b00-be90-8447365d5f97 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:05:31.510974 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-a094fec8-d560-4b00-be90-8447365d5f97 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:05:31.511400 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-a094fec8-d560-4b00-be90-8447365d5f97 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:05:31.512075 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-a094fec8-d560-4b00-be90-8447365d5f97 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:05:31.512515 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-a094fec8-d560-4b00-be90-8447365d5f97 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:05:31.512925 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-a094fec8-d560-4b00-be90-8447365d5f97 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:05:31.644843 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.policy [None req-a094fec8-d560-4b00-be90-8447365d5f97 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0948754217fc4ff2ba0241fa35feaf90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1aaf20f480a423ea5feca81585aeeed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:05:31.654329 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.policy [None req-a094fec8-d560-4b00-be90-8447365d5f97 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0948754217fc4ff2ba0241fa35feaf90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1aaf20f480a423ea5feca81585aeeed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:05:31.655799 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.policy [None req-a094fec8-d560-4b00-be90-8447365d5f97 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0948754217fc4ff2ba0241fa35feaf90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1aaf20f480a423ea5feca81585aeeed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:05:31.656985 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [None req-a094fec8-d560-4b00-be90-8447365d5f97 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] 10.222.0.50 "GET /compute/v2.1/servers/08fb826b-e891-46c4-990d-ca03cf3f4222" status: 200 len: 1720 microversion: 2.20 time: 0.157260 Sep 24 05:05:31.657547 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 284/536] 10.222.0.50 () {60 vars in 1277 bytes} [Sat Sep 24 05:05:31 2022] GET /compute/v2.1/servers/08fb826b-e891-46c4-990d-ca03cf3f4222 => generated 1720 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 05:05:32.682591 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-efe0474b-9667-419c-b161-15bd04fef154 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Calling method '>' {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:05:32.683203 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.compute.api [None req-efe0474b-9667-419c-b161-15bd04fef154 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] [instance: 08fb826b-e891-46c4-990d-ca03cf3f4222] Fetching instance by UUID {{(pid=120593) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:05:32.689667 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-efe0474b-9667-419c-b161-15bd04fef154 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:05:32.690133 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-efe0474b-9667-419c-b161-15bd04fef154 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:05:32.690574 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-efe0474b-9667-419c-b161-15bd04fef154 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:05:32.691263 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-efe0474b-9667-419c-b161-15bd04fef154 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:05:32.691716 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-efe0474b-9667-419c-b161-15bd04fef154 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:05:32.692141 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-efe0474b-9667-419c-b161-15bd04fef154 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:05:32.819283 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-efe0474b-9667-419c-b161-15bd04fef154 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0948754217fc4ff2ba0241fa35feaf90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1aaf20f480a423ea5feca81585aeeed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:05:32.827286 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-efe0474b-9667-419c-b161-15bd04fef154 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0948754217fc4ff2ba0241fa35feaf90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1aaf20f480a423ea5feca81585aeeed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:05:32.828717 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-efe0474b-9667-419c-b161-15bd04fef154 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0948754217fc4ff2ba0241fa35feaf90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1aaf20f480a423ea5feca81585aeeed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:05:32.829858 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-efe0474b-9667-419c-b161-15bd04fef154 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] 10.222.0.50 "GET /compute/v2.1/servers/08fb826b-e891-46c4-990d-ca03cf3f4222" status: 200 len: 1720 microversion: 2.20 time: 0.151164 Sep 24 05:05:32.830443 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 253/537] 10.222.0.50 () {60 vars in 1277 bytes} [Sat Sep 24 05:05:32 2022] GET /compute/v2.1/servers/08fb826b-e891-46c4-990d-ca03cf3f4222 => generated 1720 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 05:05:33.855038 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-13d98c7a-be5c-4915-9575-6580b5b68295 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Calling method '>' {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:05:33.855661 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.compute.api [None req-13d98c7a-be5c-4915-9575-6580b5b68295 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] [instance: 08fb826b-e891-46c4-990d-ca03cf3f4222] Fetching instance by UUID {{(pid=120594) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:05:33.862319 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-13d98c7a-be5c-4915-9575-6580b5b68295 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:05:33.862792 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-13d98c7a-be5c-4915-9575-6580b5b68295 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:05:33.863215 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-13d98c7a-be5c-4915-9575-6580b5b68295 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:05:33.863882 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-13d98c7a-be5c-4915-9575-6580b5b68295 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:05:33.864329 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-13d98c7a-be5c-4915-9575-6580b5b68295 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:05:33.864811 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-13d98c7a-be5c-4915-9575-6580b5b68295 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:05:33.994187 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.policy [None req-13d98c7a-be5c-4915-9575-6580b5b68295 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0948754217fc4ff2ba0241fa35feaf90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1aaf20f480a423ea5feca81585aeeed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:05:34.002347 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.policy [None req-13d98c7a-be5c-4915-9575-6580b5b68295 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0948754217fc4ff2ba0241fa35feaf90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1aaf20f480a423ea5feca81585aeeed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:05:34.003789 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.policy [None req-13d98c7a-be5c-4915-9575-6580b5b68295 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0948754217fc4ff2ba0241fa35feaf90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1aaf20f480a423ea5feca81585aeeed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:05:34.004921 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [None req-13d98c7a-be5c-4915-9575-6580b5b68295 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] 10.222.0.50 "GET /compute/v2.1/servers/08fb826b-e891-46c4-990d-ca03cf3f4222" status: 200 len: 1720 microversion: 2.20 time: 0.153777 Sep 24 05:05:34.006319 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 285/538] 10.222.0.50 () {60 vars in 1277 bytes} [Sat Sep 24 05:05:33 2022] GET /compute/v2.1/servers/08fb826b-e891-46c4-990d-ca03cf3f4222 => generated 1720 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 24 05:05:35.031397 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-06d95d0b-2081-4a05-98fd-a14cb3019f61 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Calling method '>' {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:05:35.031994 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.compute.api [None req-06d95d0b-2081-4a05-98fd-a14cb3019f61 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] [instance: 08fb826b-e891-46c4-990d-ca03cf3f4222] Fetching instance by UUID {{(pid=120593) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:05:35.039078 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-06d95d0b-2081-4a05-98fd-a14cb3019f61 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:05:35.039549 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-06d95d0b-2081-4a05-98fd-a14cb3019f61 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:05:35.039976 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-06d95d0b-2081-4a05-98fd-a14cb3019f61 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:05:35.040654 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-06d95d0b-2081-4a05-98fd-a14cb3019f61 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:05:35.041094 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-06d95d0b-2081-4a05-98fd-a14cb3019f61 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:05:35.041510 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-06d95d0b-2081-4a05-98fd-a14cb3019f61 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:05:35.180554 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-06d95d0b-2081-4a05-98fd-a14cb3019f61 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0948754217fc4ff2ba0241fa35feaf90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1aaf20f480a423ea5feca81585aeeed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:05:35.188547 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-06d95d0b-2081-4a05-98fd-a14cb3019f61 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0948754217fc4ff2ba0241fa35feaf90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1aaf20f480a423ea5feca81585aeeed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:05:35.189979 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-06d95d0b-2081-4a05-98fd-a14cb3019f61 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0948754217fc4ff2ba0241fa35feaf90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1aaf20f480a423ea5feca81585aeeed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:05:35.191226 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-06d95d0b-2081-4a05-98fd-a14cb3019f61 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] 10.222.0.50 "GET /compute/v2.1/servers/08fb826b-e891-46c4-990d-ca03cf3f4222" status: 200 len: 1720 microversion: 2.20 time: 0.163710 Sep 24 05:05:35.191775 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 254/539] 10.222.0.50 () {60 vars in 1277 bytes} [Sat Sep 24 05:05:35 2022] GET /compute/v2.1/servers/08fb826b-e891-46c4-990d-ca03cf3f4222 => generated 1720 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 05:05:36.216748 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-4dc84f29-f446-401e-9adc-1e9b1283584a tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Calling method '>' {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:05:36.217352 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.compute.api [None req-4dc84f29-f446-401e-9adc-1e9b1283584a tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] [instance: 08fb826b-e891-46c4-990d-ca03cf3f4222] Fetching instance by UUID {{(pid=120594) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:05:36.225009 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-4dc84f29-f446-401e-9adc-1e9b1283584a tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:05:36.225535 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-4dc84f29-f446-401e-9adc-1e9b1283584a tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:05:36.226139 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-4dc84f29-f446-401e-9adc-1e9b1283584a tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:05:36.226821 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-4dc84f29-f446-401e-9adc-1e9b1283584a tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:05:36.227300 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-4dc84f29-f446-401e-9adc-1e9b1283584a tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:05:36.227872 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-4dc84f29-f446-401e-9adc-1e9b1283584a tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:05:36.354167 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.policy [None req-4dc84f29-f446-401e-9adc-1e9b1283584a tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0948754217fc4ff2ba0241fa35feaf90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1aaf20f480a423ea5feca81585aeeed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:05:36.363298 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.policy [None req-4dc84f29-f446-401e-9adc-1e9b1283584a tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0948754217fc4ff2ba0241fa35feaf90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1aaf20f480a423ea5feca81585aeeed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:05:36.365303 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.policy [None req-4dc84f29-f446-401e-9adc-1e9b1283584a tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0948754217fc4ff2ba0241fa35feaf90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1aaf20f480a423ea5feca81585aeeed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:05:36.366479 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [None req-4dc84f29-f446-401e-9adc-1e9b1283584a tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] 10.222.0.50 "GET /compute/v2.1/servers/08fb826b-e891-46c4-990d-ca03cf3f4222" status: 200 len: 1720 microversion: 2.20 time: 0.153682 Sep 24 05:05:36.367041 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 286/540] 10.222.0.50 () {60 vars in 1277 bytes} [Sat Sep 24 05:05:36 2022] GET /compute/v2.1/servers/08fb826b-e891-46c4-990d-ca03cf3f4222 => generated 1720 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 05:05:37.280240 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-6ca24faa-e356-434f-93c2-572d052f22de tempest-VolumesSnapshotTestJSON-4159203 tempest-VolumesSnapshotTestJSON-4159203-project] Calling method '>' {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:05:37.280736 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.compute.api [None req-6ca24faa-e356-434f-93c2-572d052f22de tempest-VolumesSnapshotTestJSON-4159203 tempest-VolumesSnapshotTestJSON-4159203-project] [instance: 3ca6173c-2d6c-4e8f-84a7-92e40af4c8f0] Fetching instance by UUID {{(pid=120593) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:05:37.287779 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-6ca24faa-e356-434f-93c2-572d052f22de tempest-VolumesSnapshotTestJSON-4159203 tempest-VolumesSnapshotTestJSON-4159203-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:05:37.288255 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-6ca24faa-e356-434f-93c2-572d052f22de tempest-VolumesSnapshotTestJSON-4159203 tempest-VolumesSnapshotTestJSON-4159203-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:05:37.288687 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-6ca24faa-e356-434f-93c2-572d052f22de tempest-VolumesSnapshotTestJSON-4159203 tempest-VolumesSnapshotTestJSON-4159203-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:05:37.289369 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-6ca24faa-e356-434f-93c2-572d052f22de tempest-VolumesSnapshotTestJSON-4159203 tempest-VolumesSnapshotTestJSON-4159203-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:05:37.289822 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-6ca24faa-e356-434f-93c2-572d052f22de tempest-VolumesSnapshotTestJSON-4159203 tempest-VolumesSnapshotTestJSON-4159203-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:05:37.290269 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-6ca24faa-e356-434f-93c2-572d052f22de tempest-VolumesSnapshotTestJSON-4159203 tempest-VolumesSnapshotTestJSON-4159203-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:05:37.392272 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-25c936ef-9519-4478-885a-30234efa3770 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Calling method '>' {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:05:37.392883 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.compute.api [None req-25c936ef-9519-4478-885a-30234efa3770 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] [instance: 08fb826b-e891-46c4-990d-ca03cf3f4222] Fetching instance by UUID {{(pid=120594) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:05:37.400020 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-25c936ef-9519-4478-885a-30234efa3770 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:05:37.400573 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-25c936ef-9519-4478-885a-30234efa3770 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:05:37.401011 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-25c936ef-9519-4478-885a-30234efa3770 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:05:37.401767 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-25c936ef-9519-4478-885a-30234efa3770 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:05:37.402162 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-25c936ef-9519-4478-885a-30234efa3770 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:05:37.406104 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-25c936ef-9519-4478-885a-30234efa3770 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:05:37.414200 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.objects.instance [None req-6ca24faa-e356-434f-93c2-572d052f22de tempest-VolumesSnapshotTestJSON-4159203 tempest-VolumesSnapshotTestJSON-4159203-project] Lazy-loading 'services' on Instance uuid 3ca6173c-2d6c-4e8f-84a7-92e40af4c8f0 {{(pid=120593) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 24 05:05:37.530464 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-6ca24faa-e356-434f-93c2-572d052f22de tempest-VolumesSnapshotTestJSON-4159203 tempest-VolumesSnapshotTestJSON-4159203-project] 10.222.0.50 "DELETE /compute/v2.1/servers/3ca6173c-2d6c-4e8f-84a7-92e40af4c8f0/os-volume_attachments/3e93d75e-4fe0-4ae2-ab66-2004a6bf276c" status: 202 len: 0 microversion: 2.1 time: 0.253922 Sep 24 05:05:37.531235 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 255/541] 10.222.0.50 () {58 vars in 1416 bytes} [Sat Sep 24 05:05:37 2022] DELETE /compute/v2.1/servers/3ca6173c-2d6c-4e8f-84a7-92e40af4c8f0/os-volume_attachments/3e93d75e-4fe0-4ae2-ab66-2004a6bf276c => generated 0 bytes in 255 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 24 05:05:37.543404 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.policy [None req-25c936ef-9519-4478-885a-30234efa3770 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0948754217fc4ff2ba0241fa35feaf90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1aaf20f480a423ea5feca81585aeeed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:05:37.552562 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.policy [None req-25c936ef-9519-4478-885a-30234efa3770 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0948754217fc4ff2ba0241fa35feaf90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1aaf20f480a423ea5feca81585aeeed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:05:37.554134 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.policy [None req-25c936ef-9519-4478-885a-30234efa3770 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0948754217fc4ff2ba0241fa35feaf90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1aaf20f480a423ea5feca81585aeeed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:05:37.555279 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [None req-25c936ef-9519-4478-885a-30234efa3770 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] 10.222.0.50 "GET /compute/v2.1/servers/08fb826b-e891-46c4-990d-ca03cf3f4222" status: 200 len: 1720 microversion: 2.20 time: 0.167094 Sep 24 05:05:37.555837 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 287/542] 10.222.0.50 () {60 vars in 1277 bytes} [Sat Sep 24 05:05:37 2022] GET /compute/v2.1/servers/08fb826b-e891-46c4-990d-ca03cf3f4222 => generated 1720 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 24 05:05:38.582457 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-fed9725a-9d1f-4be8-ac32-127ea2598df1 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Calling method '>' {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:05:38.583146 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.compute.api [None req-fed9725a-9d1f-4be8-ac32-127ea2598df1 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] [instance: 08fb826b-e891-46c4-990d-ca03cf3f4222] Fetching instance by UUID {{(pid=120593) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:05:38.589260 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-fed9725a-9d1f-4be8-ac32-127ea2598df1 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:05:38.589739 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-fed9725a-9d1f-4be8-ac32-127ea2598df1 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:05:38.590206 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-fed9725a-9d1f-4be8-ac32-127ea2598df1 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:05:38.590887 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-fed9725a-9d1f-4be8-ac32-127ea2598df1 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:05:38.591337 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-fed9725a-9d1f-4be8-ac32-127ea2598df1 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:05:38.591758 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-fed9725a-9d1f-4be8-ac32-127ea2598df1 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:05:38.730098 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-fed9725a-9d1f-4be8-ac32-127ea2598df1 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0948754217fc4ff2ba0241fa35feaf90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1aaf20f480a423ea5feca81585aeeed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:05:38.738080 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-fed9725a-9d1f-4be8-ac32-127ea2598df1 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0948754217fc4ff2ba0241fa35feaf90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1aaf20f480a423ea5feca81585aeeed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:05:38.739510 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-fed9725a-9d1f-4be8-ac32-127ea2598df1 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0948754217fc4ff2ba0241fa35feaf90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1aaf20f480a423ea5feca81585aeeed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:05:38.741232 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-fed9725a-9d1f-4be8-ac32-127ea2598df1 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] 10.222.0.50 "GET /compute/v2.1/servers/08fb826b-e891-46c4-990d-ca03cf3f4222" status: 200 len: 1720 microversion: 2.20 time: 0.163681 Sep 24 05:05:38.741788 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 256/543] 10.222.0.50 () {60 vars in 1277 bytes} [Sat Sep 24 05:05:38 2022] GET /compute/v2.1/servers/08fb826b-e891-46c4-990d-ca03cf3f4222 => generated 1720 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 05:05:39.736185 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-a2bd0eec-f541-42c3-bee3-ab13d813f764 tempest-VolumesSnapshotTestJSON-4159203 tempest-VolumesSnapshotTestJSON-4159203-project] Calling method '>' {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:05:39.736670 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.compute.api [None req-a2bd0eec-f541-42c3-bee3-ab13d813f764 tempest-VolumesSnapshotTestJSON-4159203 tempest-VolumesSnapshotTestJSON-4159203-project] [instance: 3ca6173c-2d6c-4e8f-84a7-92e40af4c8f0] Fetching instance by UUID {{(pid=120594) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:05:39.743122 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-a2bd0eec-f541-42c3-bee3-ab13d813f764 tempest-VolumesSnapshotTestJSON-4159203 tempest-VolumesSnapshotTestJSON-4159203-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:05:39.743595 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-a2bd0eec-f541-42c3-bee3-ab13d813f764 tempest-VolumesSnapshotTestJSON-4159203 tempest-VolumesSnapshotTestJSON-4159203-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:05:39.744024 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-a2bd0eec-f541-42c3-bee3-ab13d813f764 tempest-VolumesSnapshotTestJSON-4159203 tempest-VolumesSnapshotTestJSON-4159203-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:05:39.744694 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-a2bd0eec-f541-42c3-bee3-ab13d813f764 tempest-VolumesSnapshotTestJSON-4159203 tempest-VolumesSnapshotTestJSON-4159203-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:05:39.745135 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-a2bd0eec-f541-42c3-bee3-ab13d813f764 tempest-VolumesSnapshotTestJSON-4159203 tempest-VolumesSnapshotTestJSON-4159203-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:05:39.745552 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-a2bd0eec-f541-42c3-bee3-ab13d813f764 tempest-VolumesSnapshotTestJSON-4159203 tempest-VolumesSnapshotTestJSON-4159203-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:05:39.765881 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-7e9c014e-19fe-4328-9b25-f7333e0b5c76 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Calling method '>' {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:05:39.768452 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.compute.api [None req-7e9c014e-19fe-4328-9b25-f7333e0b5c76 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] [instance: 08fb826b-e891-46c4-990d-ca03cf3f4222] Fetching instance by UUID {{(pid=120593) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:05:39.770096 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG dbcounter [-] [120593] Writing DB stats nova_api:SELECT=26 {{(pid=120593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 05:05:39.770226 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.compute.api [None req-a2bd0eec-f541-42c3-bee3-ab13d813f764 tempest-VolumesSnapshotTestJSON-4159203 tempest-VolumesSnapshotTestJSON-4159203-project] [instance: 3ca6173c-2d6c-4e8f-84a7-92e40af4c8f0] Going to try to terminate instance {{(pid=120594) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 24 05:05:39.774212 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-7e9c014e-19fe-4328-9b25-f7333e0b5c76 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:05:39.774694 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-7e9c014e-19fe-4328-9b25-f7333e0b5c76 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:05:39.775128 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-7e9c014e-19fe-4328-9b25-f7333e0b5c76 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:05:39.775846 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-7e9c014e-19fe-4328-9b25-f7333e0b5c76 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:05:39.776297 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-7e9c014e-19fe-4328-9b25-f7333e0b5c76 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:05:39.776716 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-7e9c014e-19fe-4328-9b25-f7333e0b5c76 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:05:39.848124 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [None req-a2bd0eec-f541-42c3-bee3-ab13d813f764 tempest-VolumesSnapshotTestJSON-4159203 tempest-VolumesSnapshotTestJSON-4159203-project] 10.222.0.50 "DELETE /compute/v2.1/servers/3ca6173c-2d6c-4e8f-84a7-92e40af4c8f0" status: 204 len: 0 microversion: 2.1 time: 0.115278 Sep 24 05:05:39.848966 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 288/544] 10.222.0.50 () {58 vars in 1239 bytes} [Sat Sep 24 05:05:39 2022] DELETE /compute/v2.1/servers/3ca6173c-2d6c-4e8f-84a7-92e40af4c8f0 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 24 05:05:39.857767 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-a6b6c5ea-0702-495e-a81a-db57c4bb8b8b tempest-VolumesSnapshotTestJSON-4159203 tempest-VolumesSnapshotTestJSON-4159203-project] Calling method '>' {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:05:39.858685 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.compute.api [None req-a6b6c5ea-0702-495e-a81a-db57c4bb8b8b tempest-VolumesSnapshotTestJSON-4159203 tempest-VolumesSnapshotTestJSON-4159203-project] [instance: 3ca6173c-2d6c-4e8f-84a7-92e40af4c8f0] Fetching instance by UUID {{(pid=120594) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:05:39.865116 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-a6b6c5ea-0702-495e-a81a-db57c4bb8b8b tempest-VolumesSnapshotTestJSON-4159203 tempest-VolumesSnapshotTestJSON-4159203-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:05:39.865596 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-a6b6c5ea-0702-495e-a81a-db57c4bb8b8b tempest-VolumesSnapshotTestJSON-4159203 tempest-VolumesSnapshotTestJSON-4159203-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:05:39.866052 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-a6b6c5ea-0702-495e-a81a-db57c4bb8b8b tempest-VolumesSnapshotTestJSON-4159203 tempest-VolumesSnapshotTestJSON-4159203-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:05:39.866739 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-a6b6c5ea-0702-495e-a81a-db57c4bb8b8b tempest-VolumesSnapshotTestJSON-4159203 tempest-VolumesSnapshotTestJSON-4159203-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:05:39.867187 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-a6b6c5ea-0702-495e-a81a-db57c4bb8b8b tempest-VolumesSnapshotTestJSON-4159203 tempest-VolumesSnapshotTestJSON-4159203-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:05:39.867606 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-a6b6c5ea-0702-495e-a81a-db57c4bb8b8b tempest-VolumesSnapshotTestJSON-4159203 tempest-VolumesSnapshotTestJSON-4159203-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:05:40.060951 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-7e9c014e-19fe-4328-9b25-f7333e0b5c76 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0948754217fc4ff2ba0241fa35feaf90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1aaf20f480a423ea5feca81585aeeed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:05:40.068933 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-7e9c014e-19fe-4328-9b25-f7333e0b5c76 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0948754217fc4ff2ba0241fa35feaf90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1aaf20f480a423ea5feca81585aeeed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:05:40.070394 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-7e9c014e-19fe-4328-9b25-f7333e0b5c76 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0948754217fc4ff2ba0241fa35feaf90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1aaf20f480a423ea5feca81585aeeed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:05:40.071539 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-7e9c014e-19fe-4328-9b25-f7333e0b5c76 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] 10.222.0.50 "GET /compute/v2.1/servers/08fb826b-e891-46c4-990d-ca03cf3f4222" status: 200 len: 1741 microversion: 2.20 time: 0.309508 Sep 24 05:05:40.072097 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 257/545] 10.222.0.50 () {60 vars in 1277 bytes} [Sat Sep 24 05:05:39 2022] GET /compute/v2.1/servers/08fb826b-e891-46c4-990d-ca03cf3f4222 => generated 1741 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 24 05:05:40.090321 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.policy [None req-a6b6c5ea-0702-495e-a81a-db57c4bb8b8b tempest-VolumesSnapshotTestJSON-4159203 tempest-VolumesSnapshotTestJSON-4159203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '358ce5f5c35f415eb79322ae6d187b1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e942295e9b3478abd521c6f3e60e888', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:05:40.097974 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [None req-a6b6c5ea-0702-495e-a81a-db57c4bb8b8b tempest-VolumesSnapshotTestJSON-4159203 tempest-VolumesSnapshotTestJSON-4159203-project] 10.222.0.50 "GET /compute/v2.1/servers/3ca6173c-2d6c-4e8f-84a7-92e40af4c8f0" status: 200 len: 1513 microversion: 2.1 time: 0.244278 Sep 24 05:05:40.098871 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 289/546] 10.222.0.50 () {58 vars in 1236 bytes} [Sat Sep 24 05:05:39 2022] GET /compute/v2.1/servers/3ca6173c-2d6c-4e8f-84a7-92e40af4c8f0 => generated 1513 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 24 05:05:41.096805 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-184ec004-66d8-407c-8037-59d99e6ba980 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Calling method '>' {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:05:41.097400 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.compute.api [None req-184ec004-66d8-407c-8037-59d99e6ba980 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] [instance: 08fb826b-e891-46c4-990d-ca03cf3f4222] Fetching instance by UUID {{(pid=120593) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:05:41.103753 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-184ec004-66d8-407c-8037-59d99e6ba980 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:05:41.104224 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-184ec004-66d8-407c-8037-59d99e6ba980 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:05:41.104652 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-184ec004-66d8-407c-8037-59d99e6ba980 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:05:41.105337 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-184ec004-66d8-407c-8037-59d99e6ba980 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:05:41.105783 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-184ec004-66d8-407c-8037-59d99e6ba980 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:05:41.106233 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-184ec004-66d8-407c-8037-59d99e6ba980 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:05:41.121478 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-e05d2102-63e7-4b84-9e59-9bf4f8d63550 tempest-VolumesSnapshotTestJSON-4159203 tempest-VolumesSnapshotTestJSON-4159203-project] Calling method '>' {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:05:41.122120 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.compute.api [None req-e05d2102-63e7-4b84-9e59-9bf4f8d63550 tempest-VolumesSnapshotTestJSON-4159203 tempest-VolumesSnapshotTestJSON-4159203-project] [instance: 3ca6173c-2d6c-4e8f-84a7-92e40af4c8f0] Fetching instance by UUID {{(pid=120594) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:05:41.128532 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-e05d2102-63e7-4b84-9e59-9bf4f8d63550 tempest-VolumesSnapshotTestJSON-4159203 tempest-VolumesSnapshotTestJSON-4159203-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:05:41.129012 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-e05d2102-63e7-4b84-9e59-9bf4f8d63550 tempest-VolumesSnapshotTestJSON-4159203 tempest-VolumesSnapshotTestJSON-4159203-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:05:41.129443 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-e05d2102-63e7-4b84-9e59-9bf4f8d63550 tempest-VolumesSnapshotTestJSON-4159203 tempest-VolumesSnapshotTestJSON-4159203-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:05:41.130157 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-e05d2102-63e7-4b84-9e59-9bf4f8d63550 tempest-VolumesSnapshotTestJSON-4159203 tempest-VolumesSnapshotTestJSON-4159203-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:05:41.131267 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-e05d2102-63e7-4b84-9e59-9bf4f8d63550 tempest-VolumesSnapshotTestJSON-4159203 tempest-VolumesSnapshotTestJSON-4159203-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:05:41.131740 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-e05d2102-63e7-4b84-9e59-9bf4f8d63550 tempest-VolumesSnapshotTestJSON-4159203 tempest-VolumesSnapshotTestJSON-4159203-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:05:41.522182 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-184ec004-66d8-407c-8037-59d99e6ba980 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0948754217fc4ff2ba0241fa35feaf90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1aaf20f480a423ea5feca81585aeeed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:05:41.525513 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.policy [None req-e05d2102-63e7-4b84-9e59-9bf4f8d63550 tempest-VolumesSnapshotTestJSON-4159203 tempest-VolumesSnapshotTestJSON-4159203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '358ce5f5c35f415eb79322ae6d187b1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e942295e9b3478abd521c6f3e60e888', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:05:41.530834 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-184ec004-66d8-407c-8037-59d99e6ba980 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0948754217fc4ff2ba0241fa35feaf90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1aaf20f480a423ea5feca81585aeeed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:05:41.532281 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-184ec004-66d8-407c-8037-59d99e6ba980 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0948754217fc4ff2ba0241fa35feaf90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1aaf20f480a423ea5feca81585aeeed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:05:41.533072 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [None req-e05d2102-63e7-4b84-9e59-9bf4f8d63550 tempest-VolumesSnapshotTestJSON-4159203 tempest-VolumesSnapshotTestJSON-4159203-project] 10.222.0.50 "GET /compute/v2.1/servers/3ca6173c-2d6c-4e8f-84a7-92e40af4c8f0" status: 200 len: 1513 microversion: 2.1 time: 0.415369 Sep 24 05:05:41.533433 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-184ec004-66d8-407c-8037-59d99e6ba980 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] 10.222.0.50 "GET /compute/v2.1/servers/08fb826b-e891-46c4-990d-ca03cf3f4222" status: 200 len: 1741 microversion: 2.20 time: 0.440573 Sep 24 05:05:41.533631 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 290/547] 10.222.0.50 () {58 vars in 1236 bytes} [Sat Sep 24 05:05:41 2022] GET /compute/v2.1/servers/3ca6173c-2d6c-4e8f-84a7-92e40af4c8f0 => generated 1513 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 24 05:05:41.537101 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 258/548] 10.222.0.50 () {60 vars in 1277 bytes} [Sat Sep 24 05:05:41 2022] GET /compute/v2.1/servers/08fb826b-e891-46c4-990d-ca03cf3f4222 => generated 1741 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 05:05:42.253804 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [req-bda4ad17-1ffb-44eb-80f6-008d189203a1 req-015ed760-4fd2-4f88-b530-37f706099521 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "08fb826b-e891-46c4-990d-ca03cf3f4222", "name": "network-vif-plugged", "status": "completed", "tag": "4de1eabe-932e-4cda-804d-49eeff37c34c"}]} {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 05:05:42.266596 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [req-bda4ad17-1ffb-44eb-80f6-008d189203a1 req-015ed760-4fd2-4f88-b530-37f706099521 service nova] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:05:42.267074 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [req-bda4ad17-1ffb-44eb-80f6-008d189203a1 req-015ed760-4fd2-4f88-b530-37f706099521 service nova] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:05:42.267496 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [req-bda4ad17-1ffb-44eb-80f6-008d189203a1 req-015ed760-4fd2-4f88-b530-37f706099521 service nova] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:05:42.279491 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: INFO nova.api.openstack.compute.server_external_events [req-bda4ad17-1ffb-44eb-80f6-008d189203a1 req-015ed760-4fd2-4f88-b530-37f706099521 service nova] Creating event network-vif-plugged:4de1eabe-932e-4cda-804d-49eeff37c34c for instance 08fb826b-e891-46c4-990d-ca03cf3f4222 on hv-cinder-85918 Sep 24 05:05:42.284675 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [req-bda4ad17-1ffb-44eb-80f6-008d189203a1 req-015ed760-4fd2-4f88-b530-37f706099521 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034603 Sep 24 05:05:42.285273 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 291/549] 10.222.0.50 () {64 vars in 1317 bytes} [Sat Sep 24 05:05:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 24 05:05:42.568552 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-001942ca-445a-49ed-bf35-5e290a1870fe tempest-VolumesSnapshotTestJSON-4159203 tempest-VolumesSnapshotTestJSON-4159203-project] Calling method '>' {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:05:42.569636 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-cd18537b-15f7-4e48-8731-81d7f5295992 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Calling method '>' {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:05:42.570452 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.compute.api [None req-cd18537b-15f7-4e48-8731-81d7f5295992 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] [instance: 08fb826b-e891-46c4-990d-ca03cf3f4222] Fetching instance by UUID {{(pid=120594) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:05:42.573541 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.compute.api [None req-001942ca-445a-49ed-bf35-5e290a1870fe tempest-VolumesSnapshotTestJSON-4159203 tempest-VolumesSnapshotTestJSON-4159203-project] [instance: 3ca6173c-2d6c-4e8f-84a7-92e40af4c8f0] Fetching instance by UUID {{(pid=120593) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:05:42.579790 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-001942ca-445a-49ed-bf35-5e290a1870fe tempest-VolumesSnapshotTestJSON-4159203 tempest-VolumesSnapshotTestJSON-4159203-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:05:42.583372 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-cd18537b-15f7-4e48-8731-81d7f5295992 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:05:42.583942 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-cd18537b-15f7-4e48-8731-81d7f5295992 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:05:42.584447 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-cd18537b-15f7-4e48-8731-81d7f5295992 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:05:42.585207 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-001942ca-445a-49ed-bf35-5e290a1870fe tempest-VolumesSnapshotTestJSON-4159203 tempest-VolumesSnapshotTestJSON-4159203-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:05:42.585342 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-cd18537b-15f7-4e48-8731-81d7f5295992 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:05:42.585733 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-cd18537b-15f7-4e48-8731-81d7f5295992 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:05:42.585879 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-001942ca-445a-49ed-bf35-5e290a1870fe tempest-VolumesSnapshotTestJSON-4159203 tempest-VolumesSnapshotTestJSON-4159203-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:05:42.586526 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-cd18537b-15f7-4e48-8731-81d7f5295992 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:05:42.586636 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-001942ca-445a-49ed-bf35-5e290a1870fe tempest-VolumesSnapshotTestJSON-4159203 tempest-VolumesSnapshotTestJSON-4159203-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:05:42.586983 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-001942ca-445a-49ed-bf35-5e290a1870fe tempest-VolumesSnapshotTestJSON-4159203 tempest-VolumesSnapshotTestJSON-4159203-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:05:42.587415 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-001942ca-445a-49ed-bf35-5e290a1870fe tempest-VolumesSnapshotTestJSON-4159203 tempest-VolumesSnapshotTestJSON-4159203-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:05:42.680733 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-001942ca-445a-49ed-bf35-5e290a1870fe tempest-VolumesSnapshotTestJSON-4159203 tempest-VolumesSnapshotTestJSON-4159203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '358ce5f5c35f415eb79322ae6d187b1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e942295e9b3478abd521c6f3e60e888', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:05:42.689356 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-001942ca-445a-49ed-bf35-5e290a1870fe tempest-VolumesSnapshotTestJSON-4159203 tempest-VolumesSnapshotTestJSON-4159203-project] 10.222.0.50 "GET /compute/v2.1/servers/3ca6173c-2d6c-4e8f-84a7-92e40af4c8f0" status: 200 len: 1471 microversion: 2.1 time: 0.132296 Sep 24 05:05:42.689935 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 259/550] 10.222.0.50 () {58 vars in 1236 bytes} [Sat Sep 24 05:05:42 2022] GET /compute/v2.1/servers/3ca6173c-2d6c-4e8f-84a7-92e40af4c8f0 => generated 1471 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 05:05:42.695019 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [req-2fe63a3b-8101-4cfe-9089-3834686d96a2 req-eaf8aee2-82a4-4014-81b9-7be9d50e6b17 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3ca6173c-2d6c-4e8f-84a7-92e40af4c8f0", "name": "network-vif-deleted", "tag": "9c6dec80-2159-4921-9ea1-1aecb911e3c4"}]} {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 05:05:42.704510 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [req-2fe63a3b-8101-4cfe-9089-3834686d96a2 req-eaf8aee2-82a4-4014-81b9-7be9d50e6b17 service nova] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:05:42.705233 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [req-2fe63a3b-8101-4cfe-9089-3834686d96a2 req-eaf8aee2-82a4-4014-81b9-7be9d50e6b17 service nova] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:05:42.705744 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [req-2fe63a3b-8101-4cfe-9089-3834686d96a2 req-eaf8aee2-82a4-4014-81b9-7be9d50e6b17 service nova] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:05:42.716876 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.compute.server_external_events [req-2fe63a3b-8101-4cfe-9089-3834686d96a2 req-eaf8aee2-82a4-4014-81b9-7be9d50e6b17 service nova] Creating event network-vif-deleted:9c6dec80-2159-4921-9ea1-1aecb911e3c4 for instance 3ca6173c-2d6c-4e8f-84a7-92e40af4c8f0 on hv-cinder-85918 Sep 24 05:05:42.721754 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [req-2fe63a3b-8101-4cfe-9089-3834686d96a2 req-eaf8aee2-82a4-4014-81b9-7be9d50e6b17 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030713 Sep 24 05:05:42.722396 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 260/551] 10.222.0.50 () {64 vars in 1317 bytes} [Sat Sep 24 05:05:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 05:05:42.774417 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.policy [None req-cd18537b-15f7-4e48-8731-81d7f5295992 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0948754217fc4ff2ba0241fa35feaf90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1aaf20f480a423ea5feca81585aeeed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:05:42.782610 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.policy [None req-cd18537b-15f7-4e48-8731-81d7f5295992 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0948754217fc4ff2ba0241fa35feaf90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1aaf20f480a423ea5feca81585aeeed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:05:42.784067 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.policy [None req-cd18537b-15f7-4e48-8731-81d7f5295992 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0948754217fc4ff2ba0241fa35feaf90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1aaf20f480a423ea5feca81585aeeed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:05:42.785246 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [None req-cd18537b-15f7-4e48-8731-81d7f5295992 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] 10.222.0.50 "GET /compute/v2.1/servers/08fb826b-e891-46c4-990d-ca03cf3f4222" status: 200 len: 1741 microversion: 2.20 time: 0.229782 Sep 24 05:05:42.785801 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 292/552] 10.222.0.50 () {60 vars in 1277 bytes} [Sat Sep 24 05:05:42 2022] GET /compute/v2.1/servers/08fb826b-e891-46c4-990d-ca03cf3f4222 => generated 1741 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 05:05:43.713758 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-d4ac00bc-3e02-4123-93fb-a45184fea02a tempest-VolumesSnapshotTestJSON-4159203 tempest-VolumesSnapshotTestJSON-4159203-project] Calling method '>' {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:05:43.714600 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.compute.api [None req-d4ac00bc-3e02-4123-93fb-a45184fea02a tempest-VolumesSnapshotTestJSON-4159203 tempest-VolumesSnapshotTestJSON-4159203-project] [instance: 3ca6173c-2d6c-4e8f-84a7-92e40af4c8f0] Fetching instance by UUID {{(pid=120593) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:05:43.720883 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-d4ac00bc-3e02-4123-93fb-a45184fea02a tempest-VolumesSnapshotTestJSON-4159203 tempest-VolumesSnapshotTestJSON-4159203-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:05:43.721364 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-d4ac00bc-3e02-4123-93fb-a45184fea02a tempest-VolumesSnapshotTestJSON-4159203 tempest-VolumesSnapshotTestJSON-4159203-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:05:43.721799 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-d4ac00bc-3e02-4123-93fb-a45184fea02a tempest-VolumesSnapshotTestJSON-4159203 tempest-VolumesSnapshotTestJSON-4159203-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:05:43.722507 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-d4ac00bc-3e02-4123-93fb-a45184fea02a tempest-VolumesSnapshotTestJSON-4159203 tempest-VolumesSnapshotTestJSON-4159203-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:05:43.722959 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-d4ac00bc-3e02-4123-93fb-a45184fea02a tempest-VolumesSnapshotTestJSON-4159203 tempest-VolumesSnapshotTestJSON-4159203-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:05:43.723381 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-d4ac00bc-3e02-4123-93fb-a45184fea02a tempest-VolumesSnapshotTestJSON-4159203 tempest-VolumesSnapshotTestJSON-4159203-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:05:43.736876 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.wsgi [None req-d4ac00bc-3e02-4123-93fb-a45184fea02a tempest-VolumesSnapshotTestJSON-4159203 tempest-VolumesSnapshotTestJSON-4159203-project] HTTP exception thrown: Instance 3ca6173c-2d6c-4e8f-84a7-92e40af4c8f0 could not be found. Sep 24 05:05:43.738505 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-d4ac00bc-3e02-4123-93fb-a45184fea02a tempest-VolumesSnapshotTestJSON-4159203 tempest-VolumesSnapshotTestJSON-4159203-project] Request method failure captured: Sep 24 05:05:43.738505 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: request: GET /compute/v2.1/servers/3ca6173c-2d6c-4e8f-84a7-92e40af4c8f0 HTTP/1.1 Sep 24 05:05:43.738505 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: Accept: application/json Sep 24 05:05:43.738505 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: Accept-Encoding: identity Sep 24 05:05:43.738505 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: Connection: close Sep 24 05:05:43.738505 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: Content-Length: 0 Sep 24 05:05:43.738505 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: Content-Type: application/json Sep 24 05:05:43.738505 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: Host: 10.222.0.50 Sep 24 05:05:43.738505 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: Openstack-System-Scope: None Sep 24 05:05:43.738505 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: User-Agent: python-urllib3/1.26.12 Sep 24 05:05:43.738505 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: X-Auth-Token: gAAAAABjLo_WMEcGDomIoaxlVSNKcL813mdQFpOl2BMAhWW6IVTY6YJG4G9orsaEKecGTgr1Ih1ol9mrVzDyNk536qPtyyn0_XteLafzruAcSBCrnZctBI2r_1VRnmdvkGII8XDPi8C-KWR9TNOvshlk38PwemEHVpOZ0i41rYlmwAVORrvIvX0 Sep 24 05:05:43.738505 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: X-Domain-Id: None Sep 24 05:05:43.738505 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: X-Domain-Name: None Sep 24 05:05:43.738505 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: X-Identity-Status: Confirmed Sep 24 05:05:43.738505 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: X-Is-Admin-Project: True Sep 24 05:05:43.738505 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: X-Project-Domain-Id: default Sep 24 05:05:43.738505 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: X-Project-Domain-Name: Default Sep 24 05:05:43.738505 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: X-Project-Id: 0e942295e9b3478abd521c6f3e60e888 Sep 24 05:05:43.738505 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: X-Project-Name: tempest-VolumesSnapshotTestJSON-4159203 Sep 24 05:05:43.738505 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: X-Role: member,reader Sep 24 05:05:43.738505 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: X-Roles: member,reader Sep 24 05:05:43.740728 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/0e942295e9b3478abd521c6f3e60e888"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/0e942295e9b3478abd521c6f3e60e888"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/0e942295e9b3478abd521c6f3e60e888"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.50:8080", "publicURL": "http://10.222.0.50:8080/v1/AUTH_0e942295e9b3478abd521c6f3e60e888"}]}] Sep 24 05:05:43.740728 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: X-Tenant: tempest-VolumesSnapshotTestJSON-4159203 Sep 24 05:05:43.740728 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: X-Tenant-Id: 0e942295e9b3478abd521c6f3e60e888 Sep 24 05:05:43.740728 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-4159203 Sep 24 05:05:43.740728 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: X-User: tempest-VolumesSnapshotTestJSON-4159203-project Sep 24 05:05:43.740728 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: X-User-Domain-Id: default Sep 24 05:05:43.740728 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: X-User-Domain-Name: Default Sep 24 05:05:43.740728 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: X-User-Id: 358ce5f5c35f415eb79322ae6d187b1d Sep 24 05:05:43.740728 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: X-User-Name: tempest-VolumesSnapshotTestJSON-4159203-project Sep 24 05:05:43.740728 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: method: > Sep 24 05:05:43.740728 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: exception: Instance 3ca6173c-2d6c-4e8f-84a7-92e40af4c8f0 could not be found. Sep 24 05:05:43.740728 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: action_args: {'id': '3ca6173c-2d6c-4e8f-84a7-92e40af4c8f0'} Sep 24 05:05:43.741656 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 24 05:05:43.741656 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 05:05:43.741656 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 24 05:05:43.741656 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 24 05:05:43.741656 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 24 05:05:43.741656 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 24 05:05:43.741656 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 24 05:05:43.741656 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 24 05:05:43.741656 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 24 05:05:43.741656 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 24 05:05:43.741656 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3ca6173c-2d6c-4e8f-84a7-92e40af4c8f0 could not be found. Sep 24 05:05:43.741656 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi Sep 24 05:05:43.741656 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 05:05:43.741656 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi Sep 24 05:05:43.741656 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 05:05:43.741656 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 05:05:43.741656 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 05:05:43.741656 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 24 05:05:43.741656 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 24 05:05:43.741656 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 24 05:05:43.743222 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 24 05:05:43.743222 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 24 05:05:43.743222 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 24 05:05:43.743222 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 24 05:05:43.743222 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 24 05:05:43.743222 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 24 05:05:43.743222 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 24 05:05:43.743222 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3ca6173c-2d6c-4e8f-84a7-92e40af4c8f0 could not be found. Sep 24 05:05:43.743222 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi Sep 24 05:05:43.743222 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 05:05:43.743222 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi Sep 24 05:05:43.743222 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 05:05:43.743222 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 05:05:43.743222 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 05:05:43.743222 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 24 05:05:43.743222 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 24 05:05:43.743222 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3ca6173c-2d6c-4e8f-84a7-92e40af4c8f0 could not be found. Sep 24 05:05:43.743222 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi Sep 24 05:05:43.744593 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-d4ac00bc-3e02-4123-93fb-a45184fea02a tempest-VolumesSnapshotTestJSON-4159203 tempest-VolumesSnapshotTestJSON-4159203-project] Returning 404 to user: Instance 3ca6173c-2d6c-4e8f-84a7-92e40af4c8f0 could not be found. {{(pid=120593) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 24 05:05:43.744593 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-d4ac00bc-3e02-4123-93fb-a45184fea02a tempest-VolumesSnapshotTestJSON-4159203 tempest-VolumesSnapshotTestJSON-4159203-project] 10.222.0.50 "GET /compute/v2.1/servers/3ca6173c-2d6c-4e8f-84a7-92e40af4c8f0" status: 404 len: 111 microversion: 2.1 time: 0.030762 Sep 24 05:05:43.744593 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 261/553] 10.222.0.50 () {58 vars in 1236 bytes} [Sat Sep 24 05:05:43 2022] GET /compute/v2.1/servers/3ca6173c-2d6c-4e8f-84a7-92e40af4c8f0 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 24 05:05:43.810870 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-376ddc46-3464-49ce-b317-c693552a567e tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Calling method '>' {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:05:43.811471 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.compute.api [None req-376ddc46-3464-49ce-b317-c693552a567e tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] [instance: 08fb826b-e891-46c4-990d-ca03cf3f4222] Fetching instance by UUID {{(pid=120594) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:05:43.814099 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG dbcounter [-] [120594] Writing DB stats nova_api:SELECT=39,nova_api:UPDATE=1 {{(pid=120594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 05:05:43.819755 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-376ddc46-3464-49ce-b317-c693552a567e tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:05:43.820327 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-376ddc46-3464-49ce-b317-c693552a567e tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:05:43.821042 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-376ddc46-3464-49ce-b317-c693552a567e tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:05:43.821753 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-376ddc46-3464-49ce-b317-c693552a567e tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:05:43.822281 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-376ddc46-3464-49ce-b317-c693552a567e tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:05:43.822804 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-376ddc46-3464-49ce-b317-c693552a567e tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:05:43.963506 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.policy [None req-376ddc46-3464-49ce-b317-c693552a567e tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0948754217fc4ff2ba0241fa35feaf90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1aaf20f480a423ea5feca81585aeeed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:05:43.971418 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.policy [None req-376ddc46-3464-49ce-b317-c693552a567e tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0948754217fc4ff2ba0241fa35feaf90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1aaf20f480a423ea5feca81585aeeed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:05:43.972867 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.policy [None req-376ddc46-3464-49ce-b317-c693552a567e tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0948754217fc4ff2ba0241fa35feaf90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1aaf20f480a423ea5feca81585aeeed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:05:43.974521 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [None req-376ddc46-3464-49ce-b317-c693552a567e tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] 10.222.0.50 "GET /compute/v2.1/servers/08fb826b-e891-46c4-990d-ca03cf3f4222" status: 200 len: 1741 microversion: 2.20 time: 0.167111 Sep 24 05:05:43.975078 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 293/554] 10.222.0.50 () {60 vars in 1277 bytes} [Sat Sep 24 05:05:43 2022] GET /compute/v2.1/servers/08fb826b-e891-46c4-990d-ca03cf3f4222 => generated 1741 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 05:05:44.999802 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-e7c8ea7b-0e9d-4af0-8c58-f8787f19c48f tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Calling method '>' {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:05:45.000402 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.compute.api [None req-e7c8ea7b-0e9d-4af0-8c58-f8787f19c48f tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] [instance: 08fb826b-e891-46c4-990d-ca03cf3f4222] Fetching instance by UUID {{(pid=120593) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:05:45.006695 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-e7c8ea7b-0e9d-4af0-8c58-f8787f19c48f tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:05:45.007172 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-e7c8ea7b-0e9d-4af0-8c58-f8787f19c48f tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:05:45.007604 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-e7c8ea7b-0e9d-4af0-8c58-f8787f19c48f tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:05:45.008287 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-e7c8ea7b-0e9d-4af0-8c58-f8787f19c48f tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:05:45.008736 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-e7c8ea7b-0e9d-4af0-8c58-f8787f19c48f tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:05:45.009156 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-e7c8ea7b-0e9d-4af0-8c58-f8787f19c48f tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:05:45.138715 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-e7c8ea7b-0e9d-4af0-8c58-f8787f19c48f tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0948754217fc4ff2ba0241fa35feaf90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1aaf20f480a423ea5feca81585aeeed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:05:45.147096 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-e7c8ea7b-0e9d-4af0-8c58-f8787f19c48f tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0948754217fc4ff2ba0241fa35feaf90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1aaf20f480a423ea5feca81585aeeed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:05:45.148786 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-e7c8ea7b-0e9d-4af0-8c58-f8787f19c48f tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0948754217fc4ff2ba0241fa35feaf90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1aaf20f480a423ea5feca81585aeeed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:05:45.149912 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-e7c8ea7b-0e9d-4af0-8c58-f8787f19c48f tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] 10.222.0.50 "GET /compute/v2.1/servers/08fb826b-e891-46c4-990d-ca03cf3f4222" status: 200 len: 1741 microversion: 2.20 time: 0.154065 Sep 24 05:05:45.150489 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 262/555] 10.222.0.50 () {60 vars in 1277 bytes} [Sat Sep 24 05:05:44 2022] GET /compute/v2.1/servers/08fb826b-e891-46c4-990d-ca03cf3f4222 => generated 1741 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 05:05:46.175392 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-8867c682-8541-4f7a-a2f3-3c5c145cb351 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Calling method '>' {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:05:46.176038 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.compute.api [None req-8867c682-8541-4f7a-a2f3-3c5c145cb351 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] [instance: 08fb826b-e891-46c4-990d-ca03cf3f4222] Fetching instance by UUID {{(pid=120594) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:05:46.182918 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-8867c682-8541-4f7a-a2f3-3c5c145cb351 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:05:46.183399 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-8867c682-8541-4f7a-a2f3-3c5c145cb351 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:05:46.183829 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-8867c682-8541-4f7a-a2f3-3c5c145cb351 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:05:46.184519 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-8867c682-8541-4f7a-a2f3-3c5c145cb351 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:05:46.184965 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-8867c682-8541-4f7a-a2f3-3c5c145cb351 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:05:46.185385 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-8867c682-8541-4f7a-a2f3-3c5c145cb351 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:05:46.310520 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.policy [None req-8867c682-8541-4f7a-a2f3-3c5c145cb351 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0948754217fc4ff2ba0241fa35feaf90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1aaf20f480a423ea5feca81585aeeed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:05:46.320794 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.policy [None req-8867c682-8541-4f7a-a2f3-3c5c145cb351 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0948754217fc4ff2ba0241fa35feaf90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1aaf20f480a423ea5feca81585aeeed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:05:46.322282 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.policy [None req-8867c682-8541-4f7a-a2f3-3c5c145cb351 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0948754217fc4ff2ba0241fa35feaf90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1aaf20f480a423ea5feca81585aeeed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:05:46.323421 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [None req-8867c682-8541-4f7a-a2f3-3c5c145cb351 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] 10.222.0.50 "GET /compute/v2.1/servers/08fb826b-e891-46c4-990d-ca03cf3f4222" status: 200 len: 1741 microversion: 2.20 time: 0.151982 Sep 24 05:05:46.323980 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 294/556] 10.222.0.50 () {60 vars in 1277 bytes} [Sat Sep 24 05:05:46 2022] GET /compute/v2.1/servers/08fb826b-e891-46c4-990d-ca03cf3f4222 => generated 1741 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 05:05:47.348833 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-8e19a41b-9627-4d13-b6b5-f061291072fc tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Calling method '>' {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:05:47.349375 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.compute.api [None req-8e19a41b-9627-4d13-b6b5-f061291072fc tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] [instance: 08fb826b-e891-46c4-990d-ca03cf3f4222] Fetching instance by UUID {{(pid=120593) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:05:47.355786 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-8e19a41b-9627-4d13-b6b5-f061291072fc tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:05:47.356264 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-8e19a41b-9627-4d13-b6b5-f061291072fc tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:05:47.356696 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-8e19a41b-9627-4d13-b6b5-f061291072fc tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:05:47.357378 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-8e19a41b-9627-4d13-b6b5-f061291072fc tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:05:47.357826 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-8e19a41b-9627-4d13-b6b5-f061291072fc tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:05:47.358270 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-8e19a41b-9627-4d13-b6b5-f061291072fc tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:05:47.483884 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-8e19a41b-9627-4d13-b6b5-f061291072fc tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0948754217fc4ff2ba0241fa35feaf90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1aaf20f480a423ea5feca81585aeeed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:05:47.492367 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-8e19a41b-9627-4d13-b6b5-f061291072fc tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0948754217fc4ff2ba0241fa35feaf90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1aaf20f480a423ea5feca81585aeeed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:05:47.493787 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-8e19a41b-9627-4d13-b6b5-f061291072fc tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0948754217fc4ff2ba0241fa35feaf90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1aaf20f480a423ea5feca81585aeeed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:05:47.494950 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-8e19a41b-9627-4d13-b6b5-f061291072fc tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] 10.222.0.50 "GET /compute/v2.1/servers/08fb826b-e891-46c4-990d-ca03cf3f4222" status: 200 len: 1741 microversion: 2.20 time: 0.150740 Sep 24 05:05:47.495510 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 263/557] 10.222.0.50 () {60 vars in 1277 bytes} [Sat Sep 24 05:05:47 2022] GET /compute/v2.1/servers/08fb826b-e891-46c4-990d-ca03cf3f4222 => generated 1741 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 05:05:48.519666 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-6e107867-2c0a-4658-af97-19428fd811de tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Calling method '>' {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:05:48.520275 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.compute.api [None req-6e107867-2c0a-4658-af97-19428fd811de tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] [instance: 08fb826b-e891-46c4-990d-ca03cf3f4222] Fetching instance by UUID {{(pid=120594) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:05:48.527612 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-6e107867-2c0a-4658-af97-19428fd811de tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:05:48.528089 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-6e107867-2c0a-4658-af97-19428fd811de tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:05:48.528521 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-6e107867-2c0a-4658-af97-19428fd811de tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:05:48.529202 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-6e107867-2c0a-4658-af97-19428fd811de tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:05:48.529648 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-6e107867-2c0a-4658-af97-19428fd811de tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:05:48.530097 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-6e107867-2c0a-4658-af97-19428fd811de tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:05:48.664732 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.policy [None req-6e107867-2c0a-4658-af97-19428fd811de tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0948754217fc4ff2ba0241fa35feaf90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1aaf20f480a423ea5feca81585aeeed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:05:48.672834 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.policy [None req-6e107867-2c0a-4658-af97-19428fd811de tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0948754217fc4ff2ba0241fa35feaf90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1aaf20f480a423ea5feca81585aeeed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:05:48.674309 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.policy [None req-6e107867-2c0a-4658-af97-19428fd811de tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0948754217fc4ff2ba0241fa35feaf90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1aaf20f480a423ea5feca81585aeeed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:05:48.675476 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [None req-6e107867-2c0a-4658-af97-19428fd811de tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] 10.222.0.50 "GET /compute/v2.1/servers/08fb826b-e891-46c4-990d-ca03cf3f4222" status: 200 len: 1741 microversion: 2.20 time: 0.159744 Sep 24 05:05:48.676035 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 295/558] 10.222.0.50 () {60 vars in 1277 bytes} [Sat Sep 24 05:05:48 2022] GET /compute/v2.1/servers/08fb826b-e891-46c4-990d-ca03cf3f4222 => generated 1741 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 05:05:49.701764 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-ba4a7829-c8c3-4a7f-b74c-46e769b22112 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Calling method '>' {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:05:49.702398 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.compute.api [None req-ba4a7829-c8c3-4a7f-b74c-46e769b22112 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] [instance: 08fb826b-e891-46c4-990d-ca03cf3f4222] Fetching instance by UUID {{(pid=120593) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:05:49.708996 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-ba4a7829-c8c3-4a7f-b74c-46e769b22112 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:05:49.709480 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-ba4a7829-c8c3-4a7f-b74c-46e769b22112 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:05:49.709912 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-ba4a7829-c8c3-4a7f-b74c-46e769b22112 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:05:49.710617 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-ba4a7829-c8c3-4a7f-b74c-46e769b22112 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:05:49.711068 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-ba4a7829-c8c3-4a7f-b74c-46e769b22112 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:05:49.711490 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-ba4a7829-c8c3-4a7f-b74c-46e769b22112 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:05:49.844125 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-ba4a7829-c8c3-4a7f-b74c-46e769b22112 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0948754217fc4ff2ba0241fa35feaf90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1aaf20f480a423ea5feca81585aeeed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:05:49.853064 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-ba4a7829-c8c3-4a7f-b74c-46e769b22112 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0948754217fc4ff2ba0241fa35feaf90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1aaf20f480a423ea5feca81585aeeed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:05:49.854505 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-ba4a7829-c8c3-4a7f-b74c-46e769b22112 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0948754217fc4ff2ba0241fa35feaf90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1aaf20f480a423ea5feca81585aeeed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:05:49.855630 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-ba4a7829-c8c3-4a7f-b74c-46e769b22112 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] 10.222.0.50 "GET /compute/v2.1/servers/08fb826b-e891-46c4-990d-ca03cf3f4222" status: 200 len: 1741 microversion: 2.20 time: 0.157733 Sep 24 05:05:49.856170 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 264/559] 10.222.0.50 () {60 vars in 1277 bytes} [Sat Sep 24 05:05:49 2022] GET /compute/v2.1/servers/08fb826b-e891-46c4-990d-ca03cf3f4222 => generated 1741 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 05:05:50.881555 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-b6b49f74-6a8f-4978-b0c8-a013f317991a tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Calling method '>' {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:05:50.882216 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.compute.api [None req-b6b49f74-6a8f-4978-b0c8-a013f317991a tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] [instance: 08fb826b-e891-46c4-990d-ca03cf3f4222] Fetching instance by UUID {{(pid=120594) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:05:50.888609 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-b6b49f74-6a8f-4978-b0c8-a013f317991a tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:05:50.889082 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-b6b49f74-6a8f-4978-b0c8-a013f317991a tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:05:50.889536 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-b6b49f74-6a8f-4978-b0c8-a013f317991a tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:05:50.890252 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-b6b49f74-6a8f-4978-b0c8-a013f317991a tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:05:50.890698 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-b6b49f74-6a8f-4978-b0c8-a013f317991a tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:05:50.891116 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-b6b49f74-6a8f-4978-b0c8-a013f317991a tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:05:51.116423 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.policy [None req-b6b49f74-6a8f-4978-b0c8-a013f317991a tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0948754217fc4ff2ba0241fa35feaf90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1aaf20f480a423ea5feca81585aeeed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:05:51.124334 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.policy [None req-b6b49f74-6a8f-4978-b0c8-a013f317991a tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0948754217fc4ff2ba0241fa35feaf90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1aaf20f480a423ea5feca81585aeeed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:05:51.125763 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.policy [None req-b6b49f74-6a8f-4978-b0c8-a013f317991a tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0948754217fc4ff2ba0241fa35feaf90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1aaf20f480a423ea5feca81585aeeed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:05:51.126925 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [None req-b6b49f74-6a8f-4978-b0c8-a013f317991a tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] 10.222.0.50 "GET /compute/v2.1/servers/08fb826b-e891-46c4-990d-ca03cf3f4222" status: 200 len: 1741 microversion: 2.20 time: 0.249907 Sep 24 05:05:51.127477 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 296/560] 10.222.0.50 () {60 vars in 1277 bytes} [Sat Sep 24 05:05:50 2022] GET /compute/v2.1/servers/08fb826b-e891-46c4-990d-ca03cf3f4222 => generated 1741 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 05:05:52.153083 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-b228da5a-ddc6-493b-b83d-3024ceaf9a55 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Calling method '>' {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:05:52.153706 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.compute.api [None req-b228da5a-ddc6-493b-b83d-3024ceaf9a55 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] [instance: 08fb826b-e891-46c4-990d-ca03cf3f4222] Fetching instance by UUID {{(pid=120593) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:05:52.161198 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-b228da5a-ddc6-493b-b83d-3024ceaf9a55 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:05:52.162489 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-b228da5a-ddc6-493b-b83d-3024ceaf9a55 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:05:52.162910 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-b228da5a-ddc6-493b-b83d-3024ceaf9a55 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:05:52.163609 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-b228da5a-ddc6-493b-b83d-3024ceaf9a55 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:05:52.164063 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-b228da5a-ddc6-493b-b83d-3024ceaf9a55 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:05:52.164516 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-b228da5a-ddc6-493b-b83d-3024ceaf9a55 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:05:52.167924 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG dbcounter [-] [120593] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=1 {{(pid=120593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 05:05:52.298707 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-b228da5a-ddc6-493b-b83d-3024ceaf9a55 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0948754217fc4ff2ba0241fa35feaf90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1aaf20f480a423ea5feca81585aeeed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:05:52.309323 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-b228da5a-ddc6-493b-b83d-3024ceaf9a55 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0948754217fc4ff2ba0241fa35feaf90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1aaf20f480a423ea5feca81585aeeed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:05:52.312224 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-b228da5a-ddc6-493b-b83d-3024ceaf9a55 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0948754217fc4ff2ba0241fa35feaf90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1aaf20f480a423ea5feca81585aeeed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:05:52.313421 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-b228da5a-ddc6-493b-b83d-3024ceaf9a55 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] 10.222.0.50 "GET /compute/v2.1/servers/08fb826b-e891-46c4-990d-ca03cf3f4222" status: 200 len: 1736 microversion: 2.20 time: 0.164302 Sep 24 05:05:52.313989 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 265/561] 10.222.0.50 () {60 vars in 1277 bytes} [Sat Sep 24 05:05:52 2022] GET /compute/v2.1/servers/08fb826b-e891-46c4-990d-ca03cf3f4222 => generated 1736 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 05:05:53.348472 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-d718c9cc-9e77-4111-947c-c00243b6fdee tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Calling method '>' {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:05:53.351252 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.compute.api [None req-d718c9cc-9e77-4111-947c-c00243b6fdee tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] [instance: 08fb826b-e891-46c4-990d-ca03cf3f4222] Fetching instance by UUID {{(pid=120594) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:05:53.358983 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-d718c9cc-9e77-4111-947c-c00243b6fdee tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:05:53.359869 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-d718c9cc-9e77-4111-947c-c00243b6fdee tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:05:53.361048 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-d718c9cc-9e77-4111-947c-c00243b6fdee tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:05:53.362239 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-d718c9cc-9e77-4111-947c-c00243b6fdee tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:05:53.362950 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-d718c9cc-9e77-4111-947c-c00243b6fdee tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:05:53.363730 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-d718c9cc-9e77-4111-947c-c00243b6fdee tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:05:53.545839 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.policy [None req-d718c9cc-9e77-4111-947c-c00243b6fdee tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0948754217fc4ff2ba0241fa35feaf90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1aaf20f480a423ea5feca81585aeeed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:05:53.557691 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.policy [None req-d718c9cc-9e77-4111-947c-c00243b6fdee tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0948754217fc4ff2ba0241fa35feaf90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1aaf20f480a423ea5feca81585aeeed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:05:53.559491 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.policy [None req-d718c9cc-9e77-4111-947c-c00243b6fdee tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0948754217fc4ff2ba0241fa35feaf90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1aaf20f480a423ea5feca81585aeeed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:05:53.560863 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [None req-d718c9cc-9e77-4111-947c-c00243b6fdee tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] 10.222.0.50 "GET /compute/v2.1/servers/08fb826b-e891-46c4-990d-ca03cf3f4222" status: 200 len: 1736 microversion: 2.20 time: 0.216550 Sep 24 05:05:53.561743 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 297/562] 10.222.0.50 () {60 vars in 1277 bytes} [Sat Sep 24 05:05:53 2022] GET /compute/v2.1/servers/08fb826b-e891-46c4-990d-ca03cf3f4222 => generated 1736 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 05:05:54.442370 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-c1fd293d-01e8-4e01-b00f-be71d07efc77 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Calling method '>' {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:05:54.443523 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.compute.api [None req-c1fd293d-01e8-4e01-b00f-be71d07efc77 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] [instance: b2daebb8-dfea-4ab9-8253-008a21f906e1] Fetching instance by UUID {{(pid=120593) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:05:54.454150 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-c1fd293d-01e8-4e01-b00f-be71d07efc77 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:05:54.454656 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-c1fd293d-01e8-4e01-b00f-be71d07efc77 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:05:54.455563 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-c1fd293d-01e8-4e01-b00f-be71d07efc77 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:05:54.456352 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-c1fd293d-01e8-4e01-b00f-be71d07efc77 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:05:54.456921 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-c1fd293d-01e8-4e01-b00f-be71d07efc77 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:05:54.457405 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-c1fd293d-01e8-4e01-b00f-be71d07efc77 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:05:54.484357 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-c1fd293d-01e8-4e01-b00f-be71d07efc77 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] 10.222.0.50 "GET /compute/v2.1/servers/b2daebb8-dfea-4ab9-8253-008a21f906e1/ips" status: 200 len: 146 microversion: 2.1 time: 0.157140 Sep 24 05:05:54.485672 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 266/563] 10.222.0.50 () {58 vars in 1248 bytes} [Sat Sep 24 05:05:54 2022] GET /compute/v2.1/servers/b2daebb8-dfea-4ab9-8253-008a21f906e1/ips => generated 146 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 05:05:54.586765 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-b6c07572-b5d7-4f26-82e0-5f14e3609ece tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Calling method '>' {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:05:54.588056 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.compute.api [None req-b6c07572-b5d7-4f26-82e0-5f14e3609ece tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] [instance: 08fb826b-e891-46c4-990d-ca03cf3f4222] Fetching instance by UUID {{(pid=120594) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:05:54.597043 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-b6c07572-b5d7-4f26-82e0-5f14e3609ece tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:05:54.597530 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-b6c07572-b5d7-4f26-82e0-5f14e3609ece tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:05:54.603727 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-b6c07572-b5d7-4f26-82e0-5f14e3609ece tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:05:54.604774 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-b6c07572-b5d7-4f26-82e0-5f14e3609ece tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:05:54.605403 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-b6c07572-b5d7-4f26-82e0-5f14e3609ece tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:05:54.605828 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-b6c07572-b5d7-4f26-82e0-5f14e3609ece tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:05:54.748845 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.policy [None req-b6c07572-b5d7-4f26-82e0-5f14e3609ece tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0948754217fc4ff2ba0241fa35feaf90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1aaf20f480a423ea5feca81585aeeed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:05:54.756627 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG dbcounter [-] [120594] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 05:05:54.760272 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.policy [None req-b6c07572-b5d7-4f26-82e0-5f14e3609ece tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0948754217fc4ff2ba0241fa35feaf90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1aaf20f480a423ea5feca81585aeeed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:05:54.762078 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.policy [None req-b6c07572-b5d7-4f26-82e0-5f14e3609ece tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0948754217fc4ff2ba0241fa35feaf90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1aaf20f480a423ea5feca81585aeeed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:05:54.763493 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [None req-b6c07572-b5d7-4f26-82e0-5f14e3609ece tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] 10.222.0.50 "GET /compute/v2.1/servers/08fb826b-e891-46c4-990d-ca03cf3f4222" status: 200 len: 1736 microversion: 2.20 time: 0.181156 Sep 24 05:05:54.764234 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 298/564] 10.222.0.50 () {60 vars in 1277 bytes} [Sat Sep 24 05:05:54 2022] GET /compute/v2.1/servers/08fb826b-e891-46c4-990d-ca03cf3f4222 => generated 1736 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 05:05:55.789332 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-a54770e9-d8bf-47c7-b217-050c08ede791 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Calling method '>' {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:05:55.790154 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.compute.api [None req-a54770e9-d8bf-47c7-b217-050c08ede791 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] [instance: 08fb826b-e891-46c4-990d-ca03cf3f4222] Fetching instance by UUID {{(pid=120593) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:05:55.796935 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-a54770e9-d8bf-47c7-b217-050c08ede791 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:05:55.797478 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-a54770e9-d8bf-47c7-b217-050c08ede791 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:05:55.798383 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-a54770e9-d8bf-47c7-b217-050c08ede791 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:05:55.799268 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-a54770e9-d8bf-47c7-b217-050c08ede791 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:05:55.799900 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-a54770e9-d8bf-47c7-b217-050c08ede791 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:05:55.800534 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-a54770e9-d8bf-47c7-b217-050c08ede791 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:05:55.940399 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-a54770e9-d8bf-47c7-b217-050c08ede791 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0948754217fc4ff2ba0241fa35feaf90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1aaf20f480a423ea5feca81585aeeed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:05:55.949234 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-a54770e9-d8bf-47c7-b217-050c08ede791 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0948754217fc4ff2ba0241fa35feaf90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1aaf20f480a423ea5feca81585aeeed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:05:55.950718 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-a54770e9-d8bf-47c7-b217-050c08ede791 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0948754217fc4ff2ba0241fa35feaf90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1aaf20f480a423ea5feca81585aeeed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:05:55.951873 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-a54770e9-d8bf-47c7-b217-050c08ede791 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] 10.222.0.50 "GET /compute/v2.1/servers/08fb826b-e891-46c4-990d-ca03cf3f4222" status: 200 len: 1736 microversion: 2.20 time: 0.166516 Sep 24 05:05:55.966807 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 267/565] 10.222.0.50 () {60 vars in 1277 bytes} [Sat Sep 24 05:05:55 2022] GET /compute/v2.1/servers/08fb826b-e891-46c4-990d-ca03cf3f4222 => generated 1736 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 05:05:56.933593 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-f95f522c-bbf8-4697-a114-5af5bb2b9a2c tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Calling method '>' {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:05:56.934464 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.compute.api [None req-f95f522c-bbf8-4697-a114-5af5bb2b9a2c tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] [instance: 201433d5-db4e-4e57-a800-42fe5cfc95ca] Fetching instance by UUID {{(pid=120594) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:05:56.944163 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-f95f522c-bbf8-4697-a114-5af5bb2b9a2c tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:05:56.944652 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-f95f522c-bbf8-4697-a114-5af5bb2b9a2c tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:05:56.945120 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-f95f522c-bbf8-4697-a114-5af5bb2b9a2c tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:05:56.945818 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-f95f522c-bbf8-4697-a114-5af5bb2b9a2c tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:05:56.946304 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-f95f522c-bbf8-4697-a114-5af5bb2b9a2c tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:05:56.946729 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-f95f522c-bbf8-4697-a114-5af5bb2b9a2c tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:05:56.971108 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [None req-f95f522c-bbf8-4697-a114-5af5bb2b9a2c tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] 10.222.0.50 "GET /compute/v2.1/servers/201433d5-db4e-4e57-a800-42fe5cfc95ca/ips" status: 200 len: 150 microversion: 2.1 time: 0.044072 Sep 24 05:05:56.971677 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 299/566] 10.222.0.50 () {58 vars in 1248 bytes} [Sat Sep 24 05:05:56 2022] GET /compute/v2.1/servers/201433d5-db4e-4e57-a800-42fe5cfc95ca/ips => generated 150 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 05:05:56.978675 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-b3492e7e-b0f0-4b23-b57f-f86b00edc2c9 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Calling method '>' {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:05:56.979315 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.compute.api [None req-b3492e7e-b0f0-4b23-b57f-f86b00edc2c9 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] [instance: 08fb826b-e891-46c4-990d-ca03cf3f4222] Fetching instance by UUID {{(pid=120593) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:05:56.985532 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-b3492e7e-b0f0-4b23-b57f-f86b00edc2c9 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:05:56.986024 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-b3492e7e-b0f0-4b23-b57f-f86b00edc2c9 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:05:56.986476 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-b3492e7e-b0f0-4b23-b57f-f86b00edc2c9 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:05:56.987164 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-b3492e7e-b0f0-4b23-b57f-f86b00edc2c9 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:05:56.987613 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-b3492e7e-b0f0-4b23-b57f-f86b00edc2c9 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:05:56.988033 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-b3492e7e-b0f0-4b23-b57f-f86b00edc2c9 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:05:57.162166 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-b3492e7e-b0f0-4b23-b57f-f86b00edc2c9 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0948754217fc4ff2ba0241fa35feaf90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1aaf20f480a423ea5feca81585aeeed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:05:57.171048 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-b3492e7e-b0f0-4b23-b57f-f86b00edc2c9 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0948754217fc4ff2ba0241fa35feaf90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1aaf20f480a423ea5feca81585aeeed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:05:57.173103 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-b3492e7e-b0f0-4b23-b57f-f86b00edc2c9 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0948754217fc4ff2ba0241fa35feaf90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1aaf20f480a423ea5feca81585aeeed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:05:57.175839 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-b3492e7e-b0f0-4b23-b57f-f86b00edc2c9 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] 10.222.0.50 "GET /compute/v2.1/servers/08fb826b-e891-46c4-990d-ca03cf3f4222" status: 200 len: 1736 microversion: 2.20 time: 0.199679 Sep 24 05:05:57.190174 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 268/567] 10.222.0.50 () {60 vars in 1277 bytes} [Sat Sep 24 05:05:56 2022] GET /compute/v2.1/servers/08fb826b-e891-46c4-990d-ca03cf3f4222 => generated 1736 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 05:05:57.742073 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-a575280b-0f91-4d36-a0e7-f83ed9d0363b tempest-VolumesSnapshotTestJSON-4159203 tempest-VolumesSnapshotTestJSON-4159203-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1010136146", "imageRef": "75ab730a-d8cc-4ea2-b58f-0f3eb476c976", "flavorRef": "452", "networks": [{"uuid": "6614e23a-5f78-4605-8561-615096892491"}]}} {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 05:05:57.807359 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.network.neutron [None req-a575280b-0f91-4d36-a0e7-f83ed9d0363b tempest-VolumesSnapshotTestJSON-4159203 tempest-VolumesSnapshotTestJSON-4159203-project] validate_networks() for [('6614e23a-5f78-4605-8561-615096892491', None, None, None, None, None)] {{(pid=120594) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 24 05:05:58.205105 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-ff6cca3f-291a-49be-b1f3-37de16ef1b70 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Calling method '>' {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:05:58.207023 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.compute.api [None req-ff6cca3f-291a-49be-b1f3-37de16ef1b70 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] [instance: 08fb826b-e891-46c4-990d-ca03cf3f4222] Fetching instance by UUID {{(pid=120593) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:05:58.215575 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.virt.hardware [None req-a575280b-0f91-4d36-a0e7-f83ed9d0363b tempest-VolumesSnapshotTestJSON-4159203 tempest-VolumesSnapshotTestJSON-4159203-project] Flavor limits 0:0:0 {{(pid=120594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 24 05:05:58.216010 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.virt.hardware [None req-a575280b-0f91-4d36-a0e7-f83ed9d0363b tempest-VolumesSnapshotTestJSON-4159203 tempest-VolumesSnapshotTestJSON-4159203-project] Image limits 0:0:0 {{(pid=120594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 24 05:05:58.216440 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.virt.hardware [None req-a575280b-0f91-4d36-a0e7-f83ed9d0363b tempest-VolumesSnapshotTestJSON-4159203 tempest-VolumesSnapshotTestJSON-4159203-project] Flavor pref 0:0:0 {{(pid=120594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 24 05:05:58.216841 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.virt.hardware [None req-a575280b-0f91-4d36-a0e7-f83ed9d0363b tempest-VolumesSnapshotTestJSON-4159203 tempest-VolumesSnapshotTestJSON-4159203-project] Image pref 0:0:0 {{(pid=120594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 24 05:05:58.217249 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.virt.hardware [None req-a575280b-0f91-4d36-a0e7-f83ed9d0363b tempest-VolumesSnapshotTestJSON-4159203 tempest-VolumesSnapshotTestJSON-4159203-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 24 05:05:58.223731 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-ff6cca3f-291a-49be-b1f3-37de16ef1b70 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:05:58.224261 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-ff6cca3f-291a-49be-b1f3-37de16ef1b70 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:05:58.224860 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-ff6cca3f-291a-49be-b1f3-37de16ef1b70 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:05:58.225569 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-ff6cca3f-291a-49be-b1f3-37de16ef1b70 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:05:58.226221 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-ff6cca3f-291a-49be-b1f3-37de16ef1b70 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:05:58.226644 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-ff6cca3f-291a-49be-b1f3-37de16ef1b70 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:05:58.227129 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-a575280b-0f91-4d36-a0e7-f83ed9d0363b tempest-VolumesSnapshotTestJSON-4159203 tempest-VolumesSnapshotTestJSON-4159203-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:05:58.227681 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-a575280b-0f91-4d36-a0e7-f83ed9d0363b tempest-VolumesSnapshotTestJSON-4159203 tempest-VolumesSnapshotTestJSON-4159203-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:05:58.228119 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-a575280b-0f91-4d36-a0e7-f83ed9d0363b tempest-VolumesSnapshotTestJSON-4159203 tempest-VolumesSnapshotTestJSON-4159203-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:05:58.228845 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-a575280b-0f91-4d36-a0e7-f83ed9d0363b tempest-VolumesSnapshotTestJSON-4159203 tempest-VolumesSnapshotTestJSON-4159203-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:05:58.229297 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-a575280b-0f91-4d36-a0e7-f83ed9d0363b tempest-VolumesSnapshotTestJSON-4159203 tempest-VolumesSnapshotTestJSON-4159203-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:05:58.229889 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-a575280b-0f91-4d36-a0e7-f83ed9d0363b tempest-VolumesSnapshotTestJSON-4159203 tempest-VolumesSnapshotTestJSON-4159203-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:05:58.248386 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.quota [None req-a575280b-0f91-4d36-a0e7-f83ed9d0363b tempest-VolumesSnapshotTestJSON-4159203 tempest-VolumesSnapshotTestJSON-4159203-project] Getting quotas for project 0e942295e9b3478abd521c6f3e60e888. Resources: {'instances', 'ram', 'cores'} {{(pid=120594) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 24 05:05:58.252613 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.quota [None req-a575280b-0f91-4d36-a0e7-f83ed9d0363b tempest-VolumesSnapshotTestJSON-4159203 tempest-VolumesSnapshotTestJSON-4159203-project] Getting quotas for user 358ce5f5c35f415eb79322ae6d187b1d and project 0e942295e9b3478abd521c6f3e60e888. Resources: {'instances', 'ram', 'cores'} {{(pid=120594) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 24 05:05:58.265143 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.compute.api [None req-a575280b-0f91-4d36-a0e7-f83ed9d0363b tempest-VolumesSnapshotTestJSON-4159203 tempest-VolumesSnapshotTestJSON-4159203-project] Going to run 1 instances... {{(pid=120594) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 24 05:05:58.267763 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.compute.api [None req-a575280b-0f91-4d36-a0e7-f83ed9d0363b tempest-VolumesSnapshotTestJSON-4159203 tempest-VolumesSnapshotTestJSON-4159203-project] [instance: 87e09804-74dc-4329-97d5-02be092fd866] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='75ab730a-d8cc-4ea2-b58f-0f3eb476c976',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120594) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 24 05:05:58.329188 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [None req-a575280b-0f91-4d36-a0e7-f83ed9d0363b tempest-VolumesSnapshotTestJSON-4159203 tempest-VolumesSnapshotTestJSON-4159203-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.591529 Sep 24 05:05:58.332064 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 300/568] 10.222.0.50 () {60 vars in 1147 bytes} [Sat Sep 24 05:05:57 2022] POST /compute/v2.1/servers => generated 380 bytes in 595 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 24 05:05:58.356986 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-40249cd4-276d-4f0f-a1f9-e044000ea420 tempest-VolumesSnapshotTestJSON-4159203 tempest-VolumesSnapshotTestJSON-4159203-project] Calling method '>' {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:05:58.357599 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.compute.api [None req-40249cd4-276d-4f0f-a1f9-e044000ea420 tempest-VolumesSnapshotTestJSON-4159203 tempest-VolumesSnapshotTestJSON-4159203-project] [instance: 87e09804-74dc-4329-97d5-02be092fd866] Fetching instance by UUID {{(pid=120594) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:05:58.385481 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-ff6cca3f-291a-49be-b1f3-37de16ef1b70 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0948754217fc4ff2ba0241fa35feaf90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1aaf20f480a423ea5feca81585aeeed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:05:58.394286 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-ff6cca3f-291a-49be-b1f3-37de16ef1b70 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0948754217fc4ff2ba0241fa35feaf90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1aaf20f480a423ea5feca81585aeeed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:05:58.396542 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-ff6cca3f-291a-49be-b1f3-37de16ef1b70 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0948754217fc4ff2ba0241fa35feaf90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1aaf20f480a423ea5feca81585aeeed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:05:58.397968 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-ff6cca3f-291a-49be-b1f3-37de16ef1b70 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] 10.222.0.50 "GET /compute/v2.1/servers/08fb826b-e891-46c4-990d-ca03cf3f4222" status: 200 len: 1736 microversion: 2.20 time: 0.200459 Sep 24 05:05:58.399274 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 269/569] 10.222.0.50 () {60 vars in 1277 bytes} [Sat Sep 24 05:05:58 2022] GET /compute/v2.1/servers/08fb826b-e891-46c4-990d-ca03cf3f4222 => generated 1736 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 24 05:05:58.444589 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.policy [None req-40249cd4-276d-4f0f-a1f9-e044000ea420 tempest-VolumesSnapshotTestJSON-4159203 tempest-VolumesSnapshotTestJSON-4159203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '358ce5f5c35f415eb79322ae6d187b1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e942295e9b3478abd521c6f3e60e888', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:05:58.452439 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [None req-40249cd4-276d-4f0f-a1f9-e044000ea420 tempest-VolumesSnapshotTestJSON-4159203 tempest-VolumesSnapshotTestJSON-4159203-project] 10.222.0.50 "GET /compute/v2.1/servers/87e09804-74dc-4329-97d5-02be092fd866" status: 200 len: 1219 microversion: 2.1 time: 0.112579 Sep 24 05:05:58.453256 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 301/570] 10.222.0.50 () {58 vars in 1236 bytes} [Sat Sep 24 05:05:58 2022] GET /compute/v2.1/servers/87e09804-74dc-4329-97d5-02be092fd866 => generated 1219 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 05:05:58.726014 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-1a120fc6-718f-42be-bdad-7abbe53544c7 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "5eb09f77-d070-410b-a45a-4b4937e742b7"}} {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 05:05:58.728473 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.compute.api [None req-1a120fc6-718f-42be-bdad-7abbe53544c7 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] [instance: b2daebb8-dfea-4ab9-8253-008a21f906e1] Fetching instance by UUID {{(pid=120593) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:05:58.735245 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-1a120fc6-718f-42be-bdad-7abbe53544c7 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:05:58.735785 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-1a120fc6-718f-42be-bdad-7abbe53544c7 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:05:58.736419 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-1a120fc6-718f-42be-bdad-7abbe53544c7 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:05:58.737299 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-1a120fc6-718f-42be-bdad-7abbe53544c7 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:05:58.737956 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-1a120fc6-718f-42be-bdad-7abbe53544c7 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:05:58.738547 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-1a120fc6-718f-42be-bdad-7abbe53544c7 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:05:59.325831 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-1a120fc6-718f-42be-bdad-7abbe53544c7 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] 10.222.0.50 "POST /compute/v2.1/servers/b2daebb8-dfea-4ab9-8253-008a21f906e1/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.604066 Sep 24 05:05:59.327244 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 270/571] 10.222.0.50 () {60 vars in 1323 bytes} [Sat Sep 24 05:05:58 2022] POST /compute/v2.1/servers/b2daebb8-dfea-4ab9-8253-008a21f906e1/os-volume_attachments => generated 194 bytes in 607 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 05:05:59.424077 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-2f842af2-1a9e-443a-a095-e3dde040c930 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Calling method '>' {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:05:59.424831 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.compute.api [None req-2f842af2-1a9e-443a-a095-e3dde040c930 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] [instance: 08fb826b-e891-46c4-990d-ca03cf3f4222] Fetching instance by UUID {{(pid=120594) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:05:59.435801 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-2f842af2-1a9e-443a-a095-e3dde040c930 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:05:59.436600 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-2f842af2-1a9e-443a-a095-e3dde040c930 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:05:59.438668 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-2f842af2-1a9e-443a-a095-e3dde040c930 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:05:59.447131 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-2f842af2-1a9e-443a-a095-e3dde040c930 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:05:59.448363 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-2f842af2-1a9e-443a-a095-e3dde040c930 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:05:59.448976 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-2f842af2-1a9e-443a-a095-e3dde040c930 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:05:59.476112 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-6fc581ae-ddde-4e3b-b24a-3b232796e513 tempest-VolumesSnapshotTestJSON-4159203 tempest-VolumesSnapshotTestJSON-4159203-project] Calling method '>' {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:05:59.476953 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.compute.api [None req-6fc581ae-ddde-4e3b-b24a-3b232796e513 tempest-VolumesSnapshotTestJSON-4159203 tempest-VolumesSnapshotTestJSON-4159203-project] [instance: 87e09804-74dc-4329-97d5-02be092fd866] Fetching instance by UUID {{(pid=120593) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:05:59.489941 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-6fc581ae-ddde-4e3b-b24a-3b232796e513 tempest-VolumesSnapshotTestJSON-4159203 tempest-VolumesSnapshotTestJSON-4159203-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:05:59.495510 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-6fc581ae-ddde-4e3b-b24a-3b232796e513 tempest-VolumesSnapshotTestJSON-4159203 tempest-VolumesSnapshotTestJSON-4159203-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:05:59.497278 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-6fc581ae-ddde-4e3b-b24a-3b232796e513 tempest-VolumesSnapshotTestJSON-4159203 tempest-VolumesSnapshotTestJSON-4159203-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:05:59.498822 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-6fc581ae-ddde-4e3b-b24a-3b232796e513 tempest-VolumesSnapshotTestJSON-4159203 tempest-VolumesSnapshotTestJSON-4159203-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:05:59.500276 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-6fc581ae-ddde-4e3b-b24a-3b232796e513 tempest-VolumesSnapshotTestJSON-4159203 tempest-VolumesSnapshotTestJSON-4159203-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:05:59.501727 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-6fc581ae-ddde-4e3b-b24a-3b232796e513 tempest-VolumesSnapshotTestJSON-4159203 tempest-VolumesSnapshotTestJSON-4159203-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:05:59.684787 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-6fc581ae-ddde-4e3b-b24a-3b232796e513 tempest-VolumesSnapshotTestJSON-4159203 tempest-VolumesSnapshotTestJSON-4159203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '358ce5f5c35f415eb79322ae6d187b1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e942295e9b3478abd521c6f3e60e888', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:05:59.694118 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-6fc581ae-ddde-4e3b-b24a-3b232796e513 tempest-VolumesSnapshotTestJSON-4159203 tempest-VolumesSnapshotTestJSON-4159203-project] 10.222.0.50 "GET /compute/v2.1/servers/87e09804-74dc-4329-97d5-02be092fd866" status: 200 len: 1271 microversion: 2.1 time: 0.222834 Sep 24 05:05:59.694629 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 271/572] 10.222.0.50 () {58 vars in 1236 bytes} [Sat Sep 24 05:05:59 2022] GET /compute/v2.1/servers/87e09804-74dc-4329-97d5-02be092fd866 => generated 1271 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 24 05:05:59.715511 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.policy [None req-2f842af2-1a9e-443a-a095-e3dde040c930 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0948754217fc4ff2ba0241fa35feaf90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1aaf20f480a423ea5feca81585aeeed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:05:59.724276 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.policy [None req-2f842af2-1a9e-443a-a095-e3dde040c930 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0948754217fc4ff2ba0241fa35feaf90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1aaf20f480a423ea5feca81585aeeed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:05:59.726412 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.policy [None req-2f842af2-1a9e-443a-a095-e3dde040c930 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0948754217fc4ff2ba0241fa35feaf90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1aaf20f480a423ea5feca81585aeeed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:05:59.727888 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [None req-2f842af2-1a9e-443a-a095-e3dde040c930 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] 10.222.0.50 "GET /compute/v2.1/servers/08fb826b-e891-46c4-990d-ca03cf3f4222" status: 200 len: 1736 microversion: 2.20 time: 0.308170 Sep 24 05:05:59.733510 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-ab543f4f-91ee-455b-9c54-85bbf4104a81 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "22a35095-46cf-4ed9-9de3-4e3c7adf3ef6"}} {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 05:05:59.736340 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.compute.api [None req-ab543f4f-91ee-455b-9c54-85bbf4104a81 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] [instance: 201433d5-db4e-4e57-a800-42fe5cfc95ca] Fetching instance by UUID {{(pid=120593) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:05:59.738765 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 302/573] 10.222.0.50 () {60 vars in 1277 bytes} [Sat Sep 24 05:05:59 2022] GET /compute/v2.1/servers/08fb826b-e891-46c4-990d-ca03cf3f4222 => generated 1736 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 05:05:59.743595 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-ab543f4f-91ee-455b-9c54-85bbf4104a81 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:05:59.744285 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-ab543f4f-91ee-455b-9c54-85bbf4104a81 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:05:59.744905 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-ab543f4f-91ee-455b-9c54-85bbf4104a81 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:05:59.745761 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-ab543f4f-91ee-455b-9c54-85bbf4104a81 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:05:59.746551 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-ab543f4f-91ee-455b-9c54-85bbf4104a81 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:05:59.747148 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-ab543f4f-91ee-455b-9c54-85bbf4104a81 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:06:00.351875 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-ab543f4f-91ee-455b-9c54-85bbf4104a81 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] 10.222.0.50 "POST /compute/v2.1/servers/201433d5-db4e-4e57-a800-42fe5cfc95ca/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.622317 Sep 24 05:06:00.353704 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 272/574] 10.222.0.50 () {60 vars in 1323 bytes} [Sat Sep 24 05:05:59 2022] POST /compute/v2.1/servers/201433d5-db4e-4e57-a800-42fe5cfc95ca/os-volume_attachments => generated 194 bytes in 625 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 24 05:06:00.728715 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-95731e3c-b23a-45e4-b54b-f9068b795743 tempest-VolumesSnapshotTestJSON-4159203 tempest-VolumesSnapshotTestJSON-4159203-project] Calling method '>' {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:06:00.729642 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.compute.api [None req-95731e3c-b23a-45e4-b54b-f9068b795743 tempest-VolumesSnapshotTestJSON-4159203 tempest-VolumesSnapshotTestJSON-4159203-project] [instance: 87e09804-74dc-4329-97d5-02be092fd866] Fetching instance by UUID {{(pid=120594) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:06:00.736104 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-95731e3c-b23a-45e4-b54b-f9068b795743 tempest-VolumesSnapshotTestJSON-4159203 tempest-VolumesSnapshotTestJSON-4159203-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:06:00.737183 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-95731e3c-b23a-45e4-b54b-f9068b795743 tempest-VolumesSnapshotTestJSON-4159203 tempest-VolumesSnapshotTestJSON-4159203-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:06:00.737183 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-95731e3c-b23a-45e4-b54b-f9068b795743 tempest-VolumesSnapshotTestJSON-4159203 tempest-VolumesSnapshotTestJSON-4159203-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:06:00.737920 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-95731e3c-b23a-45e4-b54b-f9068b795743 tempest-VolumesSnapshotTestJSON-4159203 tempest-VolumesSnapshotTestJSON-4159203-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:06:00.738636 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-95731e3c-b23a-45e4-b54b-f9068b795743 tempest-VolumesSnapshotTestJSON-4159203 tempest-VolumesSnapshotTestJSON-4159203-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:06:00.739139 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-95731e3c-b23a-45e4-b54b-f9068b795743 tempest-VolumesSnapshotTestJSON-4159203 tempest-VolumesSnapshotTestJSON-4159203-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:06:00.756753 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-46fd21de-addf-452d-be14-90fe68da9f51 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Calling method '>' {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:06:00.757720 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.compute.api [None req-46fd21de-addf-452d-be14-90fe68da9f51 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] [instance: 08fb826b-e891-46c4-990d-ca03cf3f4222] Fetching instance by UUID {{(pid=120593) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:06:00.767811 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-46fd21de-addf-452d-be14-90fe68da9f51 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:06:00.768563 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-46fd21de-addf-452d-be14-90fe68da9f51 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:06:00.774717 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-46fd21de-addf-452d-be14-90fe68da9f51 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:06:00.797194 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-46fd21de-addf-452d-be14-90fe68da9f51 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:06:00.798559 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-46fd21de-addf-452d-be14-90fe68da9f51 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:06:00.801467 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-46fd21de-addf-452d-be14-90fe68da9f51 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:06:00.839571 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.policy [None req-95731e3c-b23a-45e4-b54b-f9068b795743 tempest-VolumesSnapshotTestJSON-4159203 tempest-VolumesSnapshotTestJSON-4159203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '358ce5f5c35f415eb79322ae6d187b1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e942295e9b3478abd521c6f3e60e888', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:06:00.854267 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [None req-95731e3c-b23a-45e4-b54b-f9068b795743 tempest-VolumesSnapshotTestJSON-4159203 tempest-VolumesSnapshotTestJSON-4159203-project] 10.222.0.50 "GET /compute/v2.1/servers/87e09804-74dc-4329-97d5-02be092fd866" status: 200 len: 1277 microversion: 2.1 time: 0.129966 Sep 24 05:06:00.855364 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 303/575] 10.222.0.50 () {58 vars in 1236 bytes} [Sat Sep 24 05:06:00 2022] GET /compute/v2.1/servers/87e09804-74dc-4329-97d5-02be092fd866 => generated 1277 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 05:06:01.045569 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-46fd21de-addf-452d-be14-90fe68da9f51 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0948754217fc4ff2ba0241fa35feaf90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1aaf20f480a423ea5feca81585aeeed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:06:01.056359 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-46fd21de-addf-452d-be14-90fe68da9f51 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0948754217fc4ff2ba0241fa35feaf90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1aaf20f480a423ea5feca81585aeeed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:06:01.058971 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-46fd21de-addf-452d-be14-90fe68da9f51 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0948754217fc4ff2ba0241fa35feaf90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1aaf20f480a423ea5feca81585aeeed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:06:01.060368 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-46fd21de-addf-452d-be14-90fe68da9f51 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] 10.222.0.50 "GET /compute/v2.1/servers/08fb826b-e891-46c4-990d-ca03cf3f4222" status: 200 len: 1736 microversion: 2.20 time: 0.308344 Sep 24 05:06:01.061136 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 273/576] 10.222.0.50 () {60 vars in 1277 bytes} [Sat Sep 24 05:06:00 2022] GET /compute/v2.1/servers/08fb826b-e891-46c4-990d-ca03cf3f4222 => generated 1736 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 24 05:06:01.880139 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-f761830a-0173-41ba-bb74-787eda27bb42 tempest-VolumesSnapshotTestJSON-4159203 tempest-VolumesSnapshotTestJSON-4159203-project] Calling method '>' {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:06:01.881394 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.compute.api [None req-f761830a-0173-41ba-bb74-787eda27bb42 tempest-VolumesSnapshotTestJSON-4159203 tempest-VolumesSnapshotTestJSON-4159203-project] [instance: 87e09804-74dc-4329-97d5-02be092fd866] Fetching instance by UUID {{(pid=120594) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:06:01.889550 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-f761830a-0173-41ba-bb74-787eda27bb42 tempest-VolumesSnapshotTestJSON-4159203 tempest-VolumesSnapshotTestJSON-4159203-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:06:01.890702 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-f761830a-0173-41ba-bb74-787eda27bb42 tempest-VolumesSnapshotTestJSON-4159203 tempest-VolumesSnapshotTestJSON-4159203-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:06:01.891327 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-f761830a-0173-41ba-bb74-787eda27bb42 tempest-VolumesSnapshotTestJSON-4159203 tempest-VolumesSnapshotTestJSON-4159203-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:06:01.892103 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-f761830a-0173-41ba-bb74-787eda27bb42 tempest-VolumesSnapshotTestJSON-4159203 tempest-VolumesSnapshotTestJSON-4159203-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:06:01.892557 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-f761830a-0173-41ba-bb74-787eda27bb42 tempest-VolumesSnapshotTestJSON-4159203 tempest-VolumesSnapshotTestJSON-4159203-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:06:01.893160 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-f761830a-0173-41ba-bb74-787eda27bb42 tempest-VolumesSnapshotTestJSON-4159203 tempest-VolumesSnapshotTestJSON-4159203-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:06:02.046923 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [req-d8f3f281-ad92-4032-b3bf-d448d1c13883 req-51176945-28ae-46b9-b4b0-7df8ffe72bfc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "87e09804-74dc-4329-97d5-02be092fd866", "tag": "3709860a-1e61-4d69-8a8e-fb0135138d67"}]} {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 05:06:02.074877 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [req-d8f3f281-ad92-4032-b3bf-d448d1c13883 req-51176945-28ae-46b9-b4b0-7df8ffe72bfc service nova] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:06:02.075355 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [req-d8f3f281-ad92-4032-b3bf-d448d1c13883 req-51176945-28ae-46b9-b4b0-7df8ffe72bfc service nova] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:06:02.078709 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [req-d8f3f281-ad92-4032-b3bf-d448d1c13883 req-51176945-28ae-46b9-b4b0-7df8ffe72bfc service nova] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:06:02.102383 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.compute.server_external_events [req-d8f3f281-ad92-4032-b3bf-d448d1c13883 req-51176945-28ae-46b9-b4b0-7df8ffe72bfc service nova] Creating event network-changed:3709860a-1e61-4d69-8a8e-fb0135138d67 for instance 87e09804-74dc-4329-97d5-02be092fd866 on hv-cinder-85918 Sep 24 05:06:02.112555 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [req-d8f3f281-ad92-4032-b3bf-d448d1c13883 req-51176945-28ae-46b9-b4b0-7df8ffe72bfc service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.072594 Sep 24 05:06:02.117858 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 274/577] 10.222.0.50 () {64 vars in 1317 bytes} [Sat Sep 24 05:06:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 05:06:02.119595 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.policy [None req-f761830a-0173-41ba-bb74-787eda27bb42 tempest-VolumesSnapshotTestJSON-4159203 tempest-VolumesSnapshotTestJSON-4159203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '358ce5f5c35f415eb79322ae6d187b1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e942295e9b3478abd521c6f3e60e888', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:06:02.123470 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-338a25a2-092f-4085-ad3e-7a36b834e1ac tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Calling method '>' {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:06:02.124895 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.compute.api [None req-338a25a2-092f-4085-ad3e-7a36b834e1ac tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] [instance: 08fb826b-e891-46c4-990d-ca03cf3f4222] Fetching instance by UUID {{(pid=120593) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:06:02.131011 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [None req-f761830a-0173-41ba-bb74-787eda27bb42 tempest-VolumesSnapshotTestJSON-4159203 tempest-VolumesSnapshotTestJSON-4159203-project] 10.222.0.50 "GET /compute/v2.1/servers/87e09804-74dc-4329-97d5-02be092fd866" status: 200 len: 1319 microversion: 2.1 time: 0.254694 Sep 24 05:06:02.132369 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-338a25a2-092f-4085-ad3e-7a36b834e1ac tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:06:02.132679 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 304/578] 10.222.0.50 () {58 vars in 1236 bytes} [Sat Sep 24 05:06:01 2022] GET /compute/v2.1/servers/87e09804-74dc-4329-97d5-02be092fd866 => generated 1319 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 24 05:06:02.133263 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-338a25a2-092f-4085-ad3e-7a36b834e1ac tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:06:02.133877 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-338a25a2-092f-4085-ad3e-7a36b834e1ac tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:06:02.134765 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-338a25a2-092f-4085-ad3e-7a36b834e1ac tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:06:02.135225 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-338a25a2-092f-4085-ad3e-7a36b834e1ac tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:06:02.135648 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-338a25a2-092f-4085-ad3e-7a36b834e1ac tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:06:02.285377 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-338a25a2-092f-4085-ad3e-7a36b834e1ac tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0948754217fc4ff2ba0241fa35feaf90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1aaf20f480a423ea5feca81585aeeed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:06:02.294843 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-338a25a2-092f-4085-ad3e-7a36b834e1ac tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0948754217fc4ff2ba0241fa35feaf90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1aaf20f480a423ea5feca81585aeeed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:06:02.296550 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-338a25a2-092f-4085-ad3e-7a36b834e1ac tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0948754217fc4ff2ba0241fa35feaf90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1aaf20f480a423ea5feca81585aeeed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:06:02.297897 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-338a25a2-092f-4085-ad3e-7a36b834e1ac tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] 10.222.0.50 "GET /compute/v2.1/servers/08fb826b-e891-46c4-990d-ca03cf3f4222" status: 200 len: 1736 microversion: 2.20 time: 0.178758 Sep 24 05:06:02.298986 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 275/579] 10.222.0.50 () {60 vars in 1277 bytes} [Sat Sep 24 05:06:02 2022] GET /compute/v2.1/servers/08fb826b-e891-46c4-990d-ca03cf3f4222 => generated 1736 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 05:06:03.154340 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-ed7d207c-d746-4ad6-85fc-b4e7acb48612 tempest-VolumesSnapshotTestJSON-4159203 tempest-VolumesSnapshotTestJSON-4159203-project] Calling method '>' {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:06:03.155133 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.compute.api [None req-ed7d207c-d746-4ad6-85fc-b4e7acb48612 tempest-VolumesSnapshotTestJSON-4159203 tempest-VolumesSnapshotTestJSON-4159203-project] [instance: 87e09804-74dc-4329-97d5-02be092fd866] Fetching instance by UUID {{(pid=120594) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:06:03.161370 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-ed7d207c-d746-4ad6-85fc-b4e7acb48612 tempest-VolumesSnapshotTestJSON-4159203 tempest-VolumesSnapshotTestJSON-4159203-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:06:03.162667 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-ed7d207c-d746-4ad6-85fc-b4e7acb48612 tempest-VolumesSnapshotTestJSON-4159203 tempest-VolumesSnapshotTestJSON-4159203-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:06:03.163330 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-ed7d207c-d746-4ad6-85fc-b4e7acb48612 tempest-VolumesSnapshotTestJSON-4159203 tempest-VolumesSnapshotTestJSON-4159203-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:06:03.164026 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-ed7d207c-d746-4ad6-85fc-b4e7acb48612 tempest-VolumesSnapshotTestJSON-4159203 tempest-VolumesSnapshotTestJSON-4159203-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:06:03.164480 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-ed7d207c-d746-4ad6-85fc-b4e7acb48612 tempest-VolumesSnapshotTestJSON-4159203 tempest-VolumesSnapshotTestJSON-4159203-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:06:03.164902 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-ed7d207c-d746-4ad6-85fc-b4e7acb48612 tempest-VolumesSnapshotTestJSON-4159203 tempest-VolumesSnapshotTestJSON-4159203-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:06:03.300743 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.policy [None req-ed7d207c-d746-4ad6-85fc-b4e7acb48612 tempest-VolumesSnapshotTestJSON-4159203 tempest-VolumesSnapshotTestJSON-4159203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '358ce5f5c35f415eb79322ae6d187b1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e942295e9b3478abd521c6f3e60e888', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:06:03.309350 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [None req-ed7d207c-d746-4ad6-85fc-b4e7acb48612 tempest-VolumesSnapshotTestJSON-4159203 tempest-VolumesSnapshotTestJSON-4159203-project] 10.222.0.50 "GET /compute/v2.1/servers/87e09804-74dc-4329-97d5-02be092fd866" status: 200 len: 1319 microversion: 2.1 time: 0.159456 Sep 24 05:06:03.309925 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 305/580] 10.222.0.50 () {58 vars in 1236 bytes} [Sat Sep 24 05:06:03 2022] GET /compute/v2.1/servers/87e09804-74dc-4329-97d5-02be092fd866 => generated 1319 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 05:06:03.325372 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-4408041a-9729-44a1-9128-f0415c3e6f90 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Calling method '>' {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:06:03.326687 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.compute.api [None req-4408041a-9729-44a1-9128-f0415c3e6f90 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] [instance: 08fb826b-e891-46c4-990d-ca03cf3f4222] Fetching instance by UUID {{(pid=120593) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:06:03.333719 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-4408041a-9729-44a1-9128-f0415c3e6f90 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:06:03.334234 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-4408041a-9729-44a1-9128-f0415c3e6f90 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:06:03.334697 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-4408041a-9729-44a1-9128-f0415c3e6f90 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:06:03.335748 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-4408041a-9729-44a1-9128-f0415c3e6f90 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:06:03.336202 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-4408041a-9729-44a1-9128-f0415c3e6f90 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:06:03.336624 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-4408041a-9729-44a1-9128-f0415c3e6f90 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:06:03.478845 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-4408041a-9729-44a1-9128-f0415c3e6f90 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0948754217fc4ff2ba0241fa35feaf90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1aaf20f480a423ea5feca81585aeeed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:06:03.487319 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-4408041a-9729-44a1-9128-f0415c3e6f90 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0948754217fc4ff2ba0241fa35feaf90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1aaf20f480a423ea5feca81585aeeed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:06:03.488848 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-4408041a-9729-44a1-9128-f0415c3e6f90 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0948754217fc4ff2ba0241fa35feaf90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1aaf20f480a423ea5feca81585aeeed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:06:03.490756 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-4408041a-9729-44a1-9128-f0415c3e6f90 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] 10.222.0.50 "GET /compute/v2.1/servers/08fb826b-e891-46c4-990d-ca03cf3f4222" status: 200 len: 1736 microversion: 2.20 time: 0.169881 Sep 24 05:06:03.491403 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 276/581] 10.222.0.50 () {60 vars in 1277 bytes} [Sat Sep 24 05:06:03 2022] GET /compute/v2.1/servers/08fb826b-e891-46c4-990d-ca03cf3f4222 => generated 1736 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 05:06:04.331812 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-3f25c682-7c68-4a98-8cb8-e5fd2aa791e4 tempest-VolumesSnapshotTestJSON-4159203 tempest-VolumesSnapshotTestJSON-4159203-project] Calling method '>' {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:06:04.332427 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.compute.api [None req-3f25c682-7c68-4a98-8cb8-e5fd2aa791e4 tempest-VolumesSnapshotTestJSON-4159203 tempest-VolumesSnapshotTestJSON-4159203-project] [instance: 87e09804-74dc-4329-97d5-02be092fd866] Fetching instance by UUID {{(pid=120594) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:06:04.339318 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-3f25c682-7c68-4a98-8cb8-e5fd2aa791e4 tempest-VolumesSnapshotTestJSON-4159203 tempest-VolumesSnapshotTestJSON-4159203-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:06:04.339792 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-3f25c682-7c68-4a98-8cb8-e5fd2aa791e4 tempest-VolumesSnapshotTestJSON-4159203 tempest-VolumesSnapshotTestJSON-4159203-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:06:04.340226 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-3f25c682-7c68-4a98-8cb8-e5fd2aa791e4 tempest-VolumesSnapshotTestJSON-4159203 tempest-VolumesSnapshotTestJSON-4159203-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:06:04.340906 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-3f25c682-7c68-4a98-8cb8-e5fd2aa791e4 tempest-VolumesSnapshotTestJSON-4159203 tempest-VolumesSnapshotTestJSON-4159203-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:06:04.341355 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-3f25c682-7c68-4a98-8cb8-e5fd2aa791e4 tempest-VolumesSnapshotTestJSON-4159203 tempest-VolumesSnapshotTestJSON-4159203-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:06:04.341775 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-3f25c682-7c68-4a98-8cb8-e5fd2aa791e4 tempest-VolumesSnapshotTestJSON-4159203 tempest-VolumesSnapshotTestJSON-4159203-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:06:04.470656 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.policy [None req-3f25c682-7c68-4a98-8cb8-e5fd2aa791e4 tempest-VolumesSnapshotTestJSON-4159203 tempest-VolumesSnapshotTestJSON-4159203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '358ce5f5c35f415eb79322ae6d187b1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e942295e9b3478abd521c6f3e60e888', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:06:04.479306 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [None req-3f25c682-7c68-4a98-8cb8-e5fd2aa791e4 tempest-VolumesSnapshotTestJSON-4159203 tempest-VolumesSnapshotTestJSON-4159203-project] 10.222.0.50 "GET /compute/v2.1/servers/87e09804-74dc-4329-97d5-02be092fd866" status: 200 len: 1319 microversion: 2.1 time: 0.151298 Sep 24 05:06:04.480124 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 306/582] 10.222.0.50 () {58 vars in 1236 bytes} [Sat Sep 24 05:06:04 2022] GET /compute/v2.1/servers/87e09804-74dc-4329-97d5-02be092fd866 => generated 1319 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 05:06:04.515968 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-f6449022-eb3b-44bc-8e22-5d5630e87431 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Calling method '>' {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:06:04.516578 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.compute.api [None req-f6449022-eb3b-44bc-8e22-5d5630e87431 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] [instance: 08fb826b-e891-46c4-990d-ca03cf3f4222] Fetching instance by UUID {{(pid=120593) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:06:04.523817 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-f6449022-eb3b-44bc-8e22-5d5630e87431 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:06:04.524294 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-f6449022-eb3b-44bc-8e22-5d5630e87431 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:06:04.524730 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-f6449022-eb3b-44bc-8e22-5d5630e87431 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:06:04.525423 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-f6449022-eb3b-44bc-8e22-5d5630e87431 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:06:04.525874 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-f6449022-eb3b-44bc-8e22-5d5630e87431 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:06:04.526328 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-f6449022-eb3b-44bc-8e22-5d5630e87431 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:06:04.656857 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-f6449022-eb3b-44bc-8e22-5d5630e87431 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0948754217fc4ff2ba0241fa35feaf90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1aaf20f480a423ea5feca81585aeeed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:06:04.665743 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-f6449022-eb3b-44bc-8e22-5d5630e87431 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0948754217fc4ff2ba0241fa35feaf90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1aaf20f480a423ea5feca81585aeeed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:06:04.667208 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-f6449022-eb3b-44bc-8e22-5d5630e87431 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0948754217fc4ff2ba0241fa35feaf90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1aaf20f480a423ea5feca81585aeeed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:06:04.668406 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-f6449022-eb3b-44bc-8e22-5d5630e87431 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] 10.222.0.50 "GET /compute/v2.1/servers/08fb826b-e891-46c4-990d-ca03cf3f4222" status: 200 len: 1736 microversion: 2.20 time: 0.156413 Sep 24 05:06:04.668963 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 277/583] 10.222.0.50 () {60 vars in 1277 bytes} [Sat Sep 24 05:06:04 2022] GET /compute/v2.1/servers/08fb826b-e891-46c4-990d-ca03cf3f4222 => generated 1736 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 05:06:05.502269 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-11f2194b-8ba5-4b88-8f00-b403b6af5ed4 tempest-VolumesSnapshotTestJSON-4159203 tempest-VolumesSnapshotTestJSON-4159203-project] Calling method '>' {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:06:05.502881 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.compute.api [None req-11f2194b-8ba5-4b88-8f00-b403b6af5ed4 tempest-VolumesSnapshotTestJSON-4159203 tempest-VolumesSnapshotTestJSON-4159203-project] [instance: 87e09804-74dc-4329-97d5-02be092fd866] Fetching instance by UUID {{(pid=120594) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:06:05.509691 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-11f2194b-8ba5-4b88-8f00-b403b6af5ed4 tempest-VolumesSnapshotTestJSON-4159203 tempest-VolumesSnapshotTestJSON-4159203-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:06:05.510193 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-11f2194b-8ba5-4b88-8f00-b403b6af5ed4 tempest-VolumesSnapshotTestJSON-4159203 tempest-VolumesSnapshotTestJSON-4159203-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:06:05.510626 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-11f2194b-8ba5-4b88-8f00-b403b6af5ed4 tempest-VolumesSnapshotTestJSON-4159203 tempest-VolumesSnapshotTestJSON-4159203-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:06:05.511299 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-11f2194b-8ba5-4b88-8f00-b403b6af5ed4 tempest-VolumesSnapshotTestJSON-4159203 tempest-VolumesSnapshotTestJSON-4159203-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:06:05.511744 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-11f2194b-8ba5-4b88-8f00-b403b6af5ed4 tempest-VolumesSnapshotTestJSON-4159203 tempest-VolumesSnapshotTestJSON-4159203-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:06:05.512159 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-11f2194b-8ba5-4b88-8f00-b403b6af5ed4 tempest-VolumesSnapshotTestJSON-4159203 tempest-VolumesSnapshotTestJSON-4159203-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:06:05.644488 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.policy [None req-11f2194b-8ba5-4b88-8f00-b403b6af5ed4 tempest-VolumesSnapshotTestJSON-4159203 tempest-VolumesSnapshotTestJSON-4159203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '358ce5f5c35f415eb79322ae6d187b1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e942295e9b3478abd521c6f3e60e888', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:06:05.652432 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [None req-11f2194b-8ba5-4b88-8f00-b403b6af5ed4 tempest-VolumesSnapshotTestJSON-4159203 tempest-VolumesSnapshotTestJSON-4159203-project] 10.222.0.50 "GET /compute/v2.1/servers/87e09804-74dc-4329-97d5-02be092fd866" status: 200 len: 1319 microversion: 2.1 time: 0.153982 Sep 24 05:06:05.652995 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 307/584] 10.222.0.50 () {58 vars in 1236 bytes} [Sat Sep 24 05:06:05 2022] GET /compute/v2.1/servers/87e09804-74dc-4329-97d5-02be092fd866 => generated 1319 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 05:06:05.693067 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-6a4a983b-7ed9-4e49-b774-9856394becbb tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Calling method '>' {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:06:05.693666 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.compute.api [None req-6a4a983b-7ed9-4e49-b774-9856394becbb tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] [instance: 08fb826b-e891-46c4-990d-ca03cf3f4222] Fetching instance by UUID {{(pid=120593) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:06:05.699944 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-6a4a983b-7ed9-4e49-b774-9856394becbb tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:06:05.700411 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-6a4a983b-7ed9-4e49-b774-9856394becbb tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:06:05.700838 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-6a4a983b-7ed9-4e49-b774-9856394becbb tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:06:05.701507 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-6a4a983b-7ed9-4e49-b774-9856394becbb tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:06:05.701945 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-6a4a983b-7ed9-4e49-b774-9856394becbb tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:06:05.702393 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-6a4a983b-7ed9-4e49-b774-9856394becbb tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:06:05.828679 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-6a4a983b-7ed9-4e49-b774-9856394becbb tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0948754217fc4ff2ba0241fa35feaf90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1aaf20f480a423ea5feca81585aeeed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:06:05.837088 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-6a4a983b-7ed9-4e49-b774-9856394becbb tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0948754217fc4ff2ba0241fa35feaf90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1aaf20f480a423ea5feca81585aeeed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:06:05.838537 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-6a4a983b-7ed9-4e49-b774-9856394becbb tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0948754217fc4ff2ba0241fa35feaf90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1aaf20f480a423ea5feca81585aeeed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:06:05.839672 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-6a4a983b-7ed9-4e49-b774-9856394becbb tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] 10.222.0.50 "GET /compute/v2.1/servers/08fb826b-e891-46c4-990d-ca03cf3f4222" status: 200 len: 1736 microversion: 2.20 time: 0.150537 Sep 24 05:06:05.840216 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 278/585] 10.222.0.50 () {60 vars in 1277 bytes} [Sat Sep 24 05:06:05 2022] GET /compute/v2.1/servers/08fb826b-e891-46c4-990d-ca03cf3f4222 => generated 1736 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 05:06:06.675158 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-75ee3ca2-8693-4a91-89e4-43085c371230 tempest-VolumesSnapshotTestJSON-4159203 tempest-VolumesSnapshotTestJSON-4159203-project] Calling method '>' {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:06:06.675886 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.compute.api [None req-75ee3ca2-8693-4a91-89e4-43085c371230 tempest-VolumesSnapshotTestJSON-4159203 tempest-VolumesSnapshotTestJSON-4159203-project] [instance: 87e09804-74dc-4329-97d5-02be092fd866] Fetching instance by UUID {{(pid=120594) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:06:06.682667 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-75ee3ca2-8693-4a91-89e4-43085c371230 tempest-VolumesSnapshotTestJSON-4159203 tempest-VolumesSnapshotTestJSON-4159203-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:06:06.683152 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-75ee3ca2-8693-4a91-89e4-43085c371230 tempest-VolumesSnapshotTestJSON-4159203 tempest-VolumesSnapshotTestJSON-4159203-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:06:06.683584 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-75ee3ca2-8693-4a91-89e4-43085c371230 tempest-VolumesSnapshotTestJSON-4159203 tempest-VolumesSnapshotTestJSON-4159203-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:06:06.684268 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-75ee3ca2-8693-4a91-89e4-43085c371230 tempest-VolumesSnapshotTestJSON-4159203 tempest-VolumesSnapshotTestJSON-4159203-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:06:06.684752 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-75ee3ca2-8693-4a91-89e4-43085c371230 tempest-VolumesSnapshotTestJSON-4159203 tempest-VolumesSnapshotTestJSON-4159203-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:06:06.685172 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-75ee3ca2-8693-4a91-89e4-43085c371230 tempest-VolumesSnapshotTestJSON-4159203 tempest-VolumesSnapshotTestJSON-4159203-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:06:06.817883 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.policy [None req-75ee3ca2-8693-4a91-89e4-43085c371230 tempest-VolumesSnapshotTestJSON-4159203 tempest-VolumesSnapshotTestJSON-4159203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '358ce5f5c35f415eb79322ae6d187b1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e942295e9b3478abd521c6f3e60e888', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:06:06.825683 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [None req-75ee3ca2-8693-4a91-89e4-43085c371230 tempest-VolumesSnapshotTestJSON-4159203 tempest-VolumesSnapshotTestJSON-4159203-project] 10.222.0.50 "GET /compute/v2.1/servers/87e09804-74dc-4329-97d5-02be092fd866" status: 200 len: 1319 microversion: 2.1 time: 0.154397 Sep 24 05:06:06.826400 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 308/586] 10.222.0.50 () {58 vars in 1236 bytes} [Sat Sep 24 05:06:06 2022] GET /compute/v2.1/servers/87e09804-74dc-4329-97d5-02be092fd866 => generated 1319 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 05:06:06.864631 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-c924cde0-e28f-42b6-afcd-7e46299665ef tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Calling method '>' {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:06:06.865245 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.compute.api [None req-c924cde0-e28f-42b6-afcd-7e46299665ef tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] [instance: 08fb826b-e891-46c4-990d-ca03cf3f4222] Fetching instance by UUID {{(pid=120593) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:06:06.871553 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-c924cde0-e28f-42b6-afcd-7e46299665ef tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:06:06.872036 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-c924cde0-e28f-42b6-afcd-7e46299665ef tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:06:06.872470 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-c924cde0-e28f-42b6-afcd-7e46299665ef tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:06:06.873189 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-c924cde0-e28f-42b6-afcd-7e46299665ef tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:06:06.873637 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-c924cde0-e28f-42b6-afcd-7e46299665ef tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:06:06.874118 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-c924cde0-e28f-42b6-afcd-7e46299665ef tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:06:07.002844 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-c924cde0-e28f-42b6-afcd-7e46299665ef tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0948754217fc4ff2ba0241fa35feaf90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1aaf20f480a423ea5feca81585aeeed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:06:07.011394 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-c924cde0-e28f-42b6-afcd-7e46299665ef tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0948754217fc4ff2ba0241fa35feaf90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1aaf20f480a423ea5feca81585aeeed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:06:07.012760 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-c924cde0-e28f-42b6-afcd-7e46299665ef tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0948754217fc4ff2ba0241fa35feaf90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1aaf20f480a423ea5feca81585aeeed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:06:07.013968 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-c924cde0-e28f-42b6-afcd-7e46299665ef tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] 10.222.0.50 "GET /compute/v2.1/servers/08fb826b-e891-46c4-990d-ca03cf3f4222" status: 200 len: 1736 microversion: 2.20 time: 0.153256 Sep 24 05:06:07.014546 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 279/587] 10.222.0.50 () {60 vars in 1277 bytes} [Sat Sep 24 05:06:06 2022] GET /compute/v2.1/servers/08fb826b-e891-46c4-990d-ca03cf3f4222 => generated 1736 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 05:06:07.848379 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-da9f8841-0fea-470a-88d5-8aabe8d5f5a5 tempest-VolumesSnapshotTestJSON-4159203 tempest-VolumesSnapshotTestJSON-4159203-project] Calling method '>' {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:06:07.849021 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.compute.api [None req-da9f8841-0fea-470a-88d5-8aabe8d5f5a5 tempest-VolumesSnapshotTestJSON-4159203 tempest-VolumesSnapshotTestJSON-4159203-project] [instance: 87e09804-74dc-4329-97d5-02be092fd866] Fetching instance by UUID {{(pid=120594) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:06:07.855469 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-da9f8841-0fea-470a-88d5-8aabe8d5f5a5 tempest-VolumesSnapshotTestJSON-4159203 tempest-VolumesSnapshotTestJSON-4159203-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:06:07.855943 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-da9f8841-0fea-470a-88d5-8aabe8d5f5a5 tempest-VolumesSnapshotTestJSON-4159203 tempest-VolumesSnapshotTestJSON-4159203-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:06:07.856385 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-da9f8841-0fea-470a-88d5-8aabe8d5f5a5 tempest-VolumesSnapshotTestJSON-4159203 tempest-VolumesSnapshotTestJSON-4159203-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:06:07.857065 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-da9f8841-0fea-470a-88d5-8aabe8d5f5a5 tempest-VolumesSnapshotTestJSON-4159203 tempest-VolumesSnapshotTestJSON-4159203-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:06:07.857505 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-da9f8841-0fea-470a-88d5-8aabe8d5f5a5 tempest-VolumesSnapshotTestJSON-4159203 tempest-VolumesSnapshotTestJSON-4159203-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:06:07.857918 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-da9f8841-0fea-470a-88d5-8aabe8d5f5a5 tempest-VolumesSnapshotTestJSON-4159203 tempest-VolumesSnapshotTestJSON-4159203-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:06:07.986423 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.policy [None req-da9f8841-0fea-470a-88d5-8aabe8d5f5a5 tempest-VolumesSnapshotTestJSON-4159203 tempest-VolumesSnapshotTestJSON-4159203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '358ce5f5c35f415eb79322ae6d187b1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e942295e9b3478abd521c6f3e60e888', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:06:07.995605 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [None req-da9f8841-0fea-470a-88d5-8aabe8d5f5a5 tempest-VolumesSnapshotTestJSON-4159203 tempest-VolumesSnapshotTestJSON-4159203-project] 10.222.0.50 "GET /compute/v2.1/servers/87e09804-74dc-4329-97d5-02be092fd866" status: 200 len: 1319 microversion: 2.1 time: 0.150903 Sep 24 05:06:07.996177 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 309/588] 10.222.0.50 () {58 vars in 1236 bytes} [Sat Sep 24 05:06:07 2022] GET /compute/v2.1/servers/87e09804-74dc-4329-97d5-02be092fd866 => generated 1319 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 05:06:08.041444 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-fbfbc878-87fc-4fba-9355-df3aedaec912 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Calling method '>' {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:06:08.042065 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.compute.api [None req-fbfbc878-87fc-4fba-9355-df3aedaec912 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] [instance: 08fb826b-e891-46c4-990d-ca03cf3f4222] Fetching instance by UUID {{(pid=120593) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:06:08.048296 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-fbfbc878-87fc-4fba-9355-df3aedaec912 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:06:08.048766 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-fbfbc878-87fc-4fba-9355-df3aedaec912 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:06:08.049193 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-fbfbc878-87fc-4fba-9355-df3aedaec912 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:06:08.049867 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-fbfbc878-87fc-4fba-9355-df3aedaec912 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:06:08.050365 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-fbfbc878-87fc-4fba-9355-df3aedaec912 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:06:08.050786 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-fbfbc878-87fc-4fba-9355-df3aedaec912 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:06:08.055194 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG dbcounter [-] [120593] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=120593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 05:06:08.185554 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-fbfbc878-87fc-4fba-9355-df3aedaec912 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0948754217fc4ff2ba0241fa35feaf90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1aaf20f480a423ea5feca81585aeeed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:06:08.194114 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-fbfbc878-87fc-4fba-9355-df3aedaec912 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0948754217fc4ff2ba0241fa35feaf90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1aaf20f480a423ea5feca81585aeeed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:06:08.195548 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-fbfbc878-87fc-4fba-9355-df3aedaec912 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0948754217fc4ff2ba0241fa35feaf90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1aaf20f480a423ea5feca81585aeeed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:06:08.196682 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-fbfbc878-87fc-4fba-9355-df3aedaec912 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] 10.222.0.50 "GET /compute/v2.1/servers/08fb826b-e891-46c4-990d-ca03cf3f4222" status: 200 len: 1736 microversion: 2.20 time: 0.160249 Sep 24 05:06:08.197231 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 280/589] 10.222.0.50 () {60 vars in 1277 bytes} [Sat Sep 24 05:06:08 2022] GET /compute/v2.1/servers/08fb826b-e891-46c4-990d-ca03cf3f4222 => generated 1736 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 05:06:09.018981 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-573f39b7-e0ab-4b5c-a9e2-f9afe8d610fd tempest-VolumesSnapshotTestJSON-4159203 tempest-VolumesSnapshotTestJSON-4159203-project] Calling method '>' {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:06:09.019627 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.compute.api [None req-573f39b7-e0ab-4b5c-a9e2-f9afe8d610fd tempest-VolumesSnapshotTestJSON-4159203 tempest-VolumesSnapshotTestJSON-4159203-project] [instance: 87e09804-74dc-4329-97d5-02be092fd866] Fetching instance by UUID {{(pid=120594) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:06:09.021946 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG dbcounter [-] [120594] Writing DB stats nova_cell0:SELECT=2 {{(pid=120594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 05:06:09.022631 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG dbcounter [-] [120594] Writing DB stats nova_cell0:SELECT=8 {{(pid=120594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 05:06:09.031237 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-573f39b7-e0ab-4b5c-a9e2-f9afe8d610fd tempest-VolumesSnapshotTestJSON-4159203 tempest-VolumesSnapshotTestJSON-4159203-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:06:09.031719 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-573f39b7-e0ab-4b5c-a9e2-f9afe8d610fd tempest-VolumesSnapshotTestJSON-4159203 tempest-VolumesSnapshotTestJSON-4159203-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:06:09.032145 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-573f39b7-e0ab-4b5c-a9e2-f9afe8d610fd tempest-VolumesSnapshotTestJSON-4159203 tempest-VolumesSnapshotTestJSON-4159203-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:06:09.033037 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-573f39b7-e0ab-4b5c-a9e2-f9afe8d610fd tempest-VolumesSnapshotTestJSON-4159203 tempest-VolumesSnapshotTestJSON-4159203-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:06:09.033488 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-573f39b7-e0ab-4b5c-a9e2-f9afe8d610fd tempest-VolumesSnapshotTestJSON-4159203 tempest-VolumesSnapshotTestJSON-4159203-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:06:09.033907 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-573f39b7-e0ab-4b5c-a9e2-f9afe8d610fd tempest-VolumesSnapshotTestJSON-4159203 tempest-VolumesSnapshotTestJSON-4159203-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:06:09.175630 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.policy [None req-573f39b7-e0ab-4b5c-a9e2-f9afe8d610fd tempest-VolumesSnapshotTestJSON-4159203 tempest-VolumesSnapshotTestJSON-4159203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '358ce5f5c35f415eb79322ae6d187b1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e942295e9b3478abd521c6f3e60e888', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:06:09.183851 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [None req-573f39b7-e0ab-4b5c-a9e2-f9afe8d610fd tempest-VolumesSnapshotTestJSON-4159203 tempest-VolumesSnapshotTestJSON-4159203-project] 10.222.0.50 "GET /compute/v2.1/servers/87e09804-74dc-4329-97d5-02be092fd866" status: 200 len: 1319 microversion: 2.1 time: 0.168709 Sep 24 05:06:09.184451 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 310/590] 10.222.0.50 () {58 vars in 1236 bytes} [Sat Sep 24 05:06:09 2022] GET /compute/v2.1/servers/87e09804-74dc-4329-97d5-02be092fd866 => generated 1319 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 05:06:09.220570 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-7878bca9-795e-4e36-b6ca-5587afdc053f tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Calling method '>' {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:06:09.221168 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.compute.api [None req-7878bca9-795e-4e36-b6ca-5587afdc053f tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] [instance: 08fb826b-e891-46c4-990d-ca03cf3f4222] Fetching instance by UUID {{(pid=120593) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:06:09.227833 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-7878bca9-795e-4e36-b6ca-5587afdc053f tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:06:09.228302 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-7878bca9-795e-4e36-b6ca-5587afdc053f tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:06:09.228729 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-7878bca9-795e-4e36-b6ca-5587afdc053f tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:06:09.229412 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-7878bca9-795e-4e36-b6ca-5587afdc053f tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:06:09.229853 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-7878bca9-795e-4e36-b6ca-5587afdc053f tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:06:09.230314 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-7878bca9-795e-4e36-b6ca-5587afdc053f tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:06:09.366918 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-7878bca9-795e-4e36-b6ca-5587afdc053f tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0948754217fc4ff2ba0241fa35feaf90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1aaf20f480a423ea5feca81585aeeed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:06:09.375316 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-7878bca9-795e-4e36-b6ca-5587afdc053f tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0948754217fc4ff2ba0241fa35feaf90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1aaf20f480a423ea5feca81585aeeed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:06:09.376909 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-7878bca9-795e-4e36-b6ca-5587afdc053f tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0948754217fc4ff2ba0241fa35feaf90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1aaf20f480a423ea5feca81585aeeed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:06:09.378096 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-7878bca9-795e-4e36-b6ca-5587afdc053f tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] 10.222.0.50 "GET /compute/v2.1/servers/08fb826b-e891-46c4-990d-ca03cf3f4222" status: 200 len: 1718 microversion: 2.20 time: 0.161355 Sep 24 05:06:09.378849 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 281/591] 10.222.0.50 () {60 vars in 1277 bytes} [Sat Sep 24 05:06:09 2022] GET /compute/v2.1/servers/08fb826b-e891-46c4-990d-ca03cf3f4222 => generated 1718 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 05:06:09.599059 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [req-d9ee0a44-eaea-4f01-ac84-65bdbee822e1 req-ab716e3f-d2ac-4946-82b4-e34e6881f7f8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "87e09804-74dc-4329-97d5-02be092fd866", "name": "network-vif-plugged", "status": "completed", "tag": "3709860a-1e61-4d69-8a8e-fb0135138d67"}]} {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 05:06:09.610032 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [req-d9ee0a44-eaea-4f01-ac84-65bdbee822e1 req-ab716e3f-d2ac-4946-82b4-e34e6881f7f8 service nova] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:06:09.610518 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [req-d9ee0a44-eaea-4f01-ac84-65bdbee822e1 req-ab716e3f-d2ac-4946-82b4-e34e6881f7f8 service nova] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:06:09.610938 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [req-d9ee0a44-eaea-4f01-ac84-65bdbee822e1 req-ab716e3f-d2ac-4946-82b4-e34e6881f7f8 service nova] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:06:09.625875 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: INFO nova.api.openstack.compute.server_external_events [req-d9ee0a44-eaea-4f01-ac84-65bdbee822e1 req-ab716e3f-d2ac-4946-82b4-e34e6881f7f8 service nova] Creating event network-vif-plugged:3709860a-1e61-4d69-8a8e-fb0135138d67 for instance 87e09804-74dc-4329-97d5-02be092fd866 on hv-cinder-85918 Sep 24 05:06:09.632037 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [req-d9ee0a44-eaea-4f01-ac84-65bdbee822e1 req-ab716e3f-d2ac-4946-82b4-e34e6881f7f8 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036731 Sep 24 05:06:09.632826 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 311/592] 10.222.0.50 () {64 vars in 1317 bytes} [Sat Sep 24 05:06:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 05:06:10.131588 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-d1476415-3624-4f17-8a19-4f8422a0e865 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 05:06:10.133464 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG dbcounter [-] [120593] Writing DB stats nova_api:SELECT=50 {{(pid=120593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 05:06:10.138476 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-d1476415-3624-4f17-8a19-4f8422a0e865 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:06:10.138952 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-d1476415-3624-4f17-8a19-4f8422a0e865 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:06:10.139380 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-d1476415-3624-4f17-8a19-4f8422a0e865 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:06:10.200567 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.compute.api [None req-d1476415-3624-4f17-8a19-4f8422a0e865 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] [instance: b2daebb8-dfea-4ab9-8253-008a21f906e1] Going to try to stop instance {{(pid=120593) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Sep 24 05:06:10.208042 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-a492d514-7f71-4376-b713-1bdf2d1ba76c tempest-VolumesSnapshotTestJSON-4159203 tempest-VolumesSnapshotTestJSON-4159203-project] Calling method '>' {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:06:10.209279 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.compute.api [None req-a492d514-7f71-4376-b713-1bdf2d1ba76c tempest-VolumesSnapshotTestJSON-4159203 tempest-VolumesSnapshotTestJSON-4159203-project] [instance: 87e09804-74dc-4329-97d5-02be092fd866] Fetching instance by UUID {{(pid=120594) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:06:10.215219 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-a492d514-7f71-4376-b713-1bdf2d1ba76c tempest-VolumesSnapshotTestJSON-4159203 tempest-VolumesSnapshotTestJSON-4159203-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:06:10.215695 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-a492d514-7f71-4376-b713-1bdf2d1ba76c tempest-VolumesSnapshotTestJSON-4159203 tempest-VolumesSnapshotTestJSON-4159203-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:06:10.216141 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-a492d514-7f71-4376-b713-1bdf2d1ba76c tempest-VolumesSnapshotTestJSON-4159203 tempest-VolumesSnapshotTestJSON-4159203-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:06:10.216813 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-a492d514-7f71-4376-b713-1bdf2d1ba76c tempest-VolumesSnapshotTestJSON-4159203 tempest-VolumesSnapshotTestJSON-4159203-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:06:10.217258 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-a492d514-7f71-4376-b713-1bdf2d1ba76c tempest-VolumesSnapshotTestJSON-4159203 tempest-VolumesSnapshotTestJSON-4159203-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:06:10.217676 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-a492d514-7f71-4376-b713-1bdf2d1ba76c tempest-VolumesSnapshotTestJSON-4159203 tempest-VolumesSnapshotTestJSON-4159203-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:06:10.243434 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-d1476415-3624-4f17-8a19-4f8422a0e865 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] 10.222.0.50 "POST /compute/v2.1/servers/b2daebb8-dfea-4ab9-8253-008a21f906e1/action" status: 202 len: 0 microversion: 2.1 time: 0.115909 Sep 24 05:06:10.247025 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 282/593] 10.222.0.50 () {60 vars in 1278 bytes} [Sat Sep 24 05:06:10 2022] POST /compute/v2.1/servers/b2daebb8-dfea-4ab9-8253-008a21f906e1/action => generated 0 bytes in 117 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 24 05:06:10.252208 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-64368e92-d871-424e-a5f1-0afdad735024 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Calling method '>' {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:06:10.252898 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.compute.api [None req-64368e92-d871-424e-a5f1-0afdad735024 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] [instance: b2daebb8-dfea-4ab9-8253-008a21f906e1] Fetching instance by UUID {{(pid=120593) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:06:10.259593 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-64368e92-d871-424e-a5f1-0afdad735024 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:06:10.260080 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-64368e92-d871-424e-a5f1-0afdad735024 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:06:10.260517 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-64368e92-d871-424e-a5f1-0afdad735024 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:06:10.261214 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-64368e92-d871-424e-a5f1-0afdad735024 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:06:10.261699 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-64368e92-d871-424e-a5f1-0afdad735024 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:06:10.262152 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-64368e92-d871-424e-a5f1-0afdad735024 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:06:10.394324 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.policy [None req-a492d514-7f71-4376-b713-1bdf2d1ba76c tempest-VolumesSnapshotTestJSON-4159203 tempest-VolumesSnapshotTestJSON-4159203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '358ce5f5c35f415eb79322ae6d187b1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e942295e9b3478abd521c6f3e60e888', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:06:10.402279 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [None req-a492d514-7f71-4376-b713-1bdf2d1ba76c tempest-VolumesSnapshotTestJSON-4159203 tempest-VolumesSnapshotTestJSON-4159203-project] 10.222.0.50 "GET /compute/v2.1/servers/87e09804-74dc-4329-97d5-02be092fd866" status: 200 len: 1319 microversion: 2.1 time: 0.199026 Sep 24 05:06:10.402836 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 312/594] 10.222.0.50 () {58 vars in 1236 bytes} [Sat Sep 24 05:06:10 2022] GET /compute/v2.1/servers/87e09804-74dc-4329-97d5-02be092fd866 => generated 1319 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 24 05:06:10.414473 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-93d92daf-c5d5-4d3b-abf3-56647533877b tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Calling method '>' {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:06:10.415294 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.compute.api [None req-93d92daf-c5d5-4d3b-abf3-56647533877b tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] [instance: 08fb826b-e891-46c4-990d-ca03cf3f4222] Fetching instance by UUID {{(pid=120594) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:06:10.420939 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-93d92daf-c5d5-4d3b-abf3-56647533877b tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:06:10.421412 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-93d92daf-c5d5-4d3b-abf3-56647533877b tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:06:10.421839 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-93d92daf-c5d5-4d3b-abf3-56647533877b tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:06:10.422543 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-93d92daf-c5d5-4d3b-abf3-56647533877b tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:06:10.422985 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-93d92daf-c5d5-4d3b-abf3-56647533877b tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:06:10.423399 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-93d92daf-c5d5-4d3b-abf3-56647533877b tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:06:10.427631 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-64368e92-d871-424e-a5f1-0afdad735024 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b1b0448e7f54e3aaae49e411699269e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66ec8bde739145dda504995dbea0914a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:06:10.436315 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-64368e92-d871-424e-a5f1-0afdad735024 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] 10.222.0.50 "GET /compute/v2.1/servers/b2daebb8-dfea-4ab9-8253-008a21f906e1" status: 200 len: 1724 microversion: 2.1 time: 0.188008 Sep 24 05:06:10.436882 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 283/595] 10.222.0.50 () {58 vars in 1236 bytes} [Sat Sep 24 05:06:10 2022] GET /compute/v2.1/servers/b2daebb8-dfea-4ab9-8253-008a21f906e1 => generated 1724 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 24 05:06:10.548514 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.policy [None req-93d92daf-c5d5-4d3b-abf3-56647533877b tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0948754217fc4ff2ba0241fa35feaf90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1aaf20f480a423ea5feca81585aeeed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:06:10.557007 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.policy [None req-93d92daf-c5d5-4d3b-abf3-56647533877b tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0948754217fc4ff2ba0241fa35feaf90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1aaf20f480a423ea5feca81585aeeed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:06:10.558468 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.policy [None req-93d92daf-c5d5-4d3b-abf3-56647533877b tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0948754217fc4ff2ba0241fa35feaf90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1aaf20f480a423ea5feca81585aeeed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:06:10.559611 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [None req-93d92daf-c5d5-4d3b-abf3-56647533877b tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] 10.222.0.50 "GET /compute/v2.1/servers/08fb826b-e891-46c4-990d-ca03cf3f4222" status: 200 len: 1718 microversion: 2.20 time: 0.148765 Sep 24 05:06:10.560161 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 313/596] 10.222.0.50 () {60 vars in 1277 bytes} [Sat Sep 24 05:06:10 2022] GET /compute/v2.1/servers/08fb826b-e891-46c4-990d-ca03cf3f4222 => generated 1718 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 24 05:06:11.424588 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-3adfbc84-31ee-4114-92ce-5f2e9b0af399 tempest-VolumesSnapshotTestJSON-4159203 tempest-VolumesSnapshotTestJSON-4159203-project] Calling method '>' {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:06:11.425178 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.compute.api [None req-3adfbc84-31ee-4114-92ce-5f2e9b0af399 tempest-VolumesSnapshotTestJSON-4159203 tempest-VolumesSnapshotTestJSON-4159203-project] [instance: 87e09804-74dc-4329-97d5-02be092fd866] Fetching instance by UUID {{(pid=120593) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:06:11.431561 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-3adfbc84-31ee-4114-92ce-5f2e9b0af399 tempest-VolumesSnapshotTestJSON-4159203 tempest-VolumesSnapshotTestJSON-4159203-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:06:11.432040 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-3adfbc84-31ee-4114-92ce-5f2e9b0af399 tempest-VolumesSnapshotTestJSON-4159203 tempest-VolumesSnapshotTestJSON-4159203-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:06:11.432477 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-3adfbc84-31ee-4114-92ce-5f2e9b0af399 tempest-VolumesSnapshotTestJSON-4159203 tempest-VolumesSnapshotTestJSON-4159203-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:06:11.433161 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-3adfbc84-31ee-4114-92ce-5f2e9b0af399 tempest-VolumesSnapshotTestJSON-4159203 tempest-VolumesSnapshotTestJSON-4159203-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:06:11.433672 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-3adfbc84-31ee-4114-92ce-5f2e9b0af399 tempest-VolumesSnapshotTestJSON-4159203 tempest-VolumesSnapshotTestJSON-4159203-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:06:11.434127 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-3adfbc84-31ee-4114-92ce-5f2e9b0af399 tempest-VolumesSnapshotTestJSON-4159203 tempest-VolumesSnapshotTestJSON-4159203-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:06:11.460886 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-c4786f4a-4b11-44fe-ae8c-90fa20c972fb tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Calling method '>' {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:06:11.461513 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.compute.api [None req-c4786f4a-4b11-44fe-ae8c-90fa20c972fb tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] [instance: b2daebb8-dfea-4ab9-8253-008a21f906e1] Fetching instance by UUID {{(pid=120594) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:06:11.467965 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-c4786f4a-4b11-44fe-ae8c-90fa20c972fb tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:06:11.468451 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-c4786f4a-4b11-44fe-ae8c-90fa20c972fb tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:06:11.468861 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-c4786f4a-4b11-44fe-ae8c-90fa20c972fb tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:06:11.469537 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-c4786f4a-4b11-44fe-ae8c-90fa20c972fb tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:06:11.469976 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-c4786f4a-4b11-44fe-ae8c-90fa20c972fb tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:06:11.470428 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-c4786f4a-4b11-44fe-ae8c-90fa20c972fb tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:06:11.612268 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-3adfbc84-31ee-4114-92ce-5f2e9b0af399 tempest-VolumesSnapshotTestJSON-4159203 tempest-VolumesSnapshotTestJSON-4159203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '358ce5f5c35f415eb79322ae6d187b1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e942295e9b3478abd521c6f3e60e888', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:06:11.619939 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-3adfbc84-31ee-4114-92ce-5f2e9b0af399 tempest-VolumesSnapshotTestJSON-4159203 tempest-VolumesSnapshotTestJSON-4159203-project] 10.222.0.50 "GET /compute/v2.1/servers/87e09804-74dc-4329-97d5-02be092fd866" status: 200 len: 1319 microversion: 2.1 time: 0.199270 Sep 24 05:06:11.620610 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 284/597] 10.222.0.50 () {58 vars in 1236 bytes} [Sat Sep 24 05:06:11 2022] GET /compute/v2.1/servers/87e09804-74dc-4329-97d5-02be092fd866 => generated 1319 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 05:06:11.625190 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-6f901288-8adb-494d-88ef-5504709f544a tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Calling method '>' {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:06:11.625780 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.compute.api [None req-6f901288-8adb-494d-88ef-5504709f544a tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] [instance: 08fb826b-e891-46c4-990d-ca03cf3f4222] Fetching instance by UUID {{(pid=120593) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:06:11.631873 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-6f901288-8adb-494d-88ef-5504709f544a tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:06:11.632346 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-6f901288-8adb-494d-88ef-5504709f544a tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:06:11.632767 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-6f901288-8adb-494d-88ef-5504709f544a tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:06:11.633451 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-6f901288-8adb-494d-88ef-5504709f544a tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:06:11.633897 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-6f901288-8adb-494d-88ef-5504709f544a tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:06:11.634492 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-6f901288-8adb-494d-88ef-5504709f544a tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:06:11.639203 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.policy [None req-c4786f4a-4b11-44fe-ae8c-90fa20c972fb tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b1b0448e7f54e3aaae49e411699269e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66ec8bde739145dda504995dbea0914a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:06:11.648060 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [None req-c4786f4a-4b11-44fe-ae8c-90fa20c972fb tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] 10.222.0.50 "GET /compute/v2.1/servers/b2daebb8-dfea-4ab9-8253-008a21f906e1" status: 200 len: 1724 microversion: 2.1 time: 0.191643 Sep 24 05:06:11.648894 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 314/598] 10.222.0.50 () {58 vars in 1236 bytes} [Sat Sep 24 05:06:11 2022] GET /compute/v2.1/servers/b2daebb8-dfea-4ab9-8253-008a21f906e1 => generated 1724 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 24 05:06:11.764269 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-6f901288-8adb-494d-88ef-5504709f544a tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0948754217fc4ff2ba0241fa35feaf90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1aaf20f480a423ea5feca81585aeeed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:06:11.772888 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-6f901288-8adb-494d-88ef-5504709f544a tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0948754217fc4ff2ba0241fa35feaf90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1aaf20f480a423ea5feca81585aeeed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:06:11.774888 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-6f901288-8adb-494d-88ef-5504709f544a tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0948754217fc4ff2ba0241fa35feaf90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1aaf20f480a423ea5feca81585aeeed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:06:11.776039 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-6f901288-8adb-494d-88ef-5504709f544a tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] 10.222.0.50 "GET /compute/v2.1/servers/08fb826b-e891-46c4-990d-ca03cf3f4222" status: 200 len: 1718 microversion: 2.20 time: 0.154367 Sep 24 05:06:11.776604 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 285/599] 10.222.0.50 () {60 vars in 1277 bytes} [Sat Sep 24 05:06:11 2022] GET /compute/v2.1/servers/08fb826b-e891-46c4-990d-ca03cf3f4222 => generated 1718 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 05:06:12.643220 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-dbcd117b-9f2d-47b1-84af-c68e0dc775af tempest-VolumesSnapshotTestJSON-4159203 tempest-VolumesSnapshotTestJSON-4159203-project] Calling method '>' {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:06:12.643817 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.compute.api [None req-dbcd117b-9f2d-47b1-84af-c68e0dc775af tempest-VolumesSnapshotTestJSON-4159203 tempest-VolumesSnapshotTestJSON-4159203-project] [instance: 87e09804-74dc-4329-97d5-02be092fd866] Fetching instance by UUID {{(pid=120594) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:06:12.651294 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-dbcd117b-9f2d-47b1-84af-c68e0dc775af tempest-VolumesSnapshotTestJSON-4159203 tempest-VolumesSnapshotTestJSON-4159203-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:06:12.651816 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-dbcd117b-9f2d-47b1-84af-c68e0dc775af tempest-VolumesSnapshotTestJSON-4159203 tempest-VolumesSnapshotTestJSON-4159203-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:06:12.652252 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-dbcd117b-9f2d-47b1-84af-c68e0dc775af tempest-VolumesSnapshotTestJSON-4159203 tempest-VolumesSnapshotTestJSON-4159203-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:06:12.652948 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-dbcd117b-9f2d-47b1-84af-c68e0dc775af tempest-VolumesSnapshotTestJSON-4159203 tempest-VolumesSnapshotTestJSON-4159203-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:06:12.653392 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-dbcd117b-9f2d-47b1-84af-c68e0dc775af tempest-VolumesSnapshotTestJSON-4159203 tempest-VolumesSnapshotTestJSON-4159203-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:06:12.653811 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-dbcd117b-9f2d-47b1-84af-c68e0dc775af tempest-VolumesSnapshotTestJSON-4159203 tempest-VolumesSnapshotTestJSON-4159203-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:06:12.671703 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-63a3e5e9-c46e-4d67-940e-9745fd517cca tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Calling method '>' {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:06:12.672896 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.compute.api [None req-63a3e5e9-c46e-4d67-940e-9745fd517cca tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] [instance: b2daebb8-dfea-4ab9-8253-008a21f906e1] Fetching instance by UUID {{(pid=120593) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:06:12.679156 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-63a3e5e9-c46e-4d67-940e-9745fd517cca tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:06:12.679635 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-63a3e5e9-c46e-4d67-940e-9745fd517cca tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:06:12.680068 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-63a3e5e9-c46e-4d67-940e-9745fd517cca tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:06:12.680763 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-63a3e5e9-c46e-4d67-940e-9745fd517cca tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:06:12.681201 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-63a3e5e9-c46e-4d67-940e-9745fd517cca tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:06:12.681618 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-63a3e5e9-c46e-4d67-940e-9745fd517cca tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:06:12.850956 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.policy [None req-dbcd117b-9f2d-47b1-84af-c68e0dc775af tempest-VolumesSnapshotTestJSON-4159203 tempest-VolumesSnapshotTestJSON-4159203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '358ce5f5c35f415eb79322ae6d187b1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e942295e9b3478abd521c6f3e60e888', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:06:12.857181 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-63a3e5e9-c46e-4d67-940e-9745fd517cca tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b1b0448e7f54e3aaae49e411699269e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66ec8bde739145dda504995dbea0914a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:06:12.858804 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [None req-dbcd117b-9f2d-47b1-84af-c68e0dc775af tempest-VolumesSnapshotTestJSON-4159203 tempest-VolumesSnapshotTestJSON-4159203-project] 10.222.0.50 "GET /compute/v2.1/servers/87e09804-74dc-4329-97d5-02be092fd866" status: 200 len: 1319 microversion: 2.1 time: 0.219391 Sep 24 05:06:12.859467 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 315/600] 10.222.0.50 () {58 vars in 1236 bytes} [Sat Sep 24 05:06:12 2022] GET /compute/v2.1/servers/87e09804-74dc-4329-97d5-02be092fd866 => generated 1319 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 05:06:12.865802 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-8f42f184-e66f-41be-8113-3711e3ecda8b tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Calling method '>' {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:06:12.865971 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-63a3e5e9-c46e-4d67-940e-9745fd517cca tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] 10.222.0.50 "GET /compute/v2.1/servers/b2daebb8-dfea-4ab9-8253-008a21f906e1" status: 200 len: 1724 microversion: 2.1 time: 0.198043 Sep 24 05:06:12.866525 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.compute.api [None req-8f42f184-e66f-41be-8113-3711e3ecda8b tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] [instance: 08fb826b-e891-46c4-990d-ca03cf3f4222] Fetching instance by UUID {{(pid=120594) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:06:12.870847 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 286/601] 10.222.0.50 () {58 vars in 1236 bytes} [Sat Sep 24 05:06:12 2022] GET /compute/v2.1/servers/b2daebb8-dfea-4ab9-8253-008a21f906e1 => generated 1724 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 24 05:06:12.872867 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-8f42f184-e66f-41be-8113-3711e3ecda8b tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:06:12.873422 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-8f42f184-e66f-41be-8113-3711e3ecda8b tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:06:12.874115 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-8f42f184-e66f-41be-8113-3711e3ecda8b tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:06:12.874883 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-8f42f184-e66f-41be-8113-3711e3ecda8b tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:06:12.875342 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-8f42f184-e66f-41be-8113-3711e3ecda8b tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:06:12.875769 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-8f42f184-e66f-41be-8113-3711e3ecda8b tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:06:13.006271 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.policy [None req-8f42f184-e66f-41be-8113-3711e3ecda8b tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0948754217fc4ff2ba0241fa35feaf90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1aaf20f480a423ea5feca81585aeeed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:06:13.014835 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.policy [None req-8f42f184-e66f-41be-8113-3711e3ecda8b tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0948754217fc4ff2ba0241fa35feaf90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1aaf20f480a423ea5feca81585aeeed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:06:13.016201 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.policy [None req-8f42f184-e66f-41be-8113-3711e3ecda8b tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0948754217fc4ff2ba0241fa35feaf90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1aaf20f480a423ea5feca81585aeeed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:06:13.017324 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [None req-8f42f184-e66f-41be-8113-3711e3ecda8b tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] 10.222.0.50 "GET /compute/v2.1/servers/08fb826b-e891-46c4-990d-ca03cf3f4222" status: 200 len: 1721 microversion: 2.20 time: 0.156886 Sep 24 05:06:13.017878 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 316/602] 10.222.0.50 () {60 vars in 1277 bytes} [Sat Sep 24 05:06:12 2022] GET /compute/v2.1/servers/08fb826b-e891-46c4-990d-ca03cf3f4222 => generated 1721 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 05:06:13.042441 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-d319bdf3-82dc-419b-bb66-748245eab684 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "555f48a9-a917-4eb8-95d4-2364fac6f0d9"}} {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 05:06:13.044874 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.compute.api [None req-d319bdf3-82dc-419b-bb66-748245eab684 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] [instance: 08fb826b-e891-46c4-990d-ca03cf3f4222] Fetching instance by UUID {{(pid=120593) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:06:13.050773 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-d319bdf3-82dc-419b-bb66-748245eab684 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:06:13.051275 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-d319bdf3-82dc-419b-bb66-748245eab684 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:06:13.051706 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-d319bdf3-82dc-419b-bb66-748245eab684 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:06:13.052381 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-d319bdf3-82dc-419b-bb66-748245eab684 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:06:13.052829 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-d319bdf3-82dc-419b-bb66-748245eab684 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:06:13.053249 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-d319bdf3-82dc-419b-bb66-748245eab684 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:06:13.348747 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-d319bdf3-82dc-419b-bb66-748245eab684 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] 10.222.0.50 "POST /compute/v2.1/servers/08fb826b-e891-46c4-990d-ca03cf3f4222/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.310598 Sep 24 05:06:13.349353 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 287/603] 10.222.0.50 () {62 vars in 1364 bytes} [Sat Sep 24 05:06:13 2022] POST /compute/v2.1/servers/08fb826b-e891-46c4-990d-ca03cf3f4222/os-volume_attachments => generated 188 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 24 05:06:13.473051 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-036089e5-c500-49ac-89fe-12ccb628b89c tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 05:06:13.473635 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.compute.api [None req-036089e5-c500-49ac-89fe-12ccb628b89c tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] [instance: 08fb826b-e891-46c4-990d-ca03cf3f4222] Fetching instance by UUID {{(pid=120594) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:06:13.480301 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-036089e5-c500-49ac-89fe-12ccb628b89c tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:06:13.480774 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-036089e5-c500-49ac-89fe-12ccb628b89c tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:06:13.481201 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-036089e5-c500-49ac-89fe-12ccb628b89c tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:06:13.481877 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-036089e5-c500-49ac-89fe-12ccb628b89c tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:06:13.482350 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-036089e5-c500-49ac-89fe-12ccb628b89c tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:06:13.482784 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-036089e5-c500-49ac-89fe-12ccb628b89c tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:06:13.524648 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.compute.api [None req-036089e5-c500-49ac-89fe-12ccb628b89c tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] [instance: 08fb826b-e891-46c4-990d-ca03cf3f4222] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=120594) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Sep 24 05:06:13.560574 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG dbcounter [-] [120594] Writing DB stats nova_cell1:SELECT=100 {{(pid=120594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 05:06:13.562144 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [req-79e1fca1-f225-47d1-9c10-201a2e773807 req-9dab8749-1109-47de-949f-ea30b46c3ce5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "08fb826b-e891-46c4-990d-ca03cf3f4222", "name": "network-vif-unplugged", "status": "completed", "tag": "4de1eabe-932e-4cda-804d-49eeff37c34c"}]} {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 05:06:13.572207 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [req-79e1fca1-f225-47d1-9c10-201a2e773807 req-9dab8749-1109-47de-949f-ea30b46c3ce5 service nova] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:06:13.572689 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [req-79e1fca1-f225-47d1-9c10-201a2e773807 req-9dab8749-1109-47de-949f-ea30b46c3ce5 service nova] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:06:13.573116 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [req-79e1fca1-f225-47d1-9c10-201a2e773807 req-9dab8749-1109-47de-949f-ea30b46c3ce5 service nova] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:06:13.584562 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.compute.server_external_events [req-79e1fca1-f225-47d1-9c10-201a2e773807 req-9dab8749-1109-47de-949f-ea30b46c3ce5 service nova] Creating event network-vif-unplugged:4de1eabe-932e-4cda-804d-49eeff37c34c for instance 08fb826b-e891-46c4-990d-ca03cf3f4222 on hv-cinder-85918 Sep 24 05:06:13.590034 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [req-79e1fca1-f225-47d1-9c10-201a2e773807 req-9dab8749-1109-47de-949f-ea30b46c3ce5 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.031974 Sep 24 05:06:13.590636 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 288/604] 10.222.0.50 () {64 vars in 1317 bytes} [Sat Sep 24 05:06:13 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 24 05:06:13.602768 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [None req-036089e5-c500-49ac-89fe-12ccb628b89c tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] 10.222.0.50 "POST /compute/v2.1/servers/08fb826b-e891-46c4-990d-ca03cf3f4222/action" status: 202 len: 0 microversion: 2.20 time: 0.133530 Sep 24 05:06:13.603366 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 317/605] 10.222.0.50 () {62 vars in 1319 bytes} [Sat Sep 24 05:06:13 2022] POST /compute/v2.1/servers/08fb826b-e891-46c4-990d-ca03cf3f4222/action => generated 0 bytes in 135 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Sep 24 05:06:13.612043 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-5a8a7d9a-0eb8-4464-a97c-0e0bcb1ea761 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Calling method '>' {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:06:13.612743 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.compute.api [None req-5a8a7d9a-0eb8-4464-a97c-0e0bcb1ea761 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] [instance: 08fb826b-e891-46c4-990d-ca03cf3f4222] Fetching instance by UUID {{(pid=120593) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:06:13.618965 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-5a8a7d9a-0eb8-4464-a97c-0e0bcb1ea761 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:06:13.619631 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-5a8a7d9a-0eb8-4464-a97c-0e0bcb1ea761 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:06:13.620058 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-5a8a7d9a-0eb8-4464-a97c-0e0bcb1ea761 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:06:13.620918 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-5a8a7d9a-0eb8-4464-a97c-0e0bcb1ea761 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:06:13.621368 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-5a8a7d9a-0eb8-4464-a97c-0e0bcb1ea761 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:06:13.621784 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-5a8a7d9a-0eb8-4464-a97c-0e0bcb1ea761 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:06:13.761297 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-5a8a7d9a-0eb8-4464-a97c-0e0bcb1ea761 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0948754217fc4ff2ba0241fa35feaf90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1aaf20f480a423ea5feca81585aeeed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:06:13.769884 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-5a8a7d9a-0eb8-4464-a97c-0e0bcb1ea761 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0948754217fc4ff2ba0241fa35feaf90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1aaf20f480a423ea5feca81585aeeed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:06:13.771341 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-5a8a7d9a-0eb8-4464-a97c-0e0bcb1ea761 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0948754217fc4ff2ba0241fa35feaf90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1aaf20f480a423ea5feca81585aeeed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:06:13.772777 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-5a8a7d9a-0eb8-4464-a97c-0e0bcb1ea761 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] 10.222.0.50 "GET /compute/v2.1/servers/08fb826b-e891-46c4-990d-ca03cf3f4222" status: 200 len: 1807 microversion: 2.20 time: 0.164940 Sep 24 05:06:13.773329 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 289/606] 10.222.0.50 () {60 vars in 1277 bytes} [Sat Sep 24 05:06:13 2022] GET /compute/v2.1/servers/08fb826b-e891-46c4-990d-ca03cf3f4222 => generated 1807 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 05:06:13.883550 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-b6738ae2-1043-4083-a0fe-f71f0b1852bf tempest-VolumesSnapshotTestJSON-4159203 tempest-VolumesSnapshotTestJSON-4159203-project] Calling method '>' {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:06:13.884688 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.compute.api [None req-b6738ae2-1043-4083-a0fe-f71f0b1852bf tempest-VolumesSnapshotTestJSON-4159203 tempest-VolumesSnapshotTestJSON-4159203-project] [instance: 87e09804-74dc-4329-97d5-02be092fd866] Fetching instance by UUID {{(pid=120594) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:06:13.886636 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG dbcounter [-] [120594] Writing DB stats nova_api:SELECT=67,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=120594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 05:06:13.889512 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-c0a85916-a870-463d-a1b4-db7e85f85905 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Calling method '>' {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:06:13.890394 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.compute.api [None req-c0a85916-a870-463d-a1b4-db7e85f85905 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] [instance: b2daebb8-dfea-4ab9-8253-008a21f906e1] Fetching instance by UUID {{(pid=120593) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:06:13.892386 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-b6738ae2-1043-4083-a0fe-f71f0b1852bf tempest-VolumesSnapshotTestJSON-4159203 tempest-VolumesSnapshotTestJSON-4159203-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:06:13.893065 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-b6738ae2-1043-4083-a0fe-f71f0b1852bf tempest-VolumesSnapshotTestJSON-4159203 tempest-VolumesSnapshotTestJSON-4159203-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:06:13.893648 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-b6738ae2-1043-4083-a0fe-f71f0b1852bf tempest-VolumesSnapshotTestJSON-4159203 tempest-VolumesSnapshotTestJSON-4159203-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:06:13.894381 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-b6738ae2-1043-4083-a0fe-f71f0b1852bf tempest-VolumesSnapshotTestJSON-4159203 tempest-VolumesSnapshotTestJSON-4159203-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:06:13.894830 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-b6738ae2-1043-4083-a0fe-f71f0b1852bf tempest-VolumesSnapshotTestJSON-4159203 tempest-VolumesSnapshotTestJSON-4159203-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:06:13.895249 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-b6738ae2-1043-4083-a0fe-f71f0b1852bf tempest-VolumesSnapshotTestJSON-4159203 tempest-VolumesSnapshotTestJSON-4159203-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:06:13.897310 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-c0a85916-a870-463d-a1b4-db7e85f85905 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:06:13.897925 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-c0a85916-a870-463d-a1b4-db7e85f85905 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:06:13.899249 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-c0a85916-a870-463d-a1b4-db7e85f85905 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:06:13.900336 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-c0a85916-a870-463d-a1b4-db7e85f85905 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:06:13.901339 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-c0a85916-a870-463d-a1b4-db7e85f85905 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:06:13.902026 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-c0a85916-a870-463d-a1b4-db7e85f85905 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:06:14.134966 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.policy [None req-b6738ae2-1043-4083-a0fe-f71f0b1852bf tempest-VolumesSnapshotTestJSON-4159203 tempest-VolumesSnapshotTestJSON-4159203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '358ce5f5c35f415eb79322ae6d187b1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e942295e9b3478abd521c6f3e60e888', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:06:14.138396 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-c0a85916-a870-463d-a1b4-db7e85f85905 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b1b0448e7f54e3aaae49e411699269e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66ec8bde739145dda504995dbea0914a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:06:14.142829 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [None req-b6738ae2-1043-4083-a0fe-f71f0b1852bf tempest-VolumesSnapshotTestJSON-4159203 tempest-VolumesSnapshotTestJSON-4159203-project] 10.222.0.50 "GET /compute/v2.1/servers/87e09804-74dc-4329-97d5-02be092fd866" status: 200 len: 1508 microversion: 2.1 time: 0.264708 Sep 24 05:06:14.143523 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 318/607] 10.222.0.50 () {58 vars in 1236 bytes} [Sat Sep 24 05:06:13 2022] GET /compute/v2.1/servers/87e09804-74dc-4329-97d5-02be092fd866 => generated 1508 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 05:06:14.151046 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-c0a85916-a870-463d-a1b4-db7e85f85905 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] 10.222.0.50 "GET /compute/v2.1/servers/b2daebb8-dfea-4ab9-8253-008a21f906e1" status: 200 len: 1724 microversion: 2.1 time: 0.265872 Sep 24 05:06:14.151881 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 290/608] 10.222.0.50 () {58 vars in 1236 bytes} [Sat Sep 24 05:06:13 2022] GET /compute/v2.1/servers/b2daebb8-dfea-4ab9-8253-008a21f906e1 => generated 1724 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 05:06:14.168758 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-0bb0c248-f93e-43ee-b7b0-c96b5d19589c tempest-VolumesSnapshotTestJSON-4159203 tempest-VolumesSnapshotTestJSON-4159203-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "69e1f27f-a0e3-4932-90c6-200b28f9eb75", "device": "/dev/sdb"}} {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 05:06:14.171227 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.compute.api [None req-0bb0c248-f93e-43ee-b7b0-c96b5d19589c tempest-VolumesSnapshotTestJSON-4159203 tempest-VolumesSnapshotTestJSON-4159203-project] [instance: 87e09804-74dc-4329-97d5-02be092fd866] Fetching instance by UUID {{(pid=120594) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:06:14.177099 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-0bb0c248-f93e-43ee-b7b0-c96b5d19589c tempest-VolumesSnapshotTestJSON-4159203 tempest-VolumesSnapshotTestJSON-4159203-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:06:14.177571 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-0bb0c248-f93e-43ee-b7b0-c96b5d19589c tempest-VolumesSnapshotTestJSON-4159203 tempest-VolumesSnapshotTestJSON-4159203-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:06:14.178050 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-0bb0c248-f93e-43ee-b7b0-c96b5d19589c tempest-VolumesSnapshotTestJSON-4159203 tempest-VolumesSnapshotTestJSON-4159203-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:06:14.178729 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-0bb0c248-f93e-43ee-b7b0-c96b5d19589c tempest-VolumesSnapshotTestJSON-4159203 tempest-VolumesSnapshotTestJSON-4159203-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:06:14.179200 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-0bb0c248-f93e-43ee-b7b0-c96b5d19589c tempest-VolumesSnapshotTestJSON-4159203 tempest-VolumesSnapshotTestJSON-4159203-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:06:14.179616 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-0bb0c248-f93e-43ee-b7b0-c96b5d19589c tempest-VolumesSnapshotTestJSON-4159203 tempest-VolumesSnapshotTestJSON-4159203-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:06:14.554939 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [None req-0bb0c248-f93e-43ee-b7b0-c96b5d19589c tempest-VolumesSnapshotTestJSON-4159203 tempest-VolumesSnapshotTestJSON-4159203-project] 10.222.0.50 "POST /compute/v2.1/servers/87e09804-74dc-4329-97d5-02be092fd866/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.389921 Sep 24 05:06:14.555511 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 319/609] 10.222.0.50 () {60 vars in 1323 bytes} [Sat Sep 24 05:06:14 2022] POST /compute/v2.1/servers/87e09804-74dc-4329-97d5-02be092fd866/os-volume_attachments => generated 194 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 05:06:14.797748 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-3f9fe477-243f-42df-93df-50122f4f5138 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Calling method '>' {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:06:14.798375 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.compute.api [None req-3f9fe477-243f-42df-93df-50122f4f5138 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] [instance: 08fb826b-e891-46c4-990d-ca03cf3f4222] Fetching instance by UUID {{(pid=120593) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:06:14.804820 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-3f9fe477-243f-42df-93df-50122f4f5138 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:06:14.805342 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-3f9fe477-243f-42df-93df-50122f4f5138 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:06:14.805724 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-3f9fe477-243f-42df-93df-50122f4f5138 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:06:14.806436 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-3f9fe477-243f-42df-93df-50122f4f5138 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:06:14.806882 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-3f9fe477-243f-42df-93df-50122f4f5138 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:06:14.807299 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-3f9fe477-243f-42df-93df-50122f4f5138 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:06:14.935897 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-3f9fe477-243f-42df-93df-50122f4f5138 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0948754217fc4ff2ba0241fa35feaf90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1aaf20f480a423ea5feca81585aeeed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:06:14.946928 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-3f9fe477-243f-42df-93df-50122f4f5138 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0948754217fc4ff2ba0241fa35feaf90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1aaf20f480a423ea5feca81585aeeed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:06:14.948382 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-3f9fe477-243f-42df-93df-50122f4f5138 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0948754217fc4ff2ba0241fa35feaf90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1aaf20f480a423ea5feca81585aeeed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:06:14.949819 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-3f9fe477-243f-42df-93df-50122f4f5138 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] 10.222.0.50 "GET /compute/v2.1/servers/08fb826b-e891-46c4-990d-ca03cf3f4222" status: 200 len: 1747 microversion: 2.20 time: 0.155943 Sep 24 05:06:14.950414 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 291/610] 10.222.0.50 () {60 vars in 1277 bytes} [Sat Sep 24 05:06:14 2022] GET /compute/v2.1/servers/08fb826b-e891-46c4-990d-ca03cf3f4222 => generated 1747 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 05:06:15.177739 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-d85a87c5-c9ba-4035-bbbb-630a61eaec9c tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Calling method '>' {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:06:15.178377 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.compute.api [None req-d85a87c5-c9ba-4035-bbbb-630a61eaec9c tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] [instance: b2daebb8-dfea-4ab9-8253-008a21f906e1] Fetching instance by UUID {{(pid=120594) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:06:15.185029 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-d85a87c5-c9ba-4035-bbbb-630a61eaec9c tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:06:15.185501 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-d85a87c5-c9ba-4035-bbbb-630a61eaec9c tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:06:15.185931 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-d85a87c5-c9ba-4035-bbbb-630a61eaec9c tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:06:15.186628 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-d85a87c5-c9ba-4035-bbbb-630a61eaec9c tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:06:15.187077 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-d85a87c5-c9ba-4035-bbbb-630a61eaec9c tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:06:15.187493 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-d85a87c5-c9ba-4035-bbbb-630a61eaec9c tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:06:15.314613 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.policy [None req-d85a87c5-c9ba-4035-bbbb-630a61eaec9c tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b1b0448e7f54e3aaae49e411699269e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66ec8bde739145dda504995dbea0914a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:06:15.323088 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [None req-d85a87c5-c9ba-4035-bbbb-630a61eaec9c tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] 10.222.0.50 "GET /compute/v2.1/servers/b2daebb8-dfea-4ab9-8253-008a21f906e1" status: 200 len: 1724 microversion: 2.1 time: 0.150143 Sep 24 05:06:15.323653 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 320/611] 10.222.0.50 () {58 vars in 1236 bytes} [Sat Sep 24 05:06:15 2022] GET /compute/v2.1/servers/b2daebb8-dfea-4ab9-8253-008a21f906e1 => generated 1724 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 05:06:15.976378 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-24c1739f-d34e-4c92-9de0-5708d240c7ce tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Calling method '>' {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:06:15.976987 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.compute.api [None req-24c1739f-d34e-4c92-9de0-5708d240c7ce tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] [instance: 08fb826b-e891-46c4-990d-ca03cf3f4222] Fetching instance by UUID {{(pid=120593) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:06:15.983395 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-24c1739f-d34e-4c92-9de0-5708d240c7ce tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:06:15.983874 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-24c1739f-d34e-4c92-9de0-5708d240c7ce tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:06:15.984306 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-24c1739f-d34e-4c92-9de0-5708d240c7ce tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:06:15.984997 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-24c1739f-d34e-4c92-9de0-5708d240c7ce tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:06:15.985829 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-24c1739f-d34e-4c92-9de0-5708d240c7ce tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:06:15.986573 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-24c1739f-d34e-4c92-9de0-5708d240c7ce tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:06:16.140489 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-24c1739f-d34e-4c92-9de0-5708d240c7ce tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0948754217fc4ff2ba0241fa35feaf90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1aaf20f480a423ea5feca81585aeeed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:06:16.150636 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-24c1739f-d34e-4c92-9de0-5708d240c7ce tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0948754217fc4ff2ba0241fa35feaf90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1aaf20f480a423ea5feca81585aeeed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:06:16.152229 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-24c1739f-d34e-4c92-9de0-5708d240c7ce tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0948754217fc4ff2ba0241fa35feaf90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1aaf20f480a423ea5feca81585aeeed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:06:16.154980 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-24c1739f-d34e-4c92-9de0-5708d240c7ce tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] 10.222.0.50 "GET /compute/v2.1/servers/08fb826b-e891-46c4-990d-ca03cf3f4222" status: 200 len: 1749 microversion: 2.20 time: 0.183015 Sep 24 05:06:16.155653 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 292/612] 10.222.0.50 () {60 vars in 1277 bytes} [Sat Sep 24 05:06:15 2022] GET /compute/v2.1/servers/08fb826b-e891-46c4-990d-ca03cf3f4222 => generated 1749 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 05:06:16.346800 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-d15cf46e-e20d-4539-bb38-9f2e2024732a tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Calling method '>' {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:06:16.347404 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.compute.api [None req-d15cf46e-e20d-4539-bb38-9f2e2024732a tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] [instance: b2daebb8-dfea-4ab9-8253-008a21f906e1] Fetching instance by UUID {{(pid=120594) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:06:16.353843 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-d15cf46e-e20d-4539-bb38-9f2e2024732a tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:06:16.354344 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-d15cf46e-e20d-4539-bb38-9f2e2024732a tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:06:16.354772 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-d15cf46e-e20d-4539-bb38-9f2e2024732a tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:06:16.355456 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-d15cf46e-e20d-4539-bb38-9f2e2024732a tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:06:16.355902 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-d15cf46e-e20d-4539-bb38-9f2e2024732a tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:06:16.356319 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-d15cf46e-e20d-4539-bb38-9f2e2024732a tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:06:16.437761 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-973ac5a8-a0c7-42af-bdce-69138d570b9d tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Action: 'create', calling method: .version_select at 0x7f795067cca0>, body: {"keypair": {"name": "tempest-keypair-467337428", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEvbZkF7rvKtAAnkySXbkg+ualmGgQP9srIS6GCiTRmJ/tMQKWdt6kg4fgh68eIKbGfQ28vfjOR7xBgE/zpTqXRT3S5c5Hhibz9Fnis4vQTuG9KZPY0d1ppsrrxbfZA+iA=="}} {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 05:06:16.453587 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.quota [None req-973ac5a8-a0c7-42af-bdce-69138d570b9d tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Getting quotas for project 87d5229e39fe4817b5187068d8acecc7. Resources: {'key_pairs'} {{(pid=120593) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 24 05:06:16.457741 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.quota [None req-973ac5a8-a0c7-42af-bdce-69138d570b9d tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Getting quotas for user 74a8cc19ab204424ab23c62915ac2bab and project 87d5229e39fe4817b5187068d8acecc7. Resources: {'key_pairs'} {{(pid=120593) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 24 05:06:16.490111 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-973ac5a8-a0c7-42af-bdce-69138d570b9d tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] 10.222.0.50 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.056322 Sep 24 05:06:16.490722 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 293/613] 10.222.0.50 () {60 vars in 1159 bytes} [Sat Sep 24 05:06:16 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 24 05:06:16.492490 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.policy [None req-d15cf46e-e20d-4539-bb38-9f2e2024732a tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b1b0448e7f54e3aaae49e411699269e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66ec8bde739145dda504995dbea0914a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:06:16.501744 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [None req-d15cf46e-e20d-4539-bb38-9f2e2024732a tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] 10.222.0.50 "GET /compute/v2.1/servers/b2daebb8-dfea-4ab9-8253-008a21f906e1" status: 200 len: 1724 microversion: 2.1 time: 0.159606 Sep 24 05:06:16.502243 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 321/614] 10.222.0.50 () {58 vars in 1236 bytes} [Sat Sep 24 05:06:16 2022] GET /compute/v2.1/servers/b2daebb8-dfea-4ab9-8253-008a21f906e1 => generated 1724 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 05:06:17.181818 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-55e972f9-daa0-4a09-92f4-49b8fcdc37f2 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Calling method '>' {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:06:17.182451 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.compute.api [None req-55e972f9-daa0-4a09-92f4-49b8fcdc37f2 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] [instance: 08fb826b-e891-46c4-990d-ca03cf3f4222] Fetching instance by UUID {{(pid=120593) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:06:17.188299 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-55e972f9-daa0-4a09-92f4-49b8fcdc37f2 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:06:17.188779 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-55e972f9-daa0-4a09-92f4-49b8fcdc37f2 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:06:17.189209 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-55e972f9-daa0-4a09-92f4-49b8fcdc37f2 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:06:17.189897 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-55e972f9-daa0-4a09-92f4-49b8fcdc37f2 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:06:17.190414 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-55e972f9-daa0-4a09-92f4-49b8fcdc37f2 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:06:17.190840 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-55e972f9-daa0-4a09-92f4-49b8fcdc37f2 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:06:17.328953 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-55e972f9-daa0-4a09-92f4-49b8fcdc37f2 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0948754217fc4ff2ba0241fa35feaf90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1aaf20f480a423ea5feca81585aeeed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:06:17.332214 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG dbcounter [-] [120593] Writing DB stats nova_cell1:SELECT=91,nova_cell1:UPDATE=5,nova_cell1:INSERT=4 {{(pid=120593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 05:06:17.340635 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-55e972f9-daa0-4a09-92f4-49b8fcdc37f2 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0948754217fc4ff2ba0241fa35feaf90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1aaf20f480a423ea5feca81585aeeed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:06:17.342198 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-55e972f9-daa0-4a09-92f4-49b8fcdc37f2 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0948754217fc4ff2ba0241fa35feaf90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1aaf20f480a423ea5feca81585aeeed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:06:17.343546 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-55e972f9-daa0-4a09-92f4-49b8fcdc37f2 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] 10.222.0.50 "GET /compute/v2.1/servers/08fb826b-e891-46c4-990d-ca03cf3f4222" status: 200 len: 1749 microversion: 2.20 time: 0.166737 Sep 24 05:06:17.344108 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 294/615] 10.222.0.50 () {60 vars in 1277 bytes} [Sat Sep 24 05:06:17 2022] GET /compute/v2.1/servers/08fb826b-e891-46c4-990d-ca03cf3f4222 => generated 1749 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 05:06:17.526882 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-fce6cc16-6234-4c5a-a72c-3e46d88253b6 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Calling method '>' {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:06:17.527495 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.compute.api [None req-fce6cc16-6234-4c5a-a72c-3e46d88253b6 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] [instance: b2daebb8-dfea-4ab9-8253-008a21f906e1] Fetching instance by UUID {{(pid=120594) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:06:17.533874 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-fce6cc16-6234-4c5a-a72c-3e46d88253b6 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:06:17.534393 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-fce6cc16-6234-4c5a-a72c-3e46d88253b6 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:06:17.534842 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-fce6cc16-6234-4c5a-a72c-3e46d88253b6 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:06:17.535735 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-fce6cc16-6234-4c5a-a72c-3e46d88253b6 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:06:17.536364 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-fce6cc16-6234-4c5a-a72c-3e46d88253b6 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:06:17.536789 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-fce6cc16-6234-4c5a-a72c-3e46d88253b6 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:06:17.668042 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.policy [None req-fce6cc16-6234-4c5a-a72c-3e46d88253b6 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b1b0448e7f54e3aaae49e411699269e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66ec8bde739145dda504995dbea0914a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:06:17.677072 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [None req-fce6cc16-6234-4c5a-a72c-3e46d88253b6 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] 10.222.0.50 "GET /compute/v2.1/servers/b2daebb8-dfea-4ab9-8253-008a21f906e1" status: 200 len: 1724 microversion: 2.1 time: 0.154405 Sep 24 05:06:17.677778 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 322/616] 10.222.0.50 () {58 vars in 1236 bytes} [Sat Sep 24 05:06:17 2022] GET /compute/v2.1/servers/b2daebb8-dfea-4ab9-8253-008a21f906e1 => generated 1724 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 05:06:17.703261 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-3637240e-49d8-4a1c-89a2-8027b1395341 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-155909688", "imageRef": "75ab730a-d8cc-4ea2-b58f-0f3eb476c976", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "17f0f6dc-1b39-4c78-b39c-2031585b359a"}], "security_groups": [{"name": "tempest-securitygroup--1869260860"}], "key_name": "tempest-keypair-467337428", "user_data": "}} {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 05:06:17.811509 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.network.neutron [None req-3637240e-49d8-4a1c-89a2-8027b1395341 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] validate_networks() for [('17f0f6dc-1b39-4c78-b39c-2031585b359a', None, None, None, None, None)] {{(pid=120593) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 24 05:06:18.220314 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.virt.hardware [None req-3637240e-49d8-4a1c-89a2-8027b1395341 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Flavor limits 0:0:0 {{(pid=120593) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 24 05:06:18.220897 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.virt.hardware [None req-3637240e-49d8-4a1c-89a2-8027b1395341 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Image limits 0:0:0 {{(pid=120593) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 24 05:06:18.221194 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.virt.hardware [None req-3637240e-49d8-4a1c-89a2-8027b1395341 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Flavor pref 0:0:0 {{(pid=120593) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 24 05:06:18.221600 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.virt.hardware [None req-3637240e-49d8-4a1c-89a2-8027b1395341 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Image pref 0:0:0 {{(pid=120593) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 24 05:06:18.222026 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.virt.hardware [None req-3637240e-49d8-4a1c-89a2-8027b1395341 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120593) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 24 05:06:18.231350 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-3637240e-49d8-4a1c-89a2-8027b1395341 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:06:18.231827 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-3637240e-49d8-4a1c-89a2-8027b1395341 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:06:18.232258 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-3637240e-49d8-4a1c-89a2-8027b1395341 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:06:18.232978 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-3637240e-49d8-4a1c-89a2-8027b1395341 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:06:18.233426 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-3637240e-49d8-4a1c-89a2-8027b1395341 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:06:18.233845 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-3637240e-49d8-4a1c-89a2-8027b1395341 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:06:18.250664 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.quota [None req-3637240e-49d8-4a1c-89a2-8027b1395341 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Getting quotas for project 87d5229e39fe4817b5187068d8acecc7. Resources: {'instances', 'ram', 'cores'} {{(pid=120593) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 24 05:06:18.254512 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.quota [None req-3637240e-49d8-4a1c-89a2-8027b1395341 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Getting quotas for user 74a8cc19ab204424ab23c62915ac2bab and project 87d5229e39fe4817b5187068d8acecc7. Resources: {'instances', 'ram', 'cores'} {{(pid=120593) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 24 05:06:18.265257 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.compute.api [None req-3637240e-49d8-4a1c-89a2-8027b1395341 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Going to run 1 instances... {{(pid=120593) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 24 05:06:18.267568 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.compute.api [None req-3637240e-49d8-4a1c-89a2-8027b1395341 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] [instance: 34b2ef46-4969-469b-adcd-22abf7c4d6df] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='75ab730a-d8cc-4ea2-b58f-0f3eb476c976',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120593) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 24 05:06:18.315244 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-3637240e-49d8-4a1c-89a2-8027b1395341 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.616915 Sep 24 05:06:18.315888 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 295/617] 10.222.0.50 () {60 vars in 1147 bytes} [Sat Sep 24 05:06:17 2022] POST /compute/v2.1/servers => generated 402 bytes in 618 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 24 05:06:18.327613 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-4aef6a4a-af21-49aa-a074-1ba0d80104a5 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Calling method '>' {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:06:18.328321 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.compute.api [None req-4aef6a4a-af21-49aa-a074-1ba0d80104a5 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] [instance: 34b2ef46-4969-469b-adcd-22abf7c4d6df] Fetching instance by UUID {{(pid=120594) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:06:18.368784 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-39ef47ac-f63d-44c5-abef-878acb3d4d66 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Calling method '>' {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:06:18.369596 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.compute.api [None req-39ef47ac-f63d-44c5-abef-878acb3d4d66 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] [instance: 08fb826b-e891-46c4-990d-ca03cf3f4222] Fetching instance by UUID {{(pid=120593) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:06:18.375698 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-39ef47ac-f63d-44c5-abef-878acb3d4d66 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:06:18.376330 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-39ef47ac-f63d-44c5-abef-878acb3d4d66 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:06:18.376939 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-39ef47ac-f63d-44c5-abef-878acb3d4d66 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:06:18.377768 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-39ef47ac-f63d-44c5-abef-878acb3d4d66 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:06:18.378389 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-39ef47ac-f63d-44c5-abef-878acb3d4d66 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:06:18.378956 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-39ef47ac-f63d-44c5-abef-878acb3d4d66 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:06:18.386713 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.policy [None req-4aef6a4a-af21-49aa-a074-1ba0d80104a5 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74a8cc19ab204424ab23c62915ac2bab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87d5229e39fe4817b5187068d8acecc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:06:18.393488 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [None req-4aef6a4a-af21-49aa-a074-1ba0d80104a5 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] 10.222.0.50 "GET /compute/v2.1/servers/34b2ef46-4969-469b-adcd-22abf7c4d6df" status: 200 len: 1240 microversion: 2.1 time: 0.069741 Sep 24 05:06:18.394276 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 323/618] 10.222.0.50 () {58 vars in 1236 bytes} [Sat Sep 24 05:06:18 2022] GET /compute/v2.1/servers/34b2ef46-4969-469b-adcd-22abf7c4d6df => generated 1240 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 05:06:18.520350 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-39ef47ac-f63d-44c5-abef-878acb3d4d66 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0948754217fc4ff2ba0241fa35feaf90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1aaf20f480a423ea5feca81585aeeed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:06:18.529714 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-39ef47ac-f63d-44c5-abef-878acb3d4d66 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0948754217fc4ff2ba0241fa35feaf90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1aaf20f480a423ea5feca81585aeeed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:06:18.531199 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-39ef47ac-f63d-44c5-abef-878acb3d4d66 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0948754217fc4ff2ba0241fa35feaf90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1aaf20f480a423ea5feca81585aeeed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:06:18.532325 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-39ef47ac-f63d-44c5-abef-878acb3d4d66 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] 10.222.0.50 "GET /compute/v2.1/servers/08fb826b-e891-46c4-990d-ca03cf3f4222" status: 200 len: 1749 microversion: 2.20 time: 0.167426 Sep 24 05:06:18.532909 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 296/619] 10.222.0.50 () {60 vars in 1277 bytes} [Sat Sep 24 05:06:18 2022] GET /compute/v2.1/servers/08fb826b-e891-46c4-990d-ca03cf3f4222 => generated 1749 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 24 05:06:18.701725 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-c29645a7-fcc5-429b-862c-276c3dcebcbb tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Calling method '>' {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:06:18.702368 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.compute.api [None req-c29645a7-fcc5-429b-862c-276c3dcebcbb tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] [instance: b2daebb8-dfea-4ab9-8253-008a21f906e1] Fetching instance by UUID {{(pid=120594) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:06:18.708713 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-c29645a7-fcc5-429b-862c-276c3dcebcbb tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:06:18.709196 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-c29645a7-fcc5-429b-862c-276c3dcebcbb tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:06:18.709638 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-c29645a7-fcc5-429b-862c-276c3dcebcbb tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:06:18.710408 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-c29645a7-fcc5-429b-862c-276c3dcebcbb tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:06:18.710866 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-c29645a7-fcc5-429b-862c-276c3dcebcbb tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:06:18.711312 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-c29645a7-fcc5-429b-862c-276c3dcebcbb tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:06:18.860847 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.policy [None req-c29645a7-fcc5-429b-862c-276c3dcebcbb tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b1b0448e7f54e3aaae49e411699269e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66ec8bde739145dda504995dbea0914a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:06:18.870541 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [None req-c29645a7-fcc5-429b-862c-276c3dcebcbb tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] 10.222.0.50 "GET /compute/v2.1/servers/b2daebb8-dfea-4ab9-8253-008a21f906e1" status: 200 len: 1724 microversion: 2.1 time: 0.172823 Sep 24 05:06:18.871181 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 324/620] 10.222.0.50 () {58 vars in 1236 bytes} [Sat Sep 24 05:06:18 2022] GET /compute/v2.1/servers/b2daebb8-dfea-4ab9-8253-008a21f906e1 => generated 1724 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 05:06:19.416914 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-5b2d05c2-845a-4a16-81fa-fee1171f3af4 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Calling method '>' {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:06:19.417450 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.compute.api [None req-5b2d05c2-845a-4a16-81fa-fee1171f3af4 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] [instance: 34b2ef46-4969-469b-adcd-22abf7c4d6df] Fetching instance by UUID {{(pid=120593) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:06:19.423804 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-5b2d05c2-845a-4a16-81fa-fee1171f3af4 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:06:19.424284 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-5b2d05c2-845a-4a16-81fa-fee1171f3af4 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:06:19.424715 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-5b2d05c2-845a-4a16-81fa-fee1171f3af4 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:06:19.425400 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-5b2d05c2-845a-4a16-81fa-fee1171f3af4 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:06:19.425849 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-5b2d05c2-845a-4a16-81fa-fee1171f3af4 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:06:19.426306 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-5b2d05c2-845a-4a16-81fa-fee1171f3af4 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:06:19.487486 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-5b2d05c2-845a-4a16-81fa-fee1171f3af4 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74a8cc19ab204424ab23c62915ac2bab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87d5229e39fe4817b5187068d8acecc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:06:19.495582 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-5b2d05c2-845a-4a16-81fa-fee1171f3af4 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] 10.222.0.50 "GET /compute/v2.1/servers/34b2ef46-4969-469b-adcd-22abf7c4d6df" status: 200 len: 1292 microversion: 2.1 time: 0.082592 Sep 24 05:06:19.496149 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 297/621] 10.222.0.50 () {58 vars in 1236 bytes} [Sat Sep 24 05:06:19 2022] GET /compute/v2.1/servers/34b2ef46-4969-469b-adcd-22abf7c4d6df => generated 1292 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 05:06:19.560785 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-5471970d-9f85-4d0b-abc1-35182050802f tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Calling method '>' {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:06:19.561397 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.compute.api [None req-5471970d-9f85-4d0b-abc1-35182050802f tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] [instance: 08fb826b-e891-46c4-990d-ca03cf3f4222] Fetching instance by UUID {{(pid=120594) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:06:19.567501 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-5471970d-9f85-4d0b-abc1-35182050802f tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:06:19.567973 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-5471970d-9f85-4d0b-abc1-35182050802f tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:06:19.568401 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-5471970d-9f85-4d0b-abc1-35182050802f tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:06:19.569077 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-5471970d-9f85-4d0b-abc1-35182050802f tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:06:19.569605 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-5471970d-9f85-4d0b-abc1-35182050802f tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:06:19.570030 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-5471970d-9f85-4d0b-abc1-35182050802f tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:06:19.703898 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.policy [None req-5471970d-9f85-4d0b-abc1-35182050802f tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0948754217fc4ff2ba0241fa35feaf90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1aaf20f480a423ea5feca81585aeeed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:06:19.713614 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.policy [None req-5471970d-9f85-4d0b-abc1-35182050802f tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0948754217fc4ff2ba0241fa35feaf90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1aaf20f480a423ea5feca81585aeeed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:06:19.715082 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.policy [None req-5471970d-9f85-4d0b-abc1-35182050802f tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0948754217fc4ff2ba0241fa35feaf90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1aaf20f480a423ea5feca81585aeeed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:06:19.716308 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [None req-5471970d-9f85-4d0b-abc1-35182050802f tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] 10.222.0.50 "GET /compute/v2.1/servers/08fb826b-e891-46c4-990d-ca03cf3f4222" status: 200 len: 1749 microversion: 2.20 time: 0.159437 Sep 24 05:06:19.716928 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 325/622] 10.222.0.50 () {60 vars in 1277 bytes} [Sat Sep 24 05:06:19 2022] GET /compute/v2.1/servers/08fb826b-e891-46c4-990d-ca03cf3f4222 => generated 1749 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 24 05:06:19.895407 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-02c03012-e0ef-4d0b-a230-ddb37e6b7cd5 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Calling method '>' {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:06:19.896657 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.compute.api [None req-02c03012-e0ef-4d0b-a230-ddb37e6b7cd5 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] [instance: b2daebb8-dfea-4ab9-8253-008a21f906e1] Fetching instance by UUID {{(pid=120593) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:06:19.903690 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-02c03012-e0ef-4d0b-a230-ddb37e6b7cd5 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:06:19.904179 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-02c03012-e0ef-4d0b-a230-ddb37e6b7cd5 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:06:19.904649 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-02c03012-e0ef-4d0b-a230-ddb37e6b7cd5 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:06:19.905344 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-02c03012-e0ef-4d0b-a230-ddb37e6b7cd5 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:06:19.905799 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-02c03012-e0ef-4d0b-a230-ddb37e6b7cd5 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:06:19.906261 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-02c03012-e0ef-4d0b-a230-ddb37e6b7cd5 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:06:20.041676 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-02c03012-e0ef-4d0b-a230-ddb37e6b7cd5 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b1b0448e7f54e3aaae49e411699269e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66ec8bde739145dda504995dbea0914a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:06:20.049886 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-02c03012-e0ef-4d0b-a230-ddb37e6b7cd5 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] 10.222.0.50 "GET /compute/v2.1/servers/b2daebb8-dfea-4ab9-8253-008a21f906e1" status: 200 len: 1724 microversion: 2.1 time: 0.159139 Sep 24 05:06:20.050482 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 298/623] 10.222.0.50 () {58 vars in 1236 bytes} [Sat Sep 24 05:06:19 2022] GET /compute/v2.1/servers/b2daebb8-dfea-4ab9-8253-008a21f906e1 => generated 1724 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 05:06:20.519203 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-6552582b-1a65-4cbf-9cb5-3752e69c13bd tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Calling method '>' {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:06:20.519798 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.compute.api [None req-6552582b-1a65-4cbf-9cb5-3752e69c13bd tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] [instance: 34b2ef46-4969-469b-adcd-22abf7c4d6df] Fetching instance by UUID {{(pid=120594) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:06:20.526501 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-6552582b-1a65-4cbf-9cb5-3752e69c13bd tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:06:20.526984 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-6552582b-1a65-4cbf-9cb5-3752e69c13bd tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:06:20.527425 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-6552582b-1a65-4cbf-9cb5-3752e69c13bd tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:06:20.528143 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-6552582b-1a65-4cbf-9cb5-3752e69c13bd tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:06:20.528594 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-6552582b-1a65-4cbf-9cb5-3752e69c13bd tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:06:20.529407 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-6552582b-1a65-4cbf-9cb5-3752e69c13bd tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:06:20.664163 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.policy [None req-6552582b-1a65-4cbf-9cb5-3752e69c13bd tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74a8cc19ab204424ab23c62915ac2bab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87d5229e39fe4817b5187068d8acecc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:06:20.672020 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [None req-6552582b-1a65-4cbf-9cb5-3752e69c13bd tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] 10.222.0.50 "GET /compute/v2.1/servers/34b2ef46-4969-469b-adcd-22abf7c4d6df" status: 200 len: 1366 microversion: 2.1 time: 0.156824 Sep 24 05:06:20.672588 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 326/624] 10.222.0.50 () {58 vars in 1236 bytes} [Sat Sep 24 05:06:20 2022] GET /compute/v2.1/servers/34b2ef46-4969-469b-adcd-22abf7c4d6df => generated 1366 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 05:06:20.742171 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-cb3d1349-7b60-40cc-be83-c5510ef4689b tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Calling method '>' {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:06:20.742785 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.compute.api [None req-cb3d1349-7b60-40cc-be83-c5510ef4689b tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] [instance: 08fb826b-e891-46c4-990d-ca03cf3f4222] Fetching instance by UUID {{(pid=120593) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:06:20.749139 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-cb3d1349-7b60-40cc-be83-c5510ef4689b tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:06:20.749642 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-cb3d1349-7b60-40cc-be83-c5510ef4689b tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:06:20.750198 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-cb3d1349-7b60-40cc-be83-c5510ef4689b tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:06:20.751038 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-cb3d1349-7b60-40cc-be83-c5510ef4689b tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:06:20.751340 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-cb3d1349-7b60-40cc-be83-c5510ef4689b tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:06:20.751764 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-cb3d1349-7b60-40cc-be83-c5510ef4689b tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:06:20.888162 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-cb3d1349-7b60-40cc-be83-c5510ef4689b tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0948754217fc4ff2ba0241fa35feaf90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1aaf20f480a423ea5feca81585aeeed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:06:20.896581 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-cb3d1349-7b60-40cc-be83-c5510ef4689b tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0948754217fc4ff2ba0241fa35feaf90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1aaf20f480a423ea5feca81585aeeed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:06:20.898060 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-cb3d1349-7b60-40cc-be83-c5510ef4689b tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0948754217fc4ff2ba0241fa35feaf90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1aaf20f480a423ea5feca81585aeeed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:06:20.899667 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-cb3d1349-7b60-40cc-be83-c5510ef4689b tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] 10.222.0.50 "GET /compute/v2.1/servers/08fb826b-e891-46c4-990d-ca03cf3f4222" status: 200 len: 1749 microversion: 2.20 time: 0.162079 Sep 24 05:06:20.900233 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 299/625] 10.222.0.50 () {60 vars in 1277 bytes} [Sat Sep 24 05:06:20 2022] GET /compute/v2.1/servers/08fb826b-e891-46c4-990d-ca03cf3f4222 => generated 1749 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 05:06:21.075222 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-8239c521-a8ae-4b81-9bf9-a2ed4b8a0770 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Calling method '>' {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:06:21.080180 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.compute.api [None req-8239c521-a8ae-4b81-9bf9-a2ed4b8a0770 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] [instance: b2daebb8-dfea-4ab9-8253-008a21f906e1] Fetching instance by UUID {{(pid=120594) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:06:21.088917 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-8239c521-a8ae-4b81-9bf9-a2ed4b8a0770 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:06:21.089664 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-8239c521-a8ae-4b81-9bf9-a2ed4b8a0770 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:06:21.090293 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-8239c521-a8ae-4b81-9bf9-a2ed4b8a0770 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:06:21.091109 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-8239c521-a8ae-4b81-9bf9-a2ed4b8a0770 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:06:21.091552 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-8239c521-a8ae-4b81-9bf9-a2ed4b8a0770 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:06:21.091970 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-8239c521-a8ae-4b81-9bf9-a2ed4b8a0770 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:06:21.151678 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [req-dc8bd05c-968b-4eba-87c5-02080036ca46 req-4c3cefd4-f22e-4cec-96e9-94291b769d1f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "34b2ef46-4969-469b-adcd-22abf7c4d6df", "tag": "7496c434-3138-4ef6-8254-ee2787a76407"}]} {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 05:06:21.177160 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [req-dc8bd05c-968b-4eba-87c5-02080036ca46 req-4c3cefd4-f22e-4cec-96e9-94291b769d1f service nova] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:06:21.177949 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [req-dc8bd05c-968b-4eba-87c5-02080036ca46 req-4c3cefd4-f22e-4cec-96e9-94291b769d1f service nova] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:06:21.179874 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [req-dc8bd05c-968b-4eba-87c5-02080036ca46 req-4c3cefd4-f22e-4cec-96e9-94291b769d1f service nova] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:06:21.196572 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.compute.server_external_events [req-dc8bd05c-968b-4eba-87c5-02080036ca46 req-4c3cefd4-f22e-4cec-96e9-94291b769d1f service nova] Creating event network-changed:7496c434-3138-4ef6-8254-ee2787a76407 for instance 34b2ef46-4969-469b-adcd-22abf7c4d6df on hv-cinder-85918 Sep 24 05:06:21.201458 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [req-dc8bd05c-968b-4eba-87c5-02080036ca46 req-4c3cefd4-f22e-4cec-96e9-94291b769d1f service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.129987 Sep 24 05:06:21.202084 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 300/626] 10.222.0.50 () {64 vars in 1317 bytes} [Sat Sep 24 05:06:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 05:06:21.247625 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.policy [None req-8239c521-a8ae-4b81-9bf9-a2ed4b8a0770 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b1b0448e7f54e3aaae49e411699269e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66ec8bde739145dda504995dbea0914a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:06:21.255936 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [None req-8239c521-a8ae-4b81-9bf9-a2ed4b8a0770 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] 10.222.0.50 "GET /compute/v2.1/servers/b2daebb8-dfea-4ab9-8253-008a21f906e1" status: 200 len: 1724 microversion: 2.1 time: 0.187078 Sep 24 05:06:21.256507 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 327/627] 10.222.0.50 () {58 vars in 1236 bytes} [Sat Sep 24 05:06:21 2022] GET /compute/v2.1/servers/b2daebb8-dfea-4ab9-8253-008a21f906e1 => generated 1724 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 05:06:21.695841 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-42926666-5bb4-4338-ae4f-a1a9e5d22853 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Calling method '>' {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:06:21.696573 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.compute.api [None req-42926666-5bb4-4338-ae4f-a1a9e5d22853 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] [instance: 34b2ef46-4969-469b-adcd-22abf7c4d6df] Fetching instance by UUID {{(pid=120593) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:06:21.702791 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-42926666-5bb4-4338-ae4f-a1a9e5d22853 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:06:21.703271 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-42926666-5bb4-4338-ae4f-a1a9e5d22853 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:06:21.703707 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-42926666-5bb4-4338-ae4f-a1a9e5d22853 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:06:21.704424 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-42926666-5bb4-4338-ae4f-a1a9e5d22853 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:06:21.704878 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-42926666-5bb4-4338-ae4f-a1a9e5d22853 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:06:21.705300 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-42926666-5bb4-4338-ae4f-a1a9e5d22853 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:06:21.836567 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-42926666-5bb4-4338-ae4f-a1a9e5d22853 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74a8cc19ab204424ab23c62915ac2bab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87d5229e39fe4817b5187068d8acecc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:06:21.844470 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-42926666-5bb4-4338-ae4f-a1a9e5d22853 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] 10.222.0.50 "GET /compute/v2.1/servers/34b2ef46-4969-469b-adcd-22abf7c4d6df" status: 200 len: 1366 microversion: 2.1 time: 0.153470 Sep 24 05:06:21.845039 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 301/628] 10.222.0.50 () {58 vars in 1236 bytes} [Sat Sep 24 05:06:21 2022] GET /compute/v2.1/servers/34b2ef46-4969-469b-adcd-22abf7c4d6df => generated 1366 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 05:06:21.924701 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-33b14f8a-3061-453b-a43f-18d5c13eb234 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Calling method '>' {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:06:21.925228 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.compute.api [None req-33b14f8a-3061-453b-a43f-18d5c13eb234 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] [instance: 08fb826b-e891-46c4-990d-ca03cf3f4222] Fetching instance by UUID {{(pid=120594) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:06:21.931188 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-33b14f8a-3061-453b-a43f-18d5c13eb234 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:06:21.931660 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-33b14f8a-3061-453b-a43f-18d5c13eb234 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:06:21.932089 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-33b14f8a-3061-453b-a43f-18d5c13eb234 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:06:21.932763 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-33b14f8a-3061-453b-a43f-18d5c13eb234 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:06:21.933202 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-33b14f8a-3061-453b-a43f-18d5c13eb234 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:06:21.933614 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-33b14f8a-3061-453b-a43f-18d5c13eb234 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:06:22.064732 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.policy [None req-33b14f8a-3061-453b-a43f-18d5c13eb234 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0948754217fc4ff2ba0241fa35feaf90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1aaf20f480a423ea5feca81585aeeed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:06:22.073260 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.policy [None req-33b14f8a-3061-453b-a43f-18d5c13eb234 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0948754217fc4ff2ba0241fa35feaf90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1aaf20f480a423ea5feca81585aeeed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:06:22.074745 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.policy [None req-33b14f8a-3061-453b-a43f-18d5c13eb234 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0948754217fc4ff2ba0241fa35feaf90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1aaf20f480a423ea5feca81585aeeed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:06:22.075891 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [None req-33b14f8a-3061-453b-a43f-18d5c13eb234 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] 10.222.0.50 "GET /compute/v2.1/servers/08fb826b-e891-46c4-990d-ca03cf3f4222" status: 200 len: 1749 microversion: 2.20 time: 0.155170 Sep 24 05:06:22.076659 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 328/629] 10.222.0.50 () {60 vars in 1277 bytes} [Sat Sep 24 05:06:21 2022] GET /compute/v2.1/servers/08fb826b-e891-46c4-990d-ca03cf3f4222 => generated 1749 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 05:06:22.280218 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-c3d44078-aec7-4af0-826d-93a682a3ae34 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Calling method '>' {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:06:22.280861 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.compute.api [None req-c3d44078-aec7-4af0-826d-93a682a3ae34 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] [instance: b2daebb8-dfea-4ab9-8253-008a21f906e1] Fetching instance by UUID {{(pid=120593) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:06:22.286724 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-c3d44078-aec7-4af0-826d-93a682a3ae34 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:06:22.287207 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-c3d44078-aec7-4af0-826d-93a682a3ae34 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:06:22.287653 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-c3d44078-aec7-4af0-826d-93a682a3ae34 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:06:22.288338 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-c3d44078-aec7-4af0-826d-93a682a3ae34 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:06:22.289436 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-c3d44078-aec7-4af0-826d-93a682a3ae34 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:06:22.289861 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-c3d44078-aec7-4af0-826d-93a682a3ae34 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:06:22.415493 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-c3d44078-aec7-4af0-826d-93a682a3ae34 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b1b0448e7f54e3aaae49e411699269e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66ec8bde739145dda504995dbea0914a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:06:22.424154 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-c3d44078-aec7-4af0-826d-93a682a3ae34 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] 10.222.0.50 "GET /compute/v2.1/servers/b2daebb8-dfea-4ab9-8253-008a21f906e1" status: 200 len: 1724 microversion: 2.1 time: 0.147861 Sep 24 05:06:22.424789 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 302/630] 10.222.0.50 () {58 vars in 1236 bytes} [Sat Sep 24 05:06:22 2022] GET /compute/v2.1/servers/b2daebb8-dfea-4ab9-8253-008a21f906e1 => generated 1724 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 05:06:22.867741 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-d96bf6b5-955f-49e0-b264-e46910c6b0b7 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Calling method '>' {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:06:22.868345 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.compute.api [None req-d96bf6b5-955f-49e0-b264-e46910c6b0b7 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] [instance: 34b2ef46-4969-469b-adcd-22abf7c4d6df] Fetching instance by UUID {{(pid=120594) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:06:22.875198 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-d96bf6b5-955f-49e0-b264-e46910c6b0b7 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:06:22.875673 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-d96bf6b5-955f-49e0-b264-e46910c6b0b7 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:06:22.876103 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-d96bf6b5-955f-49e0-b264-e46910c6b0b7 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:06:22.876812 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-d96bf6b5-955f-49e0-b264-e46910c6b0b7 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:06:22.877258 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-d96bf6b5-955f-49e0-b264-e46910c6b0b7 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:06:22.877672 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-d96bf6b5-955f-49e0-b264-e46910c6b0b7 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:06:23.007004 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.policy [None req-d96bf6b5-955f-49e0-b264-e46910c6b0b7 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74a8cc19ab204424ab23c62915ac2bab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87d5229e39fe4817b5187068d8acecc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:06:23.014486 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [None req-d96bf6b5-955f-49e0-b264-e46910c6b0b7 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] 10.222.0.50 "GET /compute/v2.1/servers/34b2ef46-4969-469b-adcd-22abf7c4d6df" status: 200 len: 1366 microversion: 2.1 time: 0.150603 Sep 24 05:06:23.015045 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 329/631] 10.222.0.50 () {58 vars in 1236 bytes} [Sat Sep 24 05:06:22 2022] GET /compute/v2.1/servers/34b2ef46-4969-469b-adcd-22abf7c4d6df => generated 1366 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 05:06:23.100569 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-ebf40cdc-0623-450f-bd98-bea4519bfe81 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Calling method '>' {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:06:23.101756 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.compute.api [None req-ebf40cdc-0623-450f-bd98-bea4519bfe81 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] [instance: 08fb826b-e891-46c4-990d-ca03cf3f4222] Fetching instance by UUID {{(pid=120593) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:06:23.108079 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-ebf40cdc-0623-450f-bd98-bea4519bfe81 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:06:23.108553 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-ebf40cdc-0623-450f-bd98-bea4519bfe81 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:06:23.108992 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-ebf40cdc-0623-450f-bd98-bea4519bfe81 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:06:23.109669 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-ebf40cdc-0623-450f-bd98-bea4519bfe81 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:06:23.110146 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-ebf40cdc-0623-450f-bd98-bea4519bfe81 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:06:23.110565 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-ebf40cdc-0623-450f-bd98-bea4519bfe81 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:06:23.239234 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-ebf40cdc-0623-450f-bd98-bea4519bfe81 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0948754217fc4ff2ba0241fa35feaf90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1aaf20f480a423ea5feca81585aeeed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:06:23.248208 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-ebf40cdc-0623-450f-bd98-bea4519bfe81 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0948754217fc4ff2ba0241fa35feaf90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1aaf20f480a423ea5feca81585aeeed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:06:23.249634 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-ebf40cdc-0623-450f-bd98-bea4519bfe81 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0948754217fc4ff2ba0241fa35feaf90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1aaf20f480a423ea5feca81585aeeed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:06:23.250812 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-ebf40cdc-0623-450f-bd98-bea4519bfe81 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] 10.222.0.50 "GET /compute/v2.1/servers/08fb826b-e891-46c4-990d-ca03cf3f4222" status: 200 len: 1749 microversion: 2.20 time: 0.154180 Sep 24 05:06:23.251372 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 303/632] 10.222.0.50 () {60 vars in 1277 bytes} [Sat Sep 24 05:06:23 2022] GET /compute/v2.1/servers/08fb826b-e891-46c4-990d-ca03cf3f4222 => generated 1749 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 05:06:23.448924 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-6db0c895-e826-48e0-b36a-5778b4d4e24b tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Calling method '>' {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:06:23.449526 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.compute.api [None req-6db0c895-e826-48e0-b36a-5778b4d4e24b tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] [instance: b2daebb8-dfea-4ab9-8253-008a21f906e1] Fetching instance by UUID {{(pid=120594) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:06:23.455388 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-6db0c895-e826-48e0-b36a-5778b4d4e24b tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:06:23.455862 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-6db0c895-e826-48e0-b36a-5778b4d4e24b tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:06:23.456314 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-6db0c895-e826-48e0-b36a-5778b4d4e24b tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:06:23.456985 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-6db0c895-e826-48e0-b36a-5778b4d4e24b tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:06:23.457435 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-6db0c895-e826-48e0-b36a-5778b4d4e24b tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:06:23.457845 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-6db0c895-e826-48e0-b36a-5778b4d4e24b tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:06:23.587074 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.policy [None req-6db0c895-e826-48e0-b36a-5778b4d4e24b tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b1b0448e7f54e3aaae49e411699269e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66ec8bde739145dda504995dbea0914a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:06:23.595054 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [None req-6db0c895-e826-48e0-b36a-5778b4d4e24b tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] 10.222.0.50 "GET /compute/v2.1/servers/b2daebb8-dfea-4ab9-8253-008a21f906e1" status: 200 len: 1724 microversion: 2.1 time: 0.150470 Sep 24 05:06:23.595613 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 330/633] 10.222.0.50 () {58 vars in 1236 bytes} [Sat Sep 24 05:06:23 2022] GET /compute/v2.1/servers/b2daebb8-dfea-4ab9-8253-008a21f906e1 => generated 1724 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 05:06:24.037366 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-14728c28-219b-46bf-b6bc-7ab36e3bcb4e tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Calling method '>' {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:06:24.037966 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.compute.api [None req-14728c28-219b-46bf-b6bc-7ab36e3bcb4e tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] [instance: 34b2ef46-4969-469b-adcd-22abf7c4d6df] Fetching instance by UUID {{(pid=120593) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:06:24.043907 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-14728c28-219b-46bf-b6bc-7ab36e3bcb4e tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:06:24.044376 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-14728c28-219b-46bf-b6bc-7ab36e3bcb4e tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:06:24.044803 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-14728c28-219b-46bf-b6bc-7ab36e3bcb4e tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:06:24.045472 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-14728c28-219b-46bf-b6bc-7ab36e3bcb4e tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:06:24.045926 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-14728c28-219b-46bf-b6bc-7ab36e3bcb4e tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:06:24.046348 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-14728c28-219b-46bf-b6bc-7ab36e3bcb4e tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:06:24.176883 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-14728c28-219b-46bf-b6bc-7ab36e3bcb4e tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74a8cc19ab204424ab23c62915ac2bab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87d5229e39fe4817b5187068d8acecc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:06:24.184376 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-14728c28-219b-46bf-b6bc-7ab36e3bcb4e tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] 10.222.0.50 "GET /compute/v2.1/servers/34b2ef46-4969-469b-adcd-22abf7c4d6df" status: 200 len: 1366 microversion: 2.1 time: 0.150829 Sep 24 05:06:24.184938 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 304/634] 10.222.0.50 () {58 vars in 1236 bytes} [Sat Sep 24 05:06:24 2022] GET /compute/v2.1/servers/34b2ef46-4969-469b-adcd-22abf7c4d6df => generated 1366 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 05:06:24.276467 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-b013f2a6-9b52-4acd-813e-6dc43b53e7b0 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Calling method '>' {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:06:24.277079 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.compute.api [None req-b013f2a6-9b52-4acd-813e-6dc43b53e7b0 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] [instance: 08fb826b-e891-46c4-990d-ca03cf3f4222] Fetching instance by UUID {{(pid=120594) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:06:24.283546 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-b013f2a6-9b52-4acd-813e-6dc43b53e7b0 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:06:24.284058 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-b013f2a6-9b52-4acd-813e-6dc43b53e7b0 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:06:24.284516 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-b013f2a6-9b52-4acd-813e-6dc43b53e7b0 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:06:24.285251 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-b013f2a6-9b52-4acd-813e-6dc43b53e7b0 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:06:24.285737 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-b013f2a6-9b52-4acd-813e-6dc43b53e7b0 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:06:24.286238 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-b013f2a6-9b52-4acd-813e-6dc43b53e7b0 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:06:24.411954 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.policy [None req-b013f2a6-9b52-4acd-813e-6dc43b53e7b0 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0948754217fc4ff2ba0241fa35feaf90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1aaf20f480a423ea5feca81585aeeed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:06:24.420834 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.policy [None req-b013f2a6-9b52-4acd-813e-6dc43b53e7b0 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0948754217fc4ff2ba0241fa35feaf90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1aaf20f480a423ea5feca81585aeeed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:06:24.422312 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.policy [None req-b013f2a6-9b52-4acd-813e-6dc43b53e7b0 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0948754217fc4ff2ba0241fa35feaf90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1aaf20f480a423ea5feca81585aeeed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:06:24.423499 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [None req-b013f2a6-9b52-4acd-813e-6dc43b53e7b0 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] 10.222.0.50 "GET /compute/v2.1/servers/08fb826b-e891-46c4-990d-ca03cf3f4222" status: 200 len: 1749 microversion: 2.20 time: 0.151273 Sep 24 05:06:24.424055 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 331/635] 10.222.0.50 () {60 vars in 1277 bytes} [Sat Sep 24 05:06:24 2022] GET /compute/v2.1/servers/08fb826b-e891-46c4-990d-ca03cf3f4222 => generated 1749 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 24 05:06:24.617303 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-57f67acd-9ec2-45a9-94bc-540557bef27a tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Calling method '>' {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:06:24.617845 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.compute.api [None req-57f67acd-9ec2-45a9-94bc-540557bef27a tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] [instance: b2daebb8-dfea-4ab9-8253-008a21f906e1] Fetching instance by UUID {{(pid=120593) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:06:24.623938 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-57f67acd-9ec2-45a9-94bc-540557bef27a tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:06:24.624435 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-57f67acd-9ec2-45a9-94bc-540557bef27a tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:06:24.624862 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-57f67acd-9ec2-45a9-94bc-540557bef27a tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:06:24.625537 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-57f67acd-9ec2-45a9-94bc-540557bef27a tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:06:24.625980 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-57f67acd-9ec2-45a9-94bc-540557bef27a tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:06:24.626422 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-57f67acd-9ec2-45a9-94bc-540557bef27a tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:06:24.957522 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-57f67acd-9ec2-45a9-94bc-540557bef27a tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b1b0448e7f54e3aaae49e411699269e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66ec8bde739145dda504995dbea0914a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:06:24.966014 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-57f67acd-9ec2-45a9-94bc-540557bef27a tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] 10.222.0.50 "GET /compute/v2.1/servers/b2daebb8-dfea-4ab9-8253-008a21f906e1" status: 200 len: 1724 microversion: 2.1 time: 0.353252 Sep 24 05:06:24.966577 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 305/636] 10.222.0.50 () {58 vars in 1236 bytes} [Sat Sep 24 05:06:24 2022] GET /compute/v2.1/servers/b2daebb8-dfea-4ab9-8253-008a21f906e1 => generated 1724 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 05:06:25.207585 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-9a84794c-9b51-406d-b72c-a33de89607b1 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Calling method '>' {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:06:25.208317 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.compute.api [None req-9a84794c-9b51-406d-b72c-a33de89607b1 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] [instance: 34b2ef46-4969-469b-adcd-22abf7c4d6df] Fetching instance by UUID {{(pid=120594) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:06:25.215213 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-9a84794c-9b51-406d-b72c-a33de89607b1 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:06:25.215766 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-9a84794c-9b51-406d-b72c-a33de89607b1 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:06:25.216265 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-9a84794c-9b51-406d-b72c-a33de89607b1 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:06:25.217030 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-9a84794c-9b51-406d-b72c-a33de89607b1 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:06:25.217550 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-9a84794c-9b51-406d-b72c-a33de89607b1 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:06:25.218093 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-9a84794c-9b51-406d-b72c-a33de89607b1 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:06:25.344694 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.policy [None req-9a84794c-9b51-406d-b72c-a33de89607b1 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74a8cc19ab204424ab23c62915ac2bab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87d5229e39fe4817b5187068d8acecc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:06:25.352192 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [None req-9a84794c-9b51-406d-b72c-a33de89607b1 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] 10.222.0.50 "GET /compute/v2.1/servers/34b2ef46-4969-469b-adcd-22abf7c4d6df" status: 200 len: 1366 microversion: 2.1 time: 0.148394 Sep 24 05:06:25.352752 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 332/637] 10.222.0.50 () {58 vars in 1236 bytes} [Sat Sep 24 05:06:25 2022] GET /compute/v2.1/servers/34b2ef46-4969-469b-adcd-22abf7c4d6df => generated 1366 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 05:06:25.449817 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-5fce4fa9-0247-4ee3-9962-c4a59e1d17a6 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Calling method '>' {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:06:25.450448 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.compute.api [None req-5fce4fa9-0247-4ee3-9962-c4a59e1d17a6 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] [instance: 08fb826b-e891-46c4-990d-ca03cf3f4222] Fetching instance by UUID {{(pid=120593) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:06:25.456744 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-5fce4fa9-0247-4ee3-9962-c4a59e1d17a6 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:06:25.457212 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-5fce4fa9-0247-4ee3-9962-c4a59e1d17a6 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:06:25.457685 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-5fce4fa9-0247-4ee3-9962-c4a59e1d17a6 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:06:25.458356 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-5fce4fa9-0247-4ee3-9962-c4a59e1d17a6 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:06:25.458796 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-5fce4fa9-0247-4ee3-9962-c4a59e1d17a6 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:06:25.459213 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-5fce4fa9-0247-4ee3-9962-c4a59e1d17a6 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:06:25.588512 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-5fce4fa9-0247-4ee3-9962-c4a59e1d17a6 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0948754217fc4ff2ba0241fa35feaf90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1aaf20f480a423ea5feca81585aeeed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:06:25.597029 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-5fce4fa9-0247-4ee3-9962-c4a59e1d17a6 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0948754217fc4ff2ba0241fa35feaf90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1aaf20f480a423ea5feca81585aeeed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:06:25.598480 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-5fce4fa9-0247-4ee3-9962-c4a59e1d17a6 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0948754217fc4ff2ba0241fa35feaf90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1aaf20f480a423ea5feca81585aeeed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:06:25.599620 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-5fce4fa9-0247-4ee3-9962-c4a59e1d17a6 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] 10.222.0.50 "GET /compute/v2.1/servers/08fb826b-e891-46c4-990d-ca03cf3f4222" status: 200 len: 1749 microversion: 2.20 time: 0.153687 Sep 24 05:06:25.600675 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 306/638] 10.222.0.50 () {60 vars in 1277 bytes} [Sat Sep 24 05:06:25 2022] GET /compute/v2.1/servers/08fb826b-e891-46c4-990d-ca03cf3f4222 => generated 1749 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 05:06:25.989334 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-8e66c2aa-a084-4ffe-9f4e-c21d6bb4caaf tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Calling method '>' {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:06:25.989861 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.compute.api [None req-8e66c2aa-a084-4ffe-9f4e-c21d6bb4caaf tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] [instance: b2daebb8-dfea-4ab9-8253-008a21f906e1] Fetching instance by UUID {{(pid=120594) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:06:25.996373 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-8e66c2aa-a084-4ffe-9f4e-c21d6bb4caaf tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:06:25.996847 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-8e66c2aa-a084-4ffe-9f4e-c21d6bb4caaf tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:06:25.997274 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-8e66c2aa-a084-4ffe-9f4e-c21d6bb4caaf tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:06:25.997946 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-8e66c2aa-a084-4ffe-9f4e-c21d6bb4caaf tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:06:25.998423 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-8e66c2aa-a084-4ffe-9f4e-c21d6bb4caaf tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:06:25.998841 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-8e66c2aa-a084-4ffe-9f4e-c21d6bb4caaf tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:06:26.013655 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG dbcounter [-] [120594] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=120594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 05:06:26.125648 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.policy [None req-8e66c2aa-a084-4ffe-9f4e-c21d6bb4caaf tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b1b0448e7f54e3aaae49e411699269e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66ec8bde739145dda504995dbea0914a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:06:26.133885 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [None req-8e66c2aa-a084-4ffe-9f4e-c21d6bb4caaf tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] 10.222.0.50 "GET /compute/v2.1/servers/b2daebb8-dfea-4ab9-8253-008a21f906e1" status: 200 len: 1724 microversion: 2.1 time: 0.148444 Sep 24 05:06:26.134568 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 333/639] 10.222.0.50 () {58 vars in 1236 bytes} [Sat Sep 24 05:06:25 2022] GET /compute/v2.1/servers/b2daebb8-dfea-4ab9-8253-008a21f906e1 => generated 1724 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 05:06:26.375053 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-b4193273-8daa-4493-856f-68362ea2a595 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Calling method '>' {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:06:26.375652 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.compute.api [None req-b4193273-8daa-4493-856f-68362ea2a595 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] [instance: 34b2ef46-4969-469b-adcd-22abf7c4d6df] Fetching instance by UUID {{(pid=120593) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:06:26.381539 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-b4193273-8daa-4493-856f-68362ea2a595 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:06:26.382042 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-b4193273-8daa-4493-856f-68362ea2a595 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:06:26.382474 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-b4193273-8daa-4493-856f-68362ea2a595 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:06:26.383148 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-b4193273-8daa-4493-856f-68362ea2a595 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:06:26.383593 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-b4193273-8daa-4493-856f-68362ea2a595 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:06:26.384002 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-b4193273-8daa-4493-856f-68362ea2a595 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:06:26.522247 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-b4193273-8daa-4493-856f-68362ea2a595 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74a8cc19ab204424ab23c62915ac2bab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87d5229e39fe4817b5187068d8acecc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:06:26.530147 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-b4193273-8daa-4493-856f-68362ea2a595 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] 10.222.0.50 "GET /compute/v2.1/servers/34b2ef46-4969-469b-adcd-22abf7c4d6df" status: 200 len: 1366 microversion: 2.1 time: 0.159024 Sep 24 05:06:26.530710 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 307/640] 10.222.0.50 () {58 vars in 1236 bytes} [Sat Sep 24 05:06:26 2022] GET /compute/v2.1/servers/34b2ef46-4969-469b-adcd-22abf7c4d6df => generated 1366 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 05:06:26.625950 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-5b660bb8-a0ed-4122-87dd-b491d1d82415 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Calling method '>' {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:06:26.626604 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.compute.api [None req-5b660bb8-a0ed-4122-87dd-b491d1d82415 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] [instance: 08fb826b-e891-46c4-990d-ca03cf3f4222] Fetching instance by UUID {{(pid=120594) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:06:26.633142 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-5b660bb8-a0ed-4122-87dd-b491d1d82415 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:06:26.633610 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-5b660bb8-a0ed-4122-87dd-b491d1d82415 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:06:26.634059 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-5b660bb8-a0ed-4122-87dd-b491d1d82415 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:06:26.634738 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-5b660bb8-a0ed-4122-87dd-b491d1d82415 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:06:26.635178 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-5b660bb8-a0ed-4122-87dd-b491d1d82415 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:06:26.635591 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-5b660bb8-a0ed-4122-87dd-b491d1d82415 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:06:26.762983 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.policy [None req-5b660bb8-a0ed-4122-87dd-b491d1d82415 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0948754217fc4ff2ba0241fa35feaf90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1aaf20f480a423ea5feca81585aeeed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:06:26.771412 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.policy [None req-5b660bb8-a0ed-4122-87dd-b491d1d82415 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0948754217fc4ff2ba0241fa35feaf90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1aaf20f480a423ea5feca81585aeeed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:06:26.773309 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.policy [None req-5b660bb8-a0ed-4122-87dd-b491d1d82415 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0948754217fc4ff2ba0241fa35feaf90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1aaf20f480a423ea5feca81585aeeed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:06:26.774725 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [None req-5b660bb8-a0ed-4122-87dd-b491d1d82415 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] 10.222.0.50 "GET /compute/v2.1/servers/08fb826b-e891-46c4-990d-ca03cf3f4222" status: 200 len: 1749 microversion: 2.20 time: 0.152463 Sep 24 05:06:26.775450 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 334/641] 10.222.0.50 () {60 vars in 1277 bytes} [Sat Sep 24 05:06:26 2022] GET /compute/v2.1/servers/08fb826b-e891-46c4-990d-ca03cf3f4222 => generated 1749 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 24 05:06:27.157778 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-94a1e7fc-d54f-4821-a51c-7f39af902a29 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Calling method '>' {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:06:27.158459 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.compute.api [None req-94a1e7fc-d54f-4821-a51c-7f39af902a29 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] [instance: b2daebb8-dfea-4ab9-8253-008a21f906e1] Fetching instance by UUID {{(pid=120593) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:06:27.165059 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-94a1e7fc-d54f-4821-a51c-7f39af902a29 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:06:27.165546 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-94a1e7fc-d54f-4821-a51c-7f39af902a29 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:06:27.165979 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-94a1e7fc-d54f-4821-a51c-7f39af902a29 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:06:27.166787 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-94a1e7fc-d54f-4821-a51c-7f39af902a29 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:06:27.167236 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-94a1e7fc-d54f-4821-a51c-7f39af902a29 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:06:27.167656 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-94a1e7fc-d54f-4821-a51c-7f39af902a29 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:06:27.303962 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-94a1e7fc-d54f-4821-a51c-7f39af902a29 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b1b0448e7f54e3aaae49e411699269e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66ec8bde739145dda504995dbea0914a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:06:27.313124 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-94a1e7fc-d54f-4821-a51c-7f39af902a29 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] 10.222.0.50 "GET /compute/v2.1/servers/b2daebb8-dfea-4ab9-8253-008a21f906e1" status: 200 len: 1724 microversion: 2.1 time: 0.159162 Sep 24 05:06:27.313920 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 308/642] 10.222.0.50 () {58 vars in 1236 bytes} [Sat Sep 24 05:06:27 2022] GET /compute/v2.1/servers/b2daebb8-dfea-4ab9-8253-008a21f906e1 => generated 1724 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 05:06:27.555609 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-573dcb32-7769-4c95-b8fb-626d9db26f12 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Calling method '>' {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:06:27.556360 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.compute.api [None req-573dcb32-7769-4c95-b8fb-626d9db26f12 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] [instance: 34b2ef46-4969-469b-adcd-22abf7c4d6df] Fetching instance by UUID {{(pid=120594) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:06:27.563811 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-573dcb32-7769-4c95-b8fb-626d9db26f12 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:06:27.564303 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-573dcb32-7769-4c95-b8fb-626d9db26f12 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:06:27.564862 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-573dcb32-7769-4c95-b8fb-626d9db26f12 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:06:27.565772 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-573dcb32-7769-4c95-b8fb-626d9db26f12 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:06:27.566300 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-573dcb32-7769-4c95-b8fb-626d9db26f12 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:06:27.566734 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-573dcb32-7769-4c95-b8fb-626d9db26f12 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:06:27.703342 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.policy [None req-573dcb32-7769-4c95-b8fb-626d9db26f12 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74a8cc19ab204424ab23c62915ac2bab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87d5229e39fe4817b5187068d8acecc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:06:27.712080 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [None req-573dcb32-7769-4c95-b8fb-626d9db26f12 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] 10.222.0.50 "GET /compute/v2.1/servers/34b2ef46-4969-469b-adcd-22abf7c4d6df" status: 200 len: 1366 microversion: 2.1 time: 0.161728 Sep 24 05:06:27.712635 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 335/643] 10.222.0.50 () {58 vars in 1236 bytes} [Sat Sep 24 05:06:27 2022] GET /compute/v2.1/servers/34b2ef46-4969-469b-adcd-22abf7c4d6df => generated 1366 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 05:06:27.800944 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-cda5f57f-e4d8-4752-82de-17ede8a7813e tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Calling method '>' {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:06:27.801681 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.compute.api [None req-cda5f57f-e4d8-4752-82de-17ede8a7813e tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] [instance: 08fb826b-e891-46c4-990d-ca03cf3f4222] Fetching instance by UUID {{(pid=120593) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:06:27.808980 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-cda5f57f-e4d8-4752-82de-17ede8a7813e tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:06:27.809389 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-cda5f57f-e4d8-4752-82de-17ede8a7813e tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:06:27.809817 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-cda5f57f-e4d8-4752-82de-17ede8a7813e tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:06:27.810538 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-cda5f57f-e4d8-4752-82de-17ede8a7813e tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:06:27.810982 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-cda5f57f-e4d8-4752-82de-17ede8a7813e tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:06:27.811591 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-cda5f57f-e4d8-4752-82de-17ede8a7813e tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:06:27.911905 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [req-68d30f27-2609-454c-bdc0-bfdb03ae24c3 req-3fca5248-2b40-42b4-ba43-b43472a328b7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "34b2ef46-4969-469b-adcd-22abf7c4d6df", "name": "network-vif-plugged", "status": "completed", "tag": "7496c434-3138-4ef6-8254-ee2787a76407"}]} {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 05:06:27.935612 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [req-68d30f27-2609-454c-bdc0-bfdb03ae24c3 req-3fca5248-2b40-42b4-ba43-b43472a328b7 service nova] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:06:27.937778 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [req-68d30f27-2609-454c-bdc0-bfdb03ae24c3 req-3fca5248-2b40-42b4-ba43-b43472a328b7 service nova] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:06:27.938523 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [req-68d30f27-2609-454c-bdc0-bfdb03ae24c3 req-3fca5248-2b40-42b4-ba43-b43472a328b7 service nova] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:06:27.954932 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-cda5f57f-e4d8-4752-82de-17ede8a7813e tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0948754217fc4ff2ba0241fa35feaf90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1aaf20f480a423ea5feca81585aeeed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:06:27.955343 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: INFO nova.api.openstack.compute.server_external_events [req-68d30f27-2609-454c-bdc0-bfdb03ae24c3 req-3fca5248-2b40-42b4-ba43-b43472a328b7 service nova] Creating event network-vif-plugged:7496c434-3138-4ef6-8254-ee2787a76407 for instance 34b2ef46-4969-469b-adcd-22abf7c4d6df on hv-cinder-85918 Sep 24 05:06:27.961593 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [req-68d30f27-2609-454c-bdc0-bfdb03ae24c3 req-3fca5248-2b40-42b4-ba43-b43472a328b7 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054243 Sep 24 05:06:27.962593 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 336/644] 10.222.0.50 () {64 vars in 1317 bytes} [Sat Sep 24 05:06:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 05:06:27.968198 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-cda5f57f-e4d8-4752-82de-17ede8a7813e tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0948754217fc4ff2ba0241fa35feaf90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1aaf20f480a423ea5feca81585aeeed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:06:27.969625 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-cda5f57f-e4d8-4752-82de-17ede8a7813e tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0948754217fc4ff2ba0241fa35feaf90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1aaf20f480a423ea5feca81585aeeed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:06:27.970792 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-cda5f57f-e4d8-4752-82de-17ede8a7813e tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] 10.222.0.50 "GET /compute/v2.1/servers/08fb826b-e891-46c4-990d-ca03cf3f4222" status: 200 len: 1749 microversion: 2.20 time: 0.173760 Sep 24 05:06:27.973828 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 309/645] 10.222.0.50 () {60 vars in 1277 bytes} [Sat Sep 24 05:06:27 2022] GET /compute/v2.1/servers/08fb826b-e891-46c4-990d-ca03cf3f4222 => generated 1749 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 05:06:28.336921 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-dda6abed-fec5-451b-853e-d857dbbc58cd tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Calling method '>' {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:06:28.337548 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.compute.api [None req-dda6abed-fec5-451b-853e-d857dbbc58cd tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] [instance: b2daebb8-dfea-4ab9-8253-008a21f906e1] Fetching instance by UUID {{(pid=120594) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:06:28.343849 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-dda6abed-fec5-451b-853e-d857dbbc58cd tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:06:28.344327 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-dda6abed-fec5-451b-853e-d857dbbc58cd tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:06:28.344755 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-dda6abed-fec5-451b-853e-d857dbbc58cd tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:06:28.345434 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-dda6abed-fec5-451b-853e-d857dbbc58cd tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:06:28.345881 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-dda6abed-fec5-451b-853e-d857dbbc58cd tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:06:28.346333 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-dda6abed-fec5-451b-853e-d857dbbc58cd tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:06:28.391178 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG dbcounter [-] [120594] Writing DB stats nova_cell0:SELECT=2 {{(pid=120594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 05:06:28.475711 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.policy [None req-dda6abed-fec5-451b-853e-d857dbbc58cd tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b1b0448e7f54e3aaae49e411699269e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66ec8bde739145dda504995dbea0914a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:06:28.483840 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [None req-dda6abed-fec5-451b-853e-d857dbbc58cd tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] 10.222.0.50 "GET /compute/v2.1/servers/b2daebb8-dfea-4ab9-8253-008a21f906e1" status: 200 len: 1724 microversion: 2.1 time: 0.151133 Sep 24 05:06:28.484388 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 337/646] 10.222.0.50 () {58 vars in 1236 bytes} [Sat Sep 24 05:06:28 2022] GET /compute/v2.1/servers/b2daebb8-dfea-4ab9-8253-008a21f906e1 => generated 1724 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 05:06:28.735929 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-72c3fddb-7cfd-4c79-9949-e9012c1a8c25 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Calling method '>' {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:06:28.736533 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.compute.api [None req-72c3fddb-7cfd-4c79-9949-e9012c1a8c25 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] [instance: 34b2ef46-4969-469b-adcd-22abf7c4d6df] Fetching instance by UUID {{(pid=120593) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:06:28.738561 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG dbcounter [-] [120593] Writing DB stats nova_cell0:SELECT=2 {{(pid=120593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 05:06:28.739212 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG dbcounter [-] [120593] Writing DB stats nova_cell0:SELECT=10 {{(pid=120593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 05:06:28.745506 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-72c3fddb-7cfd-4c79-9949-e9012c1a8c25 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:06:28.745983 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-72c3fddb-7cfd-4c79-9949-e9012c1a8c25 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:06:28.746441 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-72c3fddb-7cfd-4c79-9949-e9012c1a8c25 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:06:28.747123 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-72c3fddb-7cfd-4c79-9949-e9012c1a8c25 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:06:28.747570 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-72c3fddb-7cfd-4c79-9949-e9012c1a8c25 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:06:28.747988 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-72c3fddb-7cfd-4c79-9949-e9012c1a8c25 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:06:28.871366 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-72c3fddb-7cfd-4c79-9949-e9012c1a8c25 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74a8cc19ab204424ab23c62915ac2bab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87d5229e39fe4817b5187068d8acecc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:06:28.878897 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-72c3fddb-7cfd-4c79-9949-e9012c1a8c25 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] 10.222.0.50 "GET /compute/v2.1/servers/34b2ef46-4969-469b-adcd-22abf7c4d6df" status: 200 len: 1366 microversion: 2.1 time: 0.146811 Sep 24 05:06:28.879477 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 310/647] 10.222.0.50 () {58 vars in 1236 bytes} [Sat Sep 24 05:06:28 2022] GET /compute/v2.1/servers/34b2ef46-4969-469b-adcd-22abf7c4d6df => generated 1366 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 05:06:28.999253 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-5ef836e2-627d-4214-981a-2b4b53461e5f tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Calling method '>' {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:06:28.999858 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.compute.api [None req-5ef836e2-627d-4214-981a-2b4b53461e5f tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] [instance: 08fb826b-e891-46c4-990d-ca03cf3f4222] Fetching instance by UUID {{(pid=120594) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:06:29.006231 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-5ef836e2-627d-4214-981a-2b4b53461e5f tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:06:29.006711 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-5ef836e2-627d-4214-981a-2b4b53461e5f tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:06:29.007353 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-5ef836e2-627d-4214-981a-2b4b53461e5f tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:06:29.008043 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-5ef836e2-627d-4214-981a-2b4b53461e5f tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:06:29.008494 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-5ef836e2-627d-4214-981a-2b4b53461e5f tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:06:29.008917 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-5ef836e2-627d-4214-981a-2b4b53461e5f tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:06:29.135588 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.policy [None req-5ef836e2-627d-4214-981a-2b4b53461e5f tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0948754217fc4ff2ba0241fa35feaf90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1aaf20f480a423ea5feca81585aeeed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:06:29.144099 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.policy [None req-5ef836e2-627d-4214-981a-2b4b53461e5f tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0948754217fc4ff2ba0241fa35feaf90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1aaf20f480a423ea5feca81585aeeed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:06:29.145528 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.policy [None req-5ef836e2-627d-4214-981a-2b4b53461e5f tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0948754217fc4ff2ba0241fa35feaf90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1aaf20f480a423ea5feca81585aeeed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:06:29.146704 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [None req-5ef836e2-627d-4214-981a-2b4b53461e5f tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] 10.222.0.50 "GET /compute/v2.1/servers/08fb826b-e891-46c4-990d-ca03cf3f4222" status: 200 len: 1805 microversion: 2.20 time: 0.151354 Sep 24 05:06:29.147287 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 338/648] 10.222.0.50 () {60 vars in 1277 bytes} [Sat Sep 24 05:06:28 2022] GET /compute/v2.1/servers/08fb826b-e891-46c4-990d-ca03cf3f4222 => generated 1805 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 05:06:29.506949 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-1b75d3ea-7f4c-421f-8307-e55c1a2b77e0 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Calling method '>' {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:06:29.507578 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.compute.api [None req-1b75d3ea-7f4c-421f-8307-e55c1a2b77e0 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] [instance: b2daebb8-dfea-4ab9-8253-008a21f906e1] Fetching instance by UUID {{(pid=120593) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:06:29.513462 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-1b75d3ea-7f4c-421f-8307-e55c1a2b77e0 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:06:29.513939 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-1b75d3ea-7f4c-421f-8307-e55c1a2b77e0 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:06:29.514404 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-1b75d3ea-7f4c-421f-8307-e55c1a2b77e0 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:06:29.515088 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-1b75d3ea-7f4c-421f-8307-e55c1a2b77e0 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:06:29.515533 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-1b75d3ea-7f4c-421f-8307-e55c1a2b77e0 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:06:29.515953 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-1b75d3ea-7f4c-421f-8307-e55c1a2b77e0 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:06:29.645988 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-1b75d3ea-7f4c-421f-8307-e55c1a2b77e0 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b1b0448e7f54e3aaae49e411699269e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66ec8bde739145dda504995dbea0914a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:06:29.654825 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-1b75d3ea-7f4c-421f-8307-e55c1a2b77e0 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] 10.222.0.50 "GET /compute/v2.1/servers/b2daebb8-dfea-4ab9-8253-008a21f906e1" status: 200 len: 1724 microversion: 2.1 time: 0.151698 Sep 24 05:06:29.655560 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 311/649] 10.222.0.50 () {58 vars in 1236 bytes} [Sat Sep 24 05:06:29 2022] GET /compute/v2.1/servers/b2daebb8-dfea-4ab9-8253-008a21f906e1 => generated 1724 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 05:06:29.901818 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-261aa72f-8a0c-4d37-9261-60f77ceeef00 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Calling method '>' {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:06:29.902386 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.compute.api [None req-261aa72f-8a0c-4d37-9261-60f77ceeef00 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] [instance: 34b2ef46-4969-469b-adcd-22abf7c4d6df] Fetching instance by UUID {{(pid=120594) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:06:29.908305 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-261aa72f-8a0c-4d37-9261-60f77ceeef00 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:06:29.908783 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-261aa72f-8a0c-4d37-9261-60f77ceeef00 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:06:29.909213 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-261aa72f-8a0c-4d37-9261-60f77ceeef00 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:06:29.909895 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-261aa72f-8a0c-4d37-9261-60f77ceeef00 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:06:29.910368 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-261aa72f-8a0c-4d37-9261-60f77ceeef00 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:06:29.910787 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-261aa72f-8a0c-4d37-9261-60f77ceeef00 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:06:30.037731 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.policy [None req-261aa72f-8a0c-4d37-9261-60f77ceeef00 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74a8cc19ab204424ab23c62915ac2bab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87d5229e39fe4817b5187068d8acecc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:06:30.045900 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [None req-261aa72f-8a0c-4d37-9261-60f77ceeef00 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] 10.222.0.50 "GET /compute/v2.1/servers/34b2ef46-4969-469b-adcd-22abf7c4d6df" status: 200 len: 1366 microversion: 2.1 time: 0.148280 Sep 24 05:06:30.046490 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 339/650] 10.222.0.50 () {58 vars in 1236 bytes} [Sat Sep 24 05:06:29 2022] GET /compute/v2.1/servers/34b2ef46-4969-469b-adcd-22abf7c4d6df => generated 1366 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 05:06:30.173655 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-330ed022-6dea-473f-a0e9-1ea710a692f0 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Calling method '>' {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:06:30.174226 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.compute.api [None req-330ed022-6dea-473f-a0e9-1ea710a692f0 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] [instance: 08fb826b-e891-46c4-990d-ca03cf3f4222] Fetching instance by UUID {{(pid=120593) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:06:30.181150 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-330ed022-6dea-473f-a0e9-1ea710a692f0 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:06:30.181624 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-330ed022-6dea-473f-a0e9-1ea710a692f0 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:06:30.182079 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-330ed022-6dea-473f-a0e9-1ea710a692f0 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:06:30.182764 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-330ed022-6dea-473f-a0e9-1ea710a692f0 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:06:30.183209 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-330ed022-6dea-473f-a0e9-1ea710a692f0 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:06:30.183629 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-330ed022-6dea-473f-a0e9-1ea710a692f0 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:06:30.311665 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-330ed022-6dea-473f-a0e9-1ea710a692f0 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0948754217fc4ff2ba0241fa35feaf90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1aaf20f480a423ea5feca81585aeeed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:06:30.313830 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG dbcounter [-] [120593] Writing DB stats nova_cell1:SELECT=100 {{(pid=120593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 05:06:30.322142 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-330ed022-6dea-473f-a0e9-1ea710a692f0 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0948754217fc4ff2ba0241fa35feaf90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1aaf20f480a423ea5feca81585aeeed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:06:30.323567 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-330ed022-6dea-473f-a0e9-1ea710a692f0 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0948754217fc4ff2ba0241fa35feaf90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1aaf20f480a423ea5feca81585aeeed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:06:30.324720 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-330ed022-6dea-473f-a0e9-1ea710a692f0 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] 10.222.0.50 "GET /compute/v2.1/servers/08fb826b-e891-46c4-990d-ca03cf3f4222" status: 200 len: 1805 microversion: 2.20 time: 0.155046 Sep 24 05:06:30.325269 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 312/651] 10.222.0.50 () {60 vars in 1277 bytes} [Sat Sep 24 05:06:30 2022] GET /compute/v2.1/servers/08fb826b-e891-46c4-990d-ca03cf3f4222 => generated 1805 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 05:06:30.677621 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-50938129-6fd1-45e4-9526-6902ebb20b85 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Calling method '>' {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:06:30.678251 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.compute.api [None req-50938129-6fd1-45e4-9526-6902ebb20b85 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] [instance: b2daebb8-dfea-4ab9-8253-008a21f906e1] Fetching instance by UUID {{(pid=120594) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:06:30.684974 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-50938129-6fd1-45e4-9526-6902ebb20b85 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:06:30.685447 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-50938129-6fd1-45e4-9526-6902ebb20b85 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:06:30.685877 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-50938129-6fd1-45e4-9526-6902ebb20b85 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:06:30.686578 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-50938129-6fd1-45e4-9526-6902ebb20b85 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:06:30.687025 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-50938129-6fd1-45e4-9526-6902ebb20b85 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:06:30.687441 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-50938129-6fd1-45e4-9526-6902ebb20b85 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:06:30.812239 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.policy [None req-50938129-6fd1-45e4-9526-6902ebb20b85 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b1b0448e7f54e3aaae49e411699269e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66ec8bde739145dda504995dbea0914a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:06:30.820914 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [None req-50938129-6fd1-45e4-9526-6902ebb20b85 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] 10.222.0.50 "GET /compute/v2.1/servers/b2daebb8-dfea-4ab9-8253-008a21f906e1" status: 200 len: 1724 microversion: 2.1 time: 0.147104 Sep 24 05:06:30.821477 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 340/652] 10.222.0.50 () {58 vars in 1236 bytes} [Sat Sep 24 05:06:30 2022] GET /compute/v2.1/servers/b2daebb8-dfea-4ab9-8253-008a21f906e1 => generated 1724 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 05:06:31.068695 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-4b519cb2-9d4d-4755-b467-89aefdf37bcd tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Calling method '>' {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:06:31.069224 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.compute.api [None req-4b519cb2-9d4d-4755-b467-89aefdf37bcd tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] [instance: 34b2ef46-4969-469b-adcd-22abf7c4d6df] Fetching instance by UUID {{(pid=120593) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:06:31.075735 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-4b519cb2-9d4d-4755-b467-89aefdf37bcd tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:06:31.076214 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-4b519cb2-9d4d-4755-b467-89aefdf37bcd tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:06:31.076648 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-4b519cb2-9d4d-4755-b467-89aefdf37bcd tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:06:31.077330 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-4b519cb2-9d4d-4755-b467-89aefdf37bcd tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:06:31.077780 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-4b519cb2-9d4d-4755-b467-89aefdf37bcd tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:06:31.078243 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-4b519cb2-9d4d-4755-b467-89aefdf37bcd tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:06:31.208696 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-4b519cb2-9d4d-4755-b467-89aefdf37bcd tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74a8cc19ab204424ab23c62915ac2bab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87d5229e39fe4817b5187068d8acecc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:06:31.216283 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-4b519cb2-9d4d-4755-b467-89aefdf37bcd tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] 10.222.0.50 "GET /compute/v2.1/servers/34b2ef46-4969-469b-adcd-22abf7c4d6df" status: 200 len: 1366 microversion: 2.1 time: 0.151589 Sep 24 05:06:31.216841 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 313/653] 10.222.0.50 () {58 vars in 1236 bytes} [Sat Sep 24 05:06:31 2022] GET /compute/v2.1/servers/34b2ef46-4969-469b-adcd-22abf7c4d6df => generated 1366 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 05:06:31.348694 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-9dfa4cb9-59da-42d9-8587-c0ea2d674d95 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Calling method '>' {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:06:31.349219 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.compute.api [None req-9dfa4cb9-59da-42d9-8587-c0ea2d674d95 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] [instance: 08fb826b-e891-46c4-990d-ca03cf3f4222] Fetching instance by UUID {{(pid=120594) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:06:31.356264 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-9dfa4cb9-59da-42d9-8587-c0ea2d674d95 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:06:31.356739 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-9dfa4cb9-59da-42d9-8587-c0ea2d674d95 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:06:31.357168 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-9dfa4cb9-59da-42d9-8587-c0ea2d674d95 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:06:31.357845 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-9dfa4cb9-59da-42d9-8587-c0ea2d674d95 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:06:31.358318 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-9dfa4cb9-59da-42d9-8587-c0ea2d674d95 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:06:31.358738 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-9dfa4cb9-59da-42d9-8587-c0ea2d674d95 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:06:31.487148 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.policy [None req-9dfa4cb9-59da-42d9-8587-c0ea2d674d95 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0948754217fc4ff2ba0241fa35feaf90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1aaf20f480a423ea5feca81585aeeed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:06:31.495551 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.policy [None req-9dfa4cb9-59da-42d9-8587-c0ea2d674d95 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0948754217fc4ff2ba0241fa35feaf90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1aaf20f480a423ea5feca81585aeeed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:06:31.496981 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.policy [None req-9dfa4cb9-59da-42d9-8587-c0ea2d674d95 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0948754217fc4ff2ba0241fa35feaf90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1aaf20f480a423ea5feca81585aeeed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:06:31.498146 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [None req-9dfa4cb9-59da-42d9-8587-c0ea2d674d95 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] 10.222.0.50 "GET /compute/v2.1/servers/08fb826b-e891-46c4-990d-ca03cf3f4222" status: 200 len: 1805 microversion: 2.20 time: 0.153425 Sep 24 05:06:31.498702 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 341/654] 10.222.0.50 () {60 vars in 1277 bytes} [Sat Sep 24 05:06:31 2022] GET /compute/v2.1/servers/08fb826b-e891-46c4-990d-ca03cf3f4222 => generated 1805 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 05:06:31.843656 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-4ddc1e31-41f1-4540-b757-43660188c3c6 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Calling method '>' {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:06:31.844259 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.compute.api [None req-4ddc1e31-41f1-4540-b757-43660188c3c6 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] [instance: b2daebb8-dfea-4ab9-8253-008a21f906e1] Fetching instance by UUID {{(pid=120593) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:06:31.850113 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-4ddc1e31-41f1-4540-b757-43660188c3c6 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:06:31.850589 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-4ddc1e31-41f1-4540-b757-43660188c3c6 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:06:31.851560 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-4ddc1e31-41f1-4540-b757-43660188c3c6 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:06:31.852236 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-4ddc1e31-41f1-4540-b757-43660188c3c6 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:06:31.852678 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-4ddc1e31-41f1-4540-b757-43660188c3c6 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:06:31.853093 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-4ddc1e31-41f1-4540-b757-43660188c3c6 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:06:31.983332 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-4ddc1e31-41f1-4540-b757-43660188c3c6 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b1b0448e7f54e3aaae49e411699269e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66ec8bde739145dda504995dbea0914a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:06:31.992289 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-4ddc1e31-41f1-4540-b757-43660188c3c6 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] 10.222.0.50 "GET /compute/v2.1/servers/b2daebb8-dfea-4ab9-8253-008a21f906e1" status: 200 len: 1724 microversion: 2.1 time: 0.151978 Sep 24 05:06:31.992849 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 314/655] 10.222.0.50 () {58 vars in 1236 bytes} [Sat Sep 24 05:06:31 2022] GET /compute/v2.1/servers/b2daebb8-dfea-4ab9-8253-008a21f906e1 => generated 1724 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 05:06:32.238494 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-6df3e579-5b2b-476f-a27e-5fee2502bef1 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Calling method '>' {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:06:32.239102 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.compute.api [None req-6df3e579-5b2b-476f-a27e-5fee2502bef1 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] [instance: 34b2ef46-4969-469b-adcd-22abf7c4d6df] Fetching instance by UUID {{(pid=120594) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:06:32.244951 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-6df3e579-5b2b-476f-a27e-5fee2502bef1 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:06:32.245430 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-6df3e579-5b2b-476f-a27e-5fee2502bef1 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:06:32.245888 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-6df3e579-5b2b-476f-a27e-5fee2502bef1 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:06:32.246576 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-6df3e579-5b2b-476f-a27e-5fee2502bef1 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:06:32.247025 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-6df3e579-5b2b-476f-a27e-5fee2502bef1 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:06:32.247442 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-6df3e579-5b2b-476f-a27e-5fee2502bef1 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:06:32.373816 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.policy [None req-6df3e579-5b2b-476f-a27e-5fee2502bef1 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74a8cc19ab204424ab23c62915ac2bab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87d5229e39fe4817b5187068d8acecc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:06:32.381469 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [None req-6df3e579-5b2b-476f-a27e-5fee2502bef1 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] 10.222.0.50 "GET /compute/v2.1/servers/34b2ef46-4969-469b-adcd-22abf7c4d6df" status: 200 len: 1366 microversion: 2.1 time: 0.146859 Sep 24 05:06:32.382059 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 342/656] 10.222.0.50 () {58 vars in 1236 bytes} [Sat Sep 24 05:06:32 2022] GET /compute/v2.1/servers/34b2ef46-4969-469b-adcd-22abf7c4d6df => generated 1366 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 05:06:32.523468 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-936af7bf-42ab-4a6c-b73e-016d31b4d666 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Calling method '>' {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:06:32.524010 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.compute.api [None req-936af7bf-42ab-4a6c-b73e-016d31b4d666 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] [instance: 08fb826b-e891-46c4-990d-ca03cf3f4222] Fetching instance by UUID {{(pid=120593) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:06:32.530638 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-936af7bf-42ab-4a6c-b73e-016d31b4d666 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:06:32.531110 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-936af7bf-42ab-4a6c-b73e-016d31b4d666 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:06:32.531538 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-936af7bf-42ab-4a6c-b73e-016d31b4d666 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:06:32.532217 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-936af7bf-42ab-4a6c-b73e-016d31b4d666 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:06:32.532653 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-936af7bf-42ab-4a6c-b73e-016d31b4d666 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:06:32.533064 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-936af7bf-42ab-4a6c-b73e-016d31b4d666 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:06:32.662757 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-936af7bf-42ab-4a6c-b73e-016d31b4d666 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0948754217fc4ff2ba0241fa35feaf90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1aaf20f480a423ea5feca81585aeeed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:06:32.671573 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-936af7bf-42ab-4a6c-b73e-016d31b4d666 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0948754217fc4ff2ba0241fa35feaf90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1aaf20f480a423ea5feca81585aeeed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:06:32.672997 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-936af7bf-42ab-4a6c-b73e-016d31b4d666 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0948754217fc4ff2ba0241fa35feaf90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1aaf20f480a423ea5feca81585aeeed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:06:32.674178 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-936af7bf-42ab-4a6c-b73e-016d31b4d666 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] 10.222.0.50 "GET /compute/v2.1/servers/08fb826b-e891-46c4-990d-ca03cf3f4222" status: 200 len: 1805 microversion: 2.20 time: 0.155275 Sep 24 05:06:32.679512 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 315/657] 10.222.0.50 () {60 vars in 1277 bytes} [Sat Sep 24 05:06:32 2022] GET /compute/v2.1/servers/08fb826b-e891-46c4-990d-ca03cf3f4222 => generated 1805 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 05:06:33.014301 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-90485284-3541-429c-ab79-0428a07c4513 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Calling method '>' {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:06:33.014909 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.compute.api [None req-90485284-3541-429c-ab79-0428a07c4513 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] [instance: b2daebb8-dfea-4ab9-8253-008a21f906e1] Fetching instance by UUID {{(pid=120594) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:06:33.020807 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-90485284-3541-429c-ab79-0428a07c4513 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:06:33.021313 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-90485284-3541-429c-ab79-0428a07c4513 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:06:33.021751 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-90485284-3541-429c-ab79-0428a07c4513 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:06:33.022611 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-90485284-3541-429c-ab79-0428a07c4513 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:06:33.023093 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-90485284-3541-429c-ab79-0428a07c4513 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:06:33.023516 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-90485284-3541-429c-ab79-0428a07c4513 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:06:33.151448 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.policy [None req-90485284-3541-429c-ab79-0428a07c4513 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b1b0448e7f54e3aaae49e411699269e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66ec8bde739145dda504995dbea0914a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:06:33.159605 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [None req-90485284-3541-429c-ab79-0428a07c4513 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] 10.222.0.50 "GET /compute/v2.1/servers/b2daebb8-dfea-4ab9-8253-008a21f906e1" status: 200 len: 1724 microversion: 2.1 time: 0.149179 Sep 24 05:06:33.160165 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 343/658] 10.222.0.50 () {58 vars in 1236 bytes} [Sat Sep 24 05:06:33 2022] GET /compute/v2.1/servers/b2daebb8-dfea-4ab9-8253-008a21f906e1 => generated 1724 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 05:06:33.404918 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-9354fa51-b818-43b9-982b-3cfc2518dab1 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Calling method '>' {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:06:33.405443 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.compute.api [None req-9354fa51-b818-43b9-982b-3cfc2518dab1 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] [instance: 34b2ef46-4969-469b-adcd-22abf7c4d6df] Fetching instance by UUID {{(pid=120593) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:06:33.411359 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-9354fa51-b818-43b9-982b-3cfc2518dab1 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:06:33.411835 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-9354fa51-b818-43b9-982b-3cfc2518dab1 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:06:33.412269 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-9354fa51-b818-43b9-982b-3cfc2518dab1 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:06:33.412949 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-9354fa51-b818-43b9-982b-3cfc2518dab1 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:06:33.413896 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-9354fa51-b818-43b9-982b-3cfc2518dab1 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:06:33.414348 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-9354fa51-b818-43b9-982b-3cfc2518dab1 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:06:33.545718 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-9354fa51-b818-43b9-982b-3cfc2518dab1 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74a8cc19ab204424ab23c62915ac2bab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87d5229e39fe4817b5187068d8acecc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:06:33.553560 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-9354fa51-b818-43b9-982b-3cfc2518dab1 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] 10.222.0.50 "GET /compute/v2.1/servers/34b2ef46-4969-469b-adcd-22abf7c4d6df" status: 200 len: 1366 microversion: 2.1 time: 0.152334 Sep 24 05:06:33.554274 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 316/659] 10.222.0.50 () {58 vars in 1236 bytes} [Sat Sep 24 05:06:33 2022] GET /compute/v2.1/servers/34b2ef46-4969-469b-adcd-22abf7c4d6df => generated 1366 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 05:06:33.699580 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-69f7a9ef-a4ab-4965-ba9b-559f23611019 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Calling method '>' {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:06:33.700178 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.compute.api [None req-69f7a9ef-a4ab-4965-ba9b-559f23611019 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] [instance: 08fb826b-e891-46c4-990d-ca03cf3f4222] Fetching instance by UUID {{(pid=120594) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:06:33.706302 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-69f7a9ef-a4ab-4965-ba9b-559f23611019 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:06:33.706779 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-69f7a9ef-a4ab-4965-ba9b-559f23611019 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:06:33.707215 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-69f7a9ef-a4ab-4965-ba9b-559f23611019 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:06:33.708038 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-69f7a9ef-a4ab-4965-ba9b-559f23611019 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:06:33.708529 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-69f7a9ef-a4ab-4965-ba9b-559f23611019 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:06:33.708948 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-69f7a9ef-a4ab-4965-ba9b-559f23611019 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:06:33.838667 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.policy [None req-69f7a9ef-a4ab-4965-ba9b-559f23611019 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0948754217fc4ff2ba0241fa35feaf90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1aaf20f480a423ea5feca81585aeeed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:06:33.853208 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.policy [None req-69f7a9ef-a4ab-4965-ba9b-559f23611019 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0948754217fc4ff2ba0241fa35feaf90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1aaf20f480a423ea5feca81585aeeed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:06:33.853208 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.policy [None req-69f7a9ef-a4ab-4965-ba9b-559f23611019 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0948754217fc4ff2ba0241fa35feaf90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1aaf20f480a423ea5feca81585aeeed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:06:33.853208 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [None req-69f7a9ef-a4ab-4965-ba9b-559f23611019 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] 10.222.0.50 "GET /compute/v2.1/servers/08fb826b-e891-46c4-990d-ca03cf3f4222" status: 200 len: 1805 microversion: 2.20 time: 0.154473 Sep 24 05:06:33.853492 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 344/660] 10.222.0.50 () {60 vars in 1277 bytes} [Sat Sep 24 05:06:33 2022] GET /compute/v2.1/servers/08fb826b-e891-46c4-990d-ca03cf3f4222 => generated 1805 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 05:06:34.182770 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-966fd619-396e-4af6-a70d-8716538de5b2 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Calling method '>' {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:06:34.183388 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.compute.api [None req-966fd619-396e-4af6-a70d-8716538de5b2 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] [instance: b2daebb8-dfea-4ab9-8253-008a21f906e1] Fetching instance by UUID {{(pid=120593) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:06:34.189212 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-966fd619-396e-4af6-a70d-8716538de5b2 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:06:34.189694 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-966fd619-396e-4af6-a70d-8716538de5b2 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:06:34.190172 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-966fd619-396e-4af6-a70d-8716538de5b2 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:06:34.190861 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-966fd619-396e-4af6-a70d-8716538de5b2 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:06:34.191311 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-966fd619-396e-4af6-a70d-8716538de5b2 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:06:34.191733 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-966fd619-396e-4af6-a70d-8716538de5b2 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:06:34.326778 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-966fd619-396e-4af6-a70d-8716538de5b2 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b1b0448e7f54e3aaae49e411699269e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66ec8bde739145dda504995dbea0914a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:06:34.334914 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-966fd619-396e-4af6-a70d-8716538de5b2 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] 10.222.0.50 "GET /compute/v2.1/servers/b2daebb8-dfea-4ab9-8253-008a21f906e1" status: 200 len: 1724 microversion: 2.1 time: 0.156031 Sep 24 05:06:34.335986 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 317/661] 10.222.0.50 () {58 vars in 1236 bytes} [Sat Sep 24 05:06:34 2022] GET /compute/v2.1/servers/b2daebb8-dfea-4ab9-8253-008a21f906e1 => generated 1724 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 24 05:06:34.577416 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-5071a486-1cca-49ba-b340-88aa8d22de95 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Calling method '>' {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:06:34.578072 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.compute.api [None req-5071a486-1cca-49ba-b340-88aa8d22de95 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] [instance: 34b2ef46-4969-469b-adcd-22abf7c4d6df] Fetching instance by UUID {{(pid=120594) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:06:34.584048 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-5071a486-1cca-49ba-b340-88aa8d22de95 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:06:34.584527 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-5071a486-1cca-49ba-b340-88aa8d22de95 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:06:34.584959 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-5071a486-1cca-49ba-b340-88aa8d22de95 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:06:34.585644 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-5071a486-1cca-49ba-b340-88aa8d22de95 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:06:34.586189 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-5071a486-1cca-49ba-b340-88aa8d22de95 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:06:34.586617 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-5071a486-1cca-49ba-b340-88aa8d22de95 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:06:34.712227 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.policy [None req-5071a486-1cca-49ba-b340-88aa8d22de95 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74a8cc19ab204424ab23c62915ac2bab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87d5229e39fe4817b5187068d8acecc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:06:34.719859 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [None req-5071a486-1cca-49ba-b340-88aa8d22de95 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] 10.222.0.50 "GET /compute/v2.1/servers/34b2ef46-4969-469b-adcd-22abf7c4d6df" status: 200 len: 1366 microversion: 2.1 time: 0.146282 Sep 24 05:06:34.720397 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 345/662] 10.222.0.50 () {58 vars in 1236 bytes} [Sat Sep 24 05:06:34 2022] GET /compute/v2.1/servers/34b2ef46-4969-469b-adcd-22abf7c4d6df => generated 1366 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 05:06:34.876597 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-204a6fff-38e9-4979-97dd-5082fe14e293 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Calling method '>' {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:06:34.877205 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.compute.api [None req-204a6fff-38e9-4979-97dd-5082fe14e293 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] [instance: 08fb826b-e891-46c4-990d-ca03cf3f4222] Fetching instance by UUID {{(pid=120593) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:06:34.883721 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-204a6fff-38e9-4979-97dd-5082fe14e293 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:06:34.884203 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-204a6fff-38e9-4979-97dd-5082fe14e293 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:06:34.884669 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-204a6fff-38e9-4979-97dd-5082fe14e293 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:06:34.885487 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-204a6fff-38e9-4979-97dd-5082fe14e293 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:06:34.885878 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-204a6fff-38e9-4979-97dd-5082fe14e293 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:06:34.886351 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-204a6fff-38e9-4979-97dd-5082fe14e293 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:06:35.016658 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-204a6fff-38e9-4979-97dd-5082fe14e293 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0948754217fc4ff2ba0241fa35feaf90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1aaf20f480a423ea5feca81585aeeed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:06:35.025426 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-204a6fff-38e9-4979-97dd-5082fe14e293 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0948754217fc4ff2ba0241fa35feaf90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1aaf20f480a423ea5feca81585aeeed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:06:35.026895 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-204a6fff-38e9-4979-97dd-5082fe14e293 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0948754217fc4ff2ba0241fa35feaf90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1aaf20f480a423ea5feca81585aeeed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:06:35.028041 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-204a6fff-38e9-4979-97dd-5082fe14e293 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] 10.222.0.50 "GET /compute/v2.1/servers/08fb826b-e891-46c4-990d-ca03cf3f4222" status: 200 len: 1805 microversion: 2.20 time: 0.155393 Sep 24 05:06:35.028603 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 318/663] 10.222.0.50 () {60 vars in 1277 bytes} [Sat Sep 24 05:06:34 2022] GET /compute/v2.1/servers/08fb826b-e891-46c4-990d-ca03cf3f4222 => generated 1805 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 05:06:35.358385 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-ed1032bc-4308-40b8-8fe8-b33232204675 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Calling method '>' {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:06:35.358916 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.compute.api [None req-ed1032bc-4308-40b8-8fe8-b33232204675 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] [instance: b2daebb8-dfea-4ab9-8253-008a21f906e1] Fetching instance by UUID {{(pid=120594) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:06:35.364822 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-ed1032bc-4308-40b8-8fe8-b33232204675 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:06:35.365297 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-ed1032bc-4308-40b8-8fe8-b33232204675 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:06:35.365730 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-ed1032bc-4308-40b8-8fe8-b33232204675 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:06:35.366441 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-ed1032bc-4308-40b8-8fe8-b33232204675 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:06:35.366891 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-ed1032bc-4308-40b8-8fe8-b33232204675 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:06:35.367312 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-ed1032bc-4308-40b8-8fe8-b33232204675 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:06:35.491800 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.policy [None req-ed1032bc-4308-40b8-8fe8-b33232204675 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b1b0448e7f54e3aaae49e411699269e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66ec8bde739145dda504995dbea0914a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:06:35.499766 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [None req-ed1032bc-4308-40b8-8fe8-b33232204675 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] 10.222.0.50 "GET /compute/v2.1/servers/b2daebb8-dfea-4ab9-8253-008a21f906e1" status: 200 len: 1701 microversion: 2.1 time: 0.145305 Sep 24 05:06:35.500329 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 346/664] 10.222.0.50 () {58 vars in 1236 bytes} [Sat Sep 24 05:06:35 2022] GET /compute/v2.1/servers/b2daebb8-dfea-4ab9-8253-008a21f906e1 => generated 1701 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 05:06:35.521877 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-82c20a39-3b82-4648-932c-bc2d4e27a030 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 05:06:35.524404 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG dbcounter [-] [120593] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=4 {{(pid=120593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 05:06:35.530564 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-82c20a39-3b82-4648-932c-bc2d4e27a030 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:06:35.531036 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-82c20a39-3b82-4648-932c-bc2d4e27a030 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:06:35.531465 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-82c20a39-3b82-4648-932c-bc2d4e27a030 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:06:35.553179 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.compute.api [None req-82c20a39-3b82-4648-932c-bc2d4e27a030 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] [instance: b2daebb8-dfea-4ab9-8253-008a21f906e1] Going to try to start instance {{(pid=120593) start /opt/stack/nova/nova/compute/api.py:2785}} Sep 24 05:06:35.594604 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-82c20a39-3b82-4648-932c-bc2d4e27a030 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] 10.222.0.50 "POST /compute/v2.1/servers/b2daebb8-dfea-4ab9-8253-008a21f906e1/action" status: 202 len: 0 microversion: 2.1 time: 0.076319 Sep 24 05:06:35.595182 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 319/665] 10.222.0.50 () {60 vars in 1278 bytes} [Sat Sep 24 05:06:35 2022] POST /compute/v2.1/servers/b2daebb8-dfea-4ab9-8253-008a21f906e1/action => generated 0 bytes in 78 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 24 05:06:35.603208 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-712ac821-6961-40c4-8ab2-3efd2f502342 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Calling method '>' {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:06:35.603810 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.compute.api [None req-712ac821-6961-40c4-8ab2-3efd2f502342 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] [instance: b2daebb8-dfea-4ab9-8253-008a21f906e1] Fetching instance by UUID {{(pid=120594) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:06:35.609621 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-712ac821-6961-40c4-8ab2-3efd2f502342 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:06:35.610066 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-712ac821-6961-40c4-8ab2-3efd2f502342 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:06:35.610499 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-712ac821-6961-40c4-8ab2-3efd2f502342 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:06:35.611176 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-712ac821-6961-40c4-8ab2-3efd2f502342 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:06:35.611617 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-712ac821-6961-40c4-8ab2-3efd2f502342 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:06:35.612036 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-712ac821-6961-40c4-8ab2-3efd2f502342 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:06:35.737224 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.policy [None req-712ac821-6961-40c4-8ab2-3efd2f502342 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b1b0448e7f54e3aaae49e411699269e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66ec8bde739145dda504995dbea0914a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:06:35.743850 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-fd7bc880-9859-47cb-8594-e6c24f2fe568 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Calling method '>' {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:06:35.744545 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.compute.api [None req-fd7bc880-9859-47cb-8594-e6c24f2fe568 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] [instance: 34b2ef46-4969-469b-adcd-22abf7c4d6df] Fetching instance by UUID {{(pid=120593) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:06:35.746366 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [None req-712ac821-6961-40c4-8ab2-3efd2f502342 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] 10.222.0.50 "GET /compute/v2.1/servers/b2daebb8-dfea-4ab9-8253-008a21f906e1" status: 200 len: 1710 microversion: 2.1 time: 0.146900 Sep 24 05:06:35.746931 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 347/666] 10.222.0.50 () {58 vars in 1236 bytes} [Sat Sep 24 05:06:35 2022] GET /compute/v2.1/servers/b2daebb8-dfea-4ab9-8253-008a21f906e1 => generated 1710 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 05:06:35.756966 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-fd7bc880-9859-47cb-8594-e6c24f2fe568 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:06:35.756966 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-fd7bc880-9859-47cb-8594-e6c24f2fe568 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:06:35.756966 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-fd7bc880-9859-47cb-8594-e6c24f2fe568 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:06:35.756966 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-fd7bc880-9859-47cb-8594-e6c24f2fe568 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:06:35.757344 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-fd7bc880-9859-47cb-8594-e6c24f2fe568 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:06:35.757344 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-fd7bc880-9859-47cb-8594-e6c24f2fe568 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:06:35.882214 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-fd7bc880-9859-47cb-8594-e6c24f2fe568 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74a8cc19ab204424ab23c62915ac2bab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87d5229e39fe4817b5187068d8acecc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:06:35.893186 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-fd7bc880-9859-47cb-8594-e6c24f2fe568 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] 10.222.0.50 "GET /compute/v2.1/servers/34b2ef46-4969-469b-adcd-22abf7c4d6df" status: 200 len: 1366 microversion: 2.1 time: 0.153980 Sep 24 05:06:35.893754 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 320/667] 10.222.0.50 () {58 vars in 1236 bytes} [Sat Sep 24 05:06:35 2022] GET /compute/v2.1/servers/34b2ef46-4969-469b-adcd-22abf7c4d6df => generated 1366 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 24 05:06:36.052484 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-2007667f-abdb-4fec-8808-70310cd1df59 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Calling method '>' {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:06:36.053082 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.compute.api [None req-2007667f-abdb-4fec-8808-70310cd1df59 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] [instance: 08fb826b-e891-46c4-990d-ca03cf3f4222] Fetching instance by UUID {{(pid=120594) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:06:36.059451 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-2007667f-abdb-4fec-8808-70310cd1df59 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:06:36.059925 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-2007667f-abdb-4fec-8808-70310cd1df59 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:06:36.060352 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-2007667f-abdb-4fec-8808-70310cd1df59 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:06:36.061028 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-2007667f-abdb-4fec-8808-70310cd1df59 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:06:36.061477 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-2007667f-abdb-4fec-8808-70310cd1df59 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:06:36.061904 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-2007667f-abdb-4fec-8808-70310cd1df59 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:06:36.191970 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.policy [None req-2007667f-abdb-4fec-8808-70310cd1df59 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0948754217fc4ff2ba0241fa35feaf90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1aaf20f480a423ea5feca81585aeeed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:06:36.200416 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.policy [None req-2007667f-abdb-4fec-8808-70310cd1df59 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0948754217fc4ff2ba0241fa35feaf90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1aaf20f480a423ea5feca81585aeeed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:06:36.201841 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.policy [None req-2007667f-abdb-4fec-8808-70310cd1df59 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0948754217fc4ff2ba0241fa35feaf90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1aaf20f480a423ea5feca81585aeeed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:06:36.203010 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [None req-2007667f-abdb-4fec-8808-70310cd1df59 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] 10.222.0.50 "GET /compute/v2.1/servers/08fb826b-e891-46c4-990d-ca03cf3f4222" status: 200 len: 1805 microversion: 2.20 time: 0.154418 Sep 24 05:06:36.203559 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 348/668] 10.222.0.50 () {60 vars in 1277 bytes} [Sat Sep 24 05:06:36 2022] GET /compute/v2.1/servers/08fb826b-e891-46c4-990d-ca03cf3f4222 => generated 1805 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 05:06:36.768665 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-204e9168-e73e-4104-9c0a-76f05620204c tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Calling method '>' {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:06:36.769198 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.compute.api [None req-204e9168-e73e-4104-9c0a-76f05620204c tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] [instance: b2daebb8-dfea-4ab9-8253-008a21f906e1] Fetching instance by UUID {{(pid=120593) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:06:36.775941 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-204e9168-e73e-4104-9c0a-76f05620204c tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:06:36.776424 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-204e9168-e73e-4104-9c0a-76f05620204c tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:06:36.776863 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-204e9168-e73e-4104-9c0a-76f05620204c tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:06:36.777544 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-204e9168-e73e-4104-9c0a-76f05620204c tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:06:36.778011 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-204e9168-e73e-4104-9c0a-76f05620204c tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:06:36.778445 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-204e9168-e73e-4104-9c0a-76f05620204c tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:06:36.907076 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-204e9168-e73e-4104-9c0a-76f05620204c tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b1b0448e7f54e3aaae49e411699269e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66ec8bde739145dda504995dbea0914a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:06:36.915332 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-204e9168-e73e-4104-9c0a-76f05620204c tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] 10.222.0.50 "GET /compute/v2.1/servers/b2daebb8-dfea-4ab9-8253-008a21f906e1" status: 200 len: 1710 microversion: 2.1 time: 0.150589 Sep 24 05:06:36.915897 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 321/669] 10.222.0.50 () {58 vars in 1236 bytes} [Sat Sep 24 05:06:36 2022] GET /compute/v2.1/servers/b2daebb8-dfea-4ab9-8253-008a21f906e1 => generated 1710 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 05:06:36.916391 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-0dde4442-2605-42e3-8156-d1b10519f6e7 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Calling method '>' {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:06:36.916995 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.compute.api [None req-0dde4442-2605-42e3-8156-d1b10519f6e7 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] [instance: 34b2ef46-4969-469b-adcd-22abf7c4d6df] Fetching instance by UUID {{(pid=120594) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:06:36.923347 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-0dde4442-2605-42e3-8156-d1b10519f6e7 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:06:36.923811 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-0dde4442-2605-42e3-8156-d1b10519f6e7 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:06:36.924235 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-0dde4442-2605-42e3-8156-d1b10519f6e7 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:06:36.924911 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-0dde4442-2605-42e3-8156-d1b10519f6e7 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:06:36.925351 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-0dde4442-2605-42e3-8156-d1b10519f6e7 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:06:36.925765 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-0dde4442-2605-42e3-8156-d1b10519f6e7 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:06:37.051727 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.policy [None req-0dde4442-2605-42e3-8156-d1b10519f6e7 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74a8cc19ab204424ab23c62915ac2bab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87d5229e39fe4817b5187068d8acecc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:06:37.060186 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [None req-0dde4442-2605-42e3-8156-d1b10519f6e7 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] 10.222.0.50 "GET /compute/v2.1/servers/34b2ef46-4969-469b-adcd-22abf7c4d6df" status: 200 len: 1366 microversion: 2.1 time: 0.147659 Sep 24 05:06:37.060754 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 349/670] 10.222.0.50 () {58 vars in 1236 bytes} [Sat Sep 24 05:06:36 2022] GET /compute/v2.1/servers/34b2ef46-4969-469b-adcd-22abf7c4d6df => generated 1366 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 24 05:06:37.227342 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-64f38d63-532b-4f0d-845e-4a8310722e0d tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Calling method '>' {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:06:37.227947 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.compute.api [None req-64f38d63-532b-4f0d-845e-4a8310722e0d tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] [instance: 08fb826b-e891-46c4-990d-ca03cf3f4222] Fetching instance by UUID {{(pid=120593) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:06:37.234147 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-64f38d63-532b-4f0d-845e-4a8310722e0d tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:06:37.234684 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-64f38d63-532b-4f0d-845e-4a8310722e0d tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:06:37.235198 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-64f38d63-532b-4f0d-845e-4a8310722e0d tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:06:37.235895 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-64f38d63-532b-4f0d-845e-4a8310722e0d tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:06:37.236348 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-64f38d63-532b-4f0d-845e-4a8310722e0d tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:06:37.236821 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-64f38d63-532b-4f0d-845e-4a8310722e0d tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:06:37.368627 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-64f38d63-532b-4f0d-845e-4a8310722e0d tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0948754217fc4ff2ba0241fa35feaf90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1aaf20f480a423ea5feca81585aeeed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:06:37.377040 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-64f38d63-532b-4f0d-845e-4a8310722e0d tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0948754217fc4ff2ba0241fa35feaf90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1aaf20f480a423ea5feca81585aeeed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:06:37.378498 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-64f38d63-532b-4f0d-845e-4a8310722e0d tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0948754217fc4ff2ba0241fa35feaf90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1aaf20f480a423ea5feca81585aeeed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:06:37.379629 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-64f38d63-532b-4f0d-845e-4a8310722e0d tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] 10.222.0.50 "GET /compute/v2.1/servers/08fb826b-e891-46c4-990d-ca03cf3f4222" status: 200 len: 1805 microversion: 2.20 time: 0.156232 Sep 24 05:06:37.380186 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 322/671] 10.222.0.50 () {60 vars in 1277 bytes} [Sat Sep 24 05:06:37 2022] GET /compute/v2.1/servers/08fb826b-e891-46c4-990d-ca03cf3f4222 => generated 1805 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 05:06:37.937554 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-d9384fb9-ef04-4a35-9fe9-142dae8d9c00 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Calling method '>' {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:06:37.938135 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.compute.api [None req-d9384fb9-ef04-4a35-9fe9-142dae8d9c00 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] [instance: b2daebb8-dfea-4ab9-8253-008a21f906e1] Fetching instance by UUID {{(pid=120594) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:06:37.944428 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-d9384fb9-ef04-4a35-9fe9-142dae8d9c00 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:06:37.944896 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-d9384fb9-ef04-4a35-9fe9-142dae8d9c00 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:06:37.945323 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-d9384fb9-ef04-4a35-9fe9-142dae8d9c00 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:06:37.946028 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-d9384fb9-ef04-4a35-9fe9-142dae8d9c00 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:06:37.946462 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-d9384fb9-ef04-4a35-9fe9-142dae8d9c00 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:06:37.946881 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-d9384fb9-ef04-4a35-9fe9-142dae8d9c00 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:06:38.079010 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.policy [None req-d9384fb9-ef04-4a35-9fe9-142dae8d9c00 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b1b0448e7f54e3aaae49e411699269e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66ec8bde739145dda504995dbea0914a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:06:38.081150 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG dbcounter [-] [120594] Writing DB stats nova_cell1:SELECT=100 {{(pid=120594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 05:06:38.082248 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-1de91769-709b-4e9b-934c-2016014b5be1 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Calling method '>' {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:06:38.082947 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.compute.api [None req-1de91769-709b-4e9b-934c-2016014b5be1 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] [instance: 34b2ef46-4969-469b-adcd-22abf7c4d6df] Fetching instance by UUID {{(pid=120593) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:06:38.088300 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [None req-d9384fb9-ef04-4a35-9fe9-142dae8d9c00 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] 10.222.0.50 "GET /compute/v2.1/servers/b2daebb8-dfea-4ab9-8253-008a21f906e1" status: 200 len: 1710 microversion: 2.1 time: 0.154663 Sep 24 05:06:38.088874 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 350/672] 10.222.0.50 () {58 vars in 1236 bytes} [Sat Sep 24 05:06:37 2022] GET /compute/v2.1/servers/b2daebb8-dfea-4ab9-8253-008a21f906e1 => generated 1710 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 05:06:38.089707 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-1de91769-709b-4e9b-934c-2016014b5be1 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:06:38.090219 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-1de91769-709b-4e9b-934c-2016014b5be1 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:06:38.090645 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-1de91769-709b-4e9b-934c-2016014b5be1 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:06:38.091330 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-1de91769-709b-4e9b-934c-2016014b5be1 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:06:38.091773 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-1de91769-709b-4e9b-934c-2016014b5be1 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:06:38.092189 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-1de91769-709b-4e9b-934c-2016014b5be1 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:06:38.219769 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-1de91769-709b-4e9b-934c-2016014b5be1 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74a8cc19ab204424ab23c62915ac2bab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87d5229e39fe4817b5187068d8acecc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:06:38.227633 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-1de91769-709b-4e9b-934c-2016014b5be1 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] 10.222.0.50 "GET /compute/v2.1/servers/34b2ef46-4969-469b-adcd-22abf7c4d6df" status: 200 len: 1366 microversion: 2.1 time: 0.149198 Sep 24 05:06:38.228259 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 323/673] 10.222.0.50 () {58 vars in 1236 bytes} [Sat Sep 24 05:06:38 2022] GET /compute/v2.1/servers/34b2ef46-4969-469b-adcd-22abf7c4d6df => generated 1366 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 05:06:38.405201 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-1b8b2101-ba65-4549-bb1b-95fa18dc3343 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Calling method '>' {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:06:38.405807 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.compute.api [None req-1b8b2101-ba65-4549-bb1b-95fa18dc3343 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] [instance: 08fb826b-e891-46c4-990d-ca03cf3f4222] Fetching instance by UUID {{(pid=120594) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:06:38.411947 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-1b8b2101-ba65-4549-bb1b-95fa18dc3343 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:06:38.412422 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-1b8b2101-ba65-4549-bb1b-95fa18dc3343 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:06:38.412850 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-1b8b2101-ba65-4549-bb1b-95fa18dc3343 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:06:38.413527 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-1b8b2101-ba65-4549-bb1b-95fa18dc3343 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:06:38.413977 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-1b8b2101-ba65-4549-bb1b-95fa18dc3343 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:06:38.414420 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-1b8b2101-ba65-4549-bb1b-95fa18dc3343 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:06:38.543131 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.policy [None req-1b8b2101-ba65-4549-bb1b-95fa18dc3343 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0948754217fc4ff2ba0241fa35feaf90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1aaf20f480a423ea5feca81585aeeed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:06:38.551531 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.policy [None req-1b8b2101-ba65-4549-bb1b-95fa18dc3343 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0948754217fc4ff2ba0241fa35feaf90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1aaf20f480a423ea5feca81585aeeed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:06:38.552967 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.policy [None req-1b8b2101-ba65-4549-bb1b-95fa18dc3343 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0948754217fc4ff2ba0241fa35feaf90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1aaf20f480a423ea5feca81585aeeed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:06:38.554768 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [None req-1b8b2101-ba65-4549-bb1b-95fa18dc3343 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] 10.222.0.50 "GET /compute/v2.1/servers/08fb826b-e891-46c4-990d-ca03cf3f4222" status: 200 len: 1805 microversion: 2.20 time: 0.152815 Sep 24 05:06:38.555333 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 351/674] 10.222.0.50 () {60 vars in 1277 bytes} [Sat Sep 24 05:06:38 2022] GET /compute/v2.1/servers/08fb826b-e891-46c4-990d-ca03cf3f4222 => generated 1805 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 05:06:39.111295 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-89e812c0-386a-4fd5-bdb7-c9aa01e46c78 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Calling method '>' {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:06:39.111893 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.compute.api [None req-89e812c0-386a-4fd5-bdb7-c9aa01e46c78 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] [instance: b2daebb8-dfea-4ab9-8253-008a21f906e1] Fetching instance by UUID {{(pid=120593) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:06:39.118937 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-89e812c0-386a-4fd5-bdb7-c9aa01e46c78 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:06:39.119409 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-89e812c0-386a-4fd5-bdb7-c9aa01e46c78 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:06:39.119837 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-89e812c0-386a-4fd5-bdb7-c9aa01e46c78 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:06:39.120510 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-89e812c0-386a-4fd5-bdb7-c9aa01e46c78 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:06:39.120956 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-89e812c0-386a-4fd5-bdb7-c9aa01e46c78 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:06:39.121373 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-89e812c0-386a-4fd5-bdb7-c9aa01e46c78 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:06:39.249071 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-89e812c0-386a-4fd5-bdb7-c9aa01e46c78 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b1b0448e7f54e3aaae49e411699269e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66ec8bde739145dda504995dbea0914a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:06:39.251177 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-f3527ca5-75e7-4d4f-8ffd-03ae00a4d858 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Calling method '>' {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:06:39.251729 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.compute.api [None req-f3527ca5-75e7-4d4f-8ffd-03ae00a4d858 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] [instance: 34b2ef46-4969-469b-adcd-22abf7c4d6df] Fetching instance by UUID {{(pid=120594) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:06:39.257295 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-89e812c0-386a-4fd5-bdb7-c9aa01e46c78 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] 10.222.0.50 "GET /compute/v2.1/servers/b2daebb8-dfea-4ab9-8253-008a21f906e1" status: 200 len: 1710 microversion: 2.1 time: 0.149736 Sep 24 05:06:39.257852 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 324/675] 10.222.0.50 () {58 vars in 1236 bytes} [Sat Sep 24 05:06:39 2022] GET /compute/v2.1/servers/b2daebb8-dfea-4ab9-8253-008a21f906e1 => generated 1710 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 05:06:39.258048 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-f3527ca5-75e7-4d4f-8ffd-03ae00a4d858 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:06:39.258540 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-f3527ca5-75e7-4d4f-8ffd-03ae00a4d858 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:06:39.259109 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-f3527ca5-75e7-4d4f-8ffd-03ae00a4d858 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:06:39.259807 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-f3527ca5-75e7-4d4f-8ffd-03ae00a4d858 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:06:39.260259 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-f3527ca5-75e7-4d4f-8ffd-03ae00a4d858 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:06:39.260684 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-f3527ca5-75e7-4d4f-8ffd-03ae00a4d858 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:06:39.392969 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.policy [None req-f3527ca5-75e7-4d4f-8ffd-03ae00a4d858 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74a8cc19ab204424ab23c62915ac2bab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87d5229e39fe4817b5187068d8acecc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:06:39.401393 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [None req-f3527ca5-75e7-4d4f-8ffd-03ae00a4d858 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] 10.222.0.50 "GET /compute/v2.1/servers/34b2ef46-4969-469b-adcd-22abf7c4d6df" status: 200 len: 1366 microversion: 2.1 time: 0.154140 Sep 24 05:06:39.401962 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 352/676] 10.222.0.50 () {58 vars in 1236 bytes} [Sat Sep 24 05:06:39 2022] GET /compute/v2.1/servers/34b2ef46-4969-469b-adcd-22abf7c4d6df => generated 1366 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 05:06:39.582621 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-41e03682-508c-4851-bdc4-5933b13ee248 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Calling method '>' {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:06:39.583268 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.compute.api [None req-41e03682-508c-4851-bdc4-5933b13ee248 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] [instance: 08fb826b-e891-46c4-990d-ca03cf3f4222] Fetching instance by UUID {{(pid=120593) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:06:39.589204 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-41e03682-508c-4851-bdc4-5933b13ee248 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:06:39.589686 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-41e03682-508c-4851-bdc4-5933b13ee248 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:06:39.590148 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-41e03682-508c-4851-bdc4-5933b13ee248 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:06:39.590842 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-41e03682-508c-4851-bdc4-5933b13ee248 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:06:39.591292 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-41e03682-508c-4851-bdc4-5933b13ee248 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:06:39.591715 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-41e03682-508c-4851-bdc4-5933b13ee248 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:06:39.728134 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-41e03682-508c-4851-bdc4-5933b13ee248 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0948754217fc4ff2ba0241fa35feaf90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1aaf20f480a423ea5feca81585aeeed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:06:39.737840 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-41e03682-508c-4851-bdc4-5933b13ee248 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0948754217fc4ff2ba0241fa35feaf90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1aaf20f480a423ea5feca81585aeeed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:06:39.739397 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-41e03682-508c-4851-bdc4-5933b13ee248 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0948754217fc4ff2ba0241fa35feaf90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1aaf20f480a423ea5feca81585aeeed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:06:39.740677 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-41e03682-508c-4851-bdc4-5933b13ee248 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] 10.222.0.50 "GET /compute/v2.1/servers/08fb826b-e891-46c4-990d-ca03cf3f4222" status: 200 len: 1805 microversion: 2.20 time: 0.162171 Sep 24 05:06:39.741317 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 325/677] 10.222.0.50 () {60 vars in 1277 bytes} [Sat Sep 24 05:06:39 2022] GET /compute/v2.1/servers/08fb826b-e891-46c4-990d-ca03cf3f4222 => generated 1805 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 05:06:40.280642 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-2e0bca5b-1d9a-4f38-a63f-ed5cc77f99b2 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Calling method '>' {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:06:40.281356 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.compute.api [None req-2e0bca5b-1d9a-4f38-a63f-ed5cc77f99b2 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] [instance: b2daebb8-dfea-4ab9-8253-008a21f906e1] Fetching instance by UUID {{(pid=120594) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:06:40.287755 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-2e0bca5b-1d9a-4f38-a63f-ed5cc77f99b2 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:06:40.288236 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-2e0bca5b-1d9a-4f38-a63f-ed5cc77f99b2 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:06:40.288701 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-2e0bca5b-1d9a-4f38-a63f-ed5cc77f99b2 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:06:40.289381 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-2e0bca5b-1d9a-4f38-a63f-ed5cc77f99b2 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:06:40.289829 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-2e0bca5b-1d9a-4f38-a63f-ed5cc77f99b2 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:06:40.290271 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-2e0bca5b-1d9a-4f38-a63f-ed5cc77f99b2 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:06:40.419592 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.policy [None req-2e0bca5b-1d9a-4f38-a63f-ed5cc77f99b2 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b1b0448e7f54e3aaae49e411699269e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66ec8bde739145dda504995dbea0914a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:06:40.423926 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-bd581b67-56d7-4aed-af18-a1f5da369ba1 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Calling method '>' {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:06:40.424608 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.compute.api [None req-bd581b67-56d7-4aed-af18-a1f5da369ba1 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] [instance: 34b2ef46-4969-469b-adcd-22abf7c4d6df] Fetching instance by UUID {{(pid=120593) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:06:40.429506 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [None req-2e0bca5b-1d9a-4f38-a63f-ed5cc77f99b2 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] 10.222.0.50 "GET /compute/v2.1/servers/b2daebb8-dfea-4ab9-8253-008a21f906e1" status: 200 len: 1710 microversion: 2.1 time: 0.152127 Sep 24 05:06:40.430312 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 353/678] 10.222.0.50 () {58 vars in 1236 bytes} [Sat Sep 24 05:06:40 2022] GET /compute/v2.1/servers/b2daebb8-dfea-4ab9-8253-008a21f906e1 => generated 1710 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 05:06:40.433022 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-bd581b67-56d7-4aed-af18-a1f5da369ba1 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:06:40.433507 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-bd581b67-56d7-4aed-af18-a1f5da369ba1 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:06:40.433940 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-bd581b67-56d7-4aed-af18-a1f5da369ba1 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:06:40.434658 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-bd581b67-56d7-4aed-af18-a1f5da369ba1 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:06:40.435104 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-bd581b67-56d7-4aed-af18-a1f5da369ba1 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:06:40.435520 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-bd581b67-56d7-4aed-af18-a1f5da369ba1 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:06:40.582266 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-bd581b67-56d7-4aed-af18-a1f5da369ba1 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74a8cc19ab204424ab23c62915ac2bab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87d5229e39fe4817b5187068d8acecc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:06:40.590872 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-bd581b67-56d7-4aed-af18-a1f5da369ba1 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] 10.222.0.50 "GET /compute/v2.1/servers/34b2ef46-4969-469b-adcd-22abf7c4d6df" status: 200 len: 1366 microversion: 2.1 time: 0.170677 Sep 24 05:06:40.591447 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 326/679] 10.222.0.50 () {58 vars in 1236 bytes} [Sat Sep 24 05:06:40 2022] GET /compute/v2.1/servers/34b2ef46-4969-469b-adcd-22abf7c4d6df => generated 1366 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 24 05:06:40.766392 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-5058a795-33dc-45de-b1d7-96f2a27959b5 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Calling method '>' {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:06:40.767002 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.compute.api [None req-5058a795-33dc-45de-b1d7-96f2a27959b5 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] [instance: 08fb826b-e891-46c4-990d-ca03cf3f4222] Fetching instance by UUID {{(pid=120594) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:06:40.773622 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-5058a795-33dc-45de-b1d7-96f2a27959b5 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:06:40.774132 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-5058a795-33dc-45de-b1d7-96f2a27959b5 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:06:40.774568 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-5058a795-33dc-45de-b1d7-96f2a27959b5 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:06:40.775547 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-5058a795-33dc-45de-b1d7-96f2a27959b5 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:06:40.775999 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-5058a795-33dc-45de-b1d7-96f2a27959b5 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:06:40.776793 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-5058a795-33dc-45de-b1d7-96f2a27959b5 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:06:40.904425 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.policy [None req-5058a795-33dc-45de-b1d7-96f2a27959b5 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0948754217fc4ff2ba0241fa35feaf90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1aaf20f480a423ea5feca81585aeeed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:06:40.913087 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.policy [None req-5058a795-33dc-45de-b1d7-96f2a27959b5 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0948754217fc4ff2ba0241fa35feaf90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1aaf20f480a423ea5feca81585aeeed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:06:40.914701 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.policy [None req-5058a795-33dc-45de-b1d7-96f2a27959b5 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0948754217fc4ff2ba0241fa35feaf90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1aaf20f480a423ea5feca81585aeeed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:06:40.915921 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [None req-5058a795-33dc-45de-b1d7-96f2a27959b5 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] 10.222.0.50 "GET /compute/v2.1/servers/08fb826b-e891-46c4-990d-ca03cf3f4222" status: 200 len: 1805 microversion: 2.20 time: 0.153423 Sep 24 05:06:40.916558 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 354/680] 10.222.0.50 () {60 vars in 1277 bytes} [Sat Sep 24 05:06:40 2022] GET /compute/v2.1/servers/08fb826b-e891-46c4-990d-ca03cf3f4222 => generated 1805 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 05:06:41.454936 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-1e9c07f1-b623-46cf-bbc4-1b6575a90fe0 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Calling method '>' {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:06:41.455658 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.compute.api [None req-1e9c07f1-b623-46cf-bbc4-1b6575a90fe0 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] [instance: b2daebb8-dfea-4ab9-8253-008a21f906e1] Fetching instance by UUID {{(pid=120593) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:06:41.463282 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-1e9c07f1-b623-46cf-bbc4-1b6575a90fe0 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:06:41.463806 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-1e9c07f1-b623-46cf-bbc4-1b6575a90fe0 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:06:41.464353 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-1e9c07f1-b623-46cf-bbc4-1b6575a90fe0 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:06:41.465246 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-1e9c07f1-b623-46cf-bbc4-1b6575a90fe0 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:06:41.465778 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-1e9c07f1-b623-46cf-bbc4-1b6575a90fe0 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:06:41.466386 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-1e9c07f1-b623-46cf-bbc4-1b6575a90fe0 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:06:41.613169 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-1e9c07f1-b623-46cf-bbc4-1b6575a90fe0 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b1b0448e7f54e3aaae49e411699269e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66ec8bde739145dda504995dbea0914a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:06:41.614483 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-1a295d38-b79e-4fd3-a266-85baaa41c6d7 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Calling method '>' {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:06:41.615097 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.compute.api [None req-1a295d38-b79e-4fd3-a266-85baaa41c6d7 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] [instance: 34b2ef46-4969-469b-adcd-22abf7c4d6df] Fetching instance by UUID {{(pid=120594) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:06:41.621615 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-1a295d38-b79e-4fd3-a266-85baaa41c6d7 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:06:41.621838 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-1e9c07f1-b623-46cf-bbc4-1b6575a90fe0 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] 10.222.0.50 "GET /compute/v2.1/servers/b2daebb8-dfea-4ab9-8253-008a21f906e1" status: 200 len: 1710 microversion: 2.1 time: 0.171021 Sep 24 05:06:41.622127 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-1a295d38-b79e-4fd3-a266-85baaa41c6d7 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:06:41.622425 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 327/681] 10.222.0.50 () {58 vars in 1236 bytes} [Sat Sep 24 05:06:41 2022] GET /compute/v2.1/servers/b2daebb8-dfea-4ab9-8253-008a21f906e1 => generated 1710 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 05:06:41.622566 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-1a295d38-b79e-4fd3-a266-85baaa41c6d7 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:06:41.623444 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-1a295d38-b79e-4fd3-a266-85baaa41c6d7 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:06:41.623903 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-1a295d38-b79e-4fd3-a266-85baaa41c6d7 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:06:41.624326 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-1a295d38-b79e-4fd3-a266-85baaa41c6d7 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:06:41.823455 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.policy [None req-1a295d38-b79e-4fd3-a266-85baaa41c6d7 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74a8cc19ab204424ab23c62915ac2bab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87d5229e39fe4817b5187068d8acecc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:06:41.834535 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [None req-1a295d38-b79e-4fd3-a266-85baaa41c6d7 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] 10.222.0.50 "GET /compute/v2.1/servers/34b2ef46-4969-469b-adcd-22abf7c4d6df" status: 200 len: 1557 microversion: 2.1 time: 0.222751 Sep 24 05:06:41.835929 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 355/682] 10.222.0.50 () {58 vars in 1236 bytes} [Sat Sep 24 05:06:41 2022] GET /compute/v2.1/servers/34b2ef46-4969-469b-adcd-22abf7c4d6df => generated 1557 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 24 05:06:41.864022 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-0c199a6e-6c00-4617-80cf-841ca2f706df tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Calling method '>' {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:06:41.864863 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.compute.api [None req-0c199a6e-6c00-4617-80cf-841ca2f706df tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] [instance: 34b2ef46-4969-469b-adcd-22abf7c4d6df] Fetching instance by UUID {{(pid=120593) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:06:41.871159 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-0c199a6e-6c00-4617-80cf-841ca2f706df tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:06:41.872002 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-0c199a6e-6c00-4617-80cf-841ca2f706df tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:06:41.872594 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-0c199a6e-6c00-4617-80cf-841ca2f706df tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:06:41.873587 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-0c199a6e-6c00-4617-80cf-841ca2f706df tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:06:41.874225 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-0c199a6e-6c00-4617-80cf-841ca2f706df tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:06:41.874813 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-0c199a6e-6c00-4617-80cf-841ca2f706df tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:06:41.889141 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG dbcounter [-] [120593] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 05:06:41.940810 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-98dbbda3-3fad-43ba-8d05-0bac10f80e61 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Calling method '>' {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:06:41.941427 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.compute.api [None req-98dbbda3-3fad-43ba-8d05-0bac10f80e61 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] [instance: 08fb826b-e891-46c4-990d-ca03cf3f4222] Fetching instance by UUID {{(pid=120594) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:06:41.947291 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-98dbbda3-3fad-43ba-8d05-0bac10f80e61 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:06:41.947775 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-98dbbda3-3fad-43ba-8d05-0bac10f80e61 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:06:41.948207 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-98dbbda3-3fad-43ba-8d05-0bac10f80e61 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:06:41.948891 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-98dbbda3-3fad-43ba-8d05-0bac10f80e61 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:06:41.949339 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-98dbbda3-3fad-43ba-8d05-0bac10f80e61 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:06:41.949757 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-98dbbda3-3fad-43ba-8d05-0bac10f80e61 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:06:41.959016 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-0c199a6e-6c00-4617-80cf-841ca2f706df tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] 10.222.0.50 "GET /compute/v2.1/servers/34b2ef46-4969-469b-adcd-22abf7c4d6df/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.099375 Sep 24 05:06:41.960801 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 328/683] 10.222.0.50 () {58 vars in 1275 bytes} [Sat Sep 24 05:06:41 2022] GET /compute/v2.1/servers/34b2ef46-4969-469b-adcd-22abf7c4d6df/os-interface => generated 285 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 05:06:42.262297 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.policy [None req-98dbbda3-3fad-43ba-8d05-0bac10f80e61 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0948754217fc4ff2ba0241fa35feaf90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1aaf20f480a423ea5feca81585aeeed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:06:42.277343 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.policy [None req-98dbbda3-3fad-43ba-8d05-0bac10f80e61 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0948754217fc4ff2ba0241fa35feaf90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1aaf20f480a423ea5feca81585aeeed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:06:42.284011 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.policy [None req-98dbbda3-3fad-43ba-8d05-0bac10f80e61 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0948754217fc4ff2ba0241fa35feaf90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1aaf20f480a423ea5feca81585aeeed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:06:42.286825 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [None req-98dbbda3-3fad-43ba-8d05-0bac10f80e61 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] 10.222.0.50 "GET /compute/v2.1/servers/08fb826b-e891-46c4-990d-ca03cf3f4222" status: 200 len: 1805 microversion: 2.20 time: 0.349108 Sep 24 05:06:42.289572 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 356/684] 10.222.0.50 () {60 vars in 1277 bytes} [Sat Sep 24 05:06:41 2022] GET /compute/v2.1/servers/08fb826b-e891-46c4-990d-ca03cf3f4222 => generated 1805 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 05:06:42.645125 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-17084948-14ff-4db6-9156-f5fac9587eb4 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Calling method '>' {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:06:42.654755 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.compute.api [None req-17084948-14ff-4db6-9156-f5fac9587eb4 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] [instance: b2daebb8-dfea-4ab9-8253-008a21f906e1] Fetching instance by UUID {{(pid=120593) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:06:42.661121 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-17084948-14ff-4db6-9156-f5fac9587eb4 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:06:42.661614 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-17084948-14ff-4db6-9156-f5fac9587eb4 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:06:42.662285 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-17084948-14ff-4db6-9156-f5fac9587eb4 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:06:42.662989 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-17084948-14ff-4db6-9156-f5fac9587eb4 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:06:42.663444 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-17084948-14ff-4db6-9156-f5fac9587eb4 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:06:42.663864 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-17084948-14ff-4db6-9156-f5fac9587eb4 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:06:42.886544 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-17084948-14ff-4db6-9156-f5fac9587eb4 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b1b0448e7f54e3aaae49e411699269e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66ec8bde739145dda504995dbea0914a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:06:42.894657 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-17084948-14ff-4db6-9156-f5fac9587eb4 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] 10.222.0.50 "GET /compute/v2.1/servers/b2daebb8-dfea-4ab9-8253-008a21f906e1" status: 200 len: 1710 microversion: 2.1 time: 0.253912 Sep 24 05:06:42.895225 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 329/685] 10.222.0.50 () {58 vars in 1236 bytes} [Sat Sep 24 05:06:42 2022] GET /compute/v2.1/servers/b2daebb8-dfea-4ab9-8253-008a21f906e1 => generated 1710 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 05:06:43.319367 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-0f0a1fb2-18a5-445d-a9c9-252b04b9c14d tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Calling method '>' {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:06:43.320610 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.compute.api [None req-0f0a1fb2-18a5-445d-a9c9-252b04b9c14d tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] [instance: 08fb826b-e891-46c4-990d-ca03cf3f4222] Fetching instance by UUID {{(pid=120594) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:06:43.327123 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-0f0a1fb2-18a5-445d-a9c9-252b04b9c14d tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:06:43.327605 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-0f0a1fb2-18a5-445d-a9c9-252b04b9c14d tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:06:43.328032 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-0f0a1fb2-18a5-445d-a9c9-252b04b9c14d tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:06:43.328780 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-0f0a1fb2-18a5-445d-a9c9-252b04b9c14d tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:06:43.329140 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-0f0a1fb2-18a5-445d-a9c9-252b04b9c14d tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:06:43.329548 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-0f0a1fb2-18a5-445d-a9c9-252b04b9c14d tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:06:43.487605 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [req-e9187d97-3997-4ef1-8d38-fa683b897807 req-aaca1799-7dce-434f-baea-cee0893a7f50 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "34b2ef46-4969-469b-adcd-22abf7c4d6df", "tag": "7496c434-3138-4ef6-8254-ee2787a76407"}]} {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 05:06:43.500451 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [req-e9187d97-3997-4ef1-8d38-fa683b897807 req-aaca1799-7dce-434f-baea-cee0893a7f50 service nova] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:06:43.501201 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [req-e9187d97-3997-4ef1-8d38-fa683b897807 req-aaca1799-7dce-434f-baea-cee0893a7f50 service nova] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:06:43.501903 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [req-e9187d97-3997-4ef1-8d38-fa683b897807 req-aaca1799-7dce-434f-baea-cee0893a7f50 service nova] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:06:43.515897 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.policy [None req-0f0a1fb2-18a5-445d-a9c9-252b04b9c14d tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0948754217fc4ff2ba0241fa35feaf90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1aaf20f480a423ea5feca81585aeeed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:06:43.527511 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.policy [None req-0f0a1fb2-18a5-445d-a9c9-252b04b9c14d tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0948754217fc4ff2ba0241fa35feaf90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1aaf20f480a423ea5feca81585aeeed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:06:43.529440 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.policy [None req-0f0a1fb2-18a5-445d-a9c9-252b04b9c14d tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0948754217fc4ff2ba0241fa35feaf90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1aaf20f480a423ea5feca81585aeeed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:06:43.530693 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [None req-0f0a1fb2-18a5-445d-a9c9-252b04b9c14d tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] 10.222.0.50 "GET /compute/v2.1/servers/08fb826b-e891-46c4-990d-ca03cf3f4222" status: 200 len: 1805 microversion: 2.20 time: 0.215193 Sep 24 05:06:43.548209 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 357/686] 10.222.0.50 () {60 vars in 1277 bytes} [Sat Sep 24 05:06:43 2022] GET /compute/v2.1/servers/08fb826b-e891-46c4-990d-ca03cf3f4222 => generated 1805 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 05:06:43.548209 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-e768492e-056e-4c35-9011-102b17fe7271 tempest-VolumesSnapshotTestJSON-4159203 tempest-VolumesSnapshotTestJSON-4159203-project] Calling method '>' {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:06:43.548209 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.compute.api [None req-e768492e-056e-4c35-9011-102b17fe7271 tempest-VolumesSnapshotTestJSON-4159203 tempest-VolumesSnapshotTestJSON-4159203-project] [instance: 87e09804-74dc-4329-97d5-02be092fd866] Fetching instance by UUID {{(pid=120594) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:06:43.548624 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.compute.server_external_events [req-e9187d97-3997-4ef1-8d38-fa683b897807 req-aaca1799-7dce-434f-baea-cee0893a7f50 service nova] Creating event network-changed:7496c434-3138-4ef6-8254-ee2787a76407 for instance 34b2ef46-4969-469b-adcd-22abf7c4d6df on hv-cinder-85918 Sep 24 05:06:43.548737 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-e768492e-056e-4c35-9011-102b17fe7271 tempest-VolumesSnapshotTestJSON-4159203 tempest-VolumesSnapshotTestJSON-4159203-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:06:43.548737 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-e768492e-056e-4c35-9011-102b17fe7271 tempest-VolumesSnapshotTestJSON-4159203 tempest-VolumesSnapshotTestJSON-4159203-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:06:43.548737 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-e768492e-056e-4c35-9011-102b17fe7271 tempest-VolumesSnapshotTestJSON-4159203 tempest-VolumesSnapshotTestJSON-4159203-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:06:43.548737 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-e768492e-056e-4c35-9011-102b17fe7271 tempest-VolumesSnapshotTestJSON-4159203 tempest-VolumesSnapshotTestJSON-4159203-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:06:43.549073 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-e768492e-056e-4c35-9011-102b17fe7271 tempest-VolumesSnapshotTestJSON-4159203 tempest-VolumesSnapshotTestJSON-4159203-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:06:43.549073 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-e768492e-056e-4c35-9011-102b17fe7271 tempest-VolumesSnapshotTestJSON-4159203 tempest-VolumesSnapshotTestJSON-4159203-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:06:43.551737 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [req-e9187d97-3997-4ef1-8d38-fa683b897807 req-aaca1799-7dce-434f-baea-cee0893a7f50 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.167975 Sep 24 05:06:43.555101 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 330/687] 10.222.0.50 () {64 vars in 1317 bytes} [Sat Sep 24 05:06:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 24 05:06:43.717579 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.objects.instance [None req-e768492e-056e-4c35-9011-102b17fe7271 tempest-VolumesSnapshotTestJSON-4159203 tempest-VolumesSnapshotTestJSON-4159203-project] Lazy-loading 'services' on Instance uuid 87e09804-74dc-4329-97d5-02be092fd866 {{(pid=120594) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 24 05:06:43.853334 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [None req-e768492e-056e-4c35-9011-102b17fe7271 tempest-VolumesSnapshotTestJSON-4159203 tempest-VolumesSnapshotTestJSON-4159203-project] 10.222.0.50 "DELETE /compute/v2.1/servers/87e09804-74dc-4329-97d5-02be092fd866/os-volume_attachments/69e1f27f-a0e3-4932-90c6-200b28f9eb75" status: 202 len: 0 microversion: 2.1 time: 0.320154 Sep 24 05:06:43.854131 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 358/688] 10.222.0.50 () {58 vars in 1416 bytes} [Sat Sep 24 05:06:43 2022] DELETE /compute/v2.1/servers/87e09804-74dc-4329-97d5-02be092fd866/os-volume_attachments/69e1f27f-a0e3-4932-90c6-200b28f9eb75 => generated 0 bytes in 322 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 24 05:06:43.922705 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-0ac825b1-76c7-4919-910a-1daca86bab9e tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Calling method '>' {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:06:43.923484 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.compute.api [None req-0ac825b1-76c7-4919-910a-1daca86bab9e tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] [instance: b2daebb8-dfea-4ab9-8253-008a21f906e1] Fetching instance by UUID {{(pid=120593) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:06:43.930986 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-0ac825b1-76c7-4919-910a-1daca86bab9e tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:06:43.931727 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-0ac825b1-76c7-4919-910a-1daca86bab9e tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:06:43.932331 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-0ac825b1-76c7-4919-910a-1daca86bab9e tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:06:43.933300 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-0ac825b1-76c7-4919-910a-1daca86bab9e tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:06:43.933913 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-0ac825b1-76c7-4919-910a-1daca86bab9e tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:06:43.934515 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-0ac825b1-76c7-4919-910a-1daca86bab9e tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:06:44.083947 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-0ac825b1-76c7-4919-910a-1daca86bab9e tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b1b0448e7f54e3aaae49e411699269e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66ec8bde739145dda504995dbea0914a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:06:44.092599 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-0ac825b1-76c7-4919-910a-1daca86bab9e tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] 10.222.0.50 "GET /compute/v2.1/servers/b2daebb8-dfea-4ab9-8253-008a21f906e1" status: 200 len: 1710 microversion: 2.1 time: 0.177331 Sep 24 05:06:44.093172 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 331/689] 10.222.0.50 () {58 vars in 1236 bytes} [Sat Sep 24 05:06:43 2022] GET /compute/v2.1/servers/b2daebb8-dfea-4ab9-8253-008a21f906e1 => generated 1710 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 05:06:44.556957 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-0ec0086a-fbf2-4ea4-b9a3-6426fb070df7 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Calling method '>' {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:06:44.557606 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.compute.api [None req-0ec0086a-fbf2-4ea4-b9a3-6426fb070df7 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] [instance: 08fb826b-e891-46c4-990d-ca03cf3f4222] Fetching instance by UUID {{(pid=120594) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:06:44.559997 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG dbcounter [-] [120594] Writing DB stats nova_api:SELECT=84 {{(pid=120594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 05:06:44.579085 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-0ec0086a-fbf2-4ea4-b9a3-6426fb070df7 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:06:44.579576 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-0ec0086a-fbf2-4ea4-b9a3-6426fb070df7 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:06:44.580004 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-0ec0086a-fbf2-4ea4-b9a3-6426fb070df7 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:06:44.580716 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-0ec0086a-fbf2-4ea4-b9a3-6426fb070df7 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:06:44.583160 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-0ec0086a-fbf2-4ea4-b9a3-6426fb070df7 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:06:44.586579 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-0ec0086a-fbf2-4ea4-b9a3-6426fb070df7 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:06:44.739695 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.policy [None req-0ec0086a-fbf2-4ea4-b9a3-6426fb070df7 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0948754217fc4ff2ba0241fa35feaf90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1aaf20f480a423ea5feca81585aeeed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:06:44.749840 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.policy [None req-0ec0086a-fbf2-4ea4-b9a3-6426fb070df7 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0948754217fc4ff2ba0241fa35feaf90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1aaf20f480a423ea5feca81585aeeed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:06:44.751309 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.policy [None req-0ec0086a-fbf2-4ea4-b9a3-6426fb070df7 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0948754217fc4ff2ba0241fa35feaf90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1aaf20f480a423ea5feca81585aeeed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:06:44.752477 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [None req-0ec0086a-fbf2-4ea4-b9a3-6426fb070df7 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] 10.222.0.50 "GET /compute/v2.1/servers/08fb826b-e891-46c4-990d-ca03cf3f4222" status: 200 len: 1805 microversion: 2.20 time: 0.200362 Sep 24 05:06:44.753247 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 359/690] 10.222.0.50 () {60 vars in 1277 bytes} [Sat Sep 24 05:06:44 2022] GET /compute/v2.1/servers/08fb826b-e891-46c4-990d-ca03cf3f4222 => generated 1805 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 05:06:45.115498 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-c3ae0c19-a1d0-4734-a352-7e315b771022 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Calling method '>' {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:06:45.117343 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.compute.api [None req-c3ae0c19-a1d0-4734-a352-7e315b771022 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] [instance: b2daebb8-dfea-4ab9-8253-008a21f906e1] Fetching instance by UUID {{(pid=120593) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:06:45.124109 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-c3ae0c19-a1d0-4734-a352-7e315b771022 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:06:45.124579 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-c3ae0c19-a1d0-4734-a352-7e315b771022 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:06:45.125003 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-c3ae0c19-a1d0-4734-a352-7e315b771022 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:06:45.125694 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-c3ae0c19-a1d0-4734-a352-7e315b771022 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:06:45.126169 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-c3ae0c19-a1d0-4734-a352-7e315b771022 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:06:45.126583 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-c3ae0c19-a1d0-4734-a352-7e315b771022 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:06:45.256611 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-c3ae0c19-a1d0-4734-a352-7e315b771022 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b1b0448e7f54e3aaae49e411699269e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66ec8bde739145dda504995dbea0914a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:06:45.264781 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-c3ae0c19-a1d0-4734-a352-7e315b771022 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] 10.222.0.50 "GET /compute/v2.1/servers/b2daebb8-dfea-4ab9-8253-008a21f906e1" status: 200 len: 1710 microversion: 2.1 time: 0.153115 Sep 24 05:06:45.265345 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 332/691] 10.222.0.50 () {58 vars in 1236 bytes} [Sat Sep 24 05:06:45 2022] GET /compute/v2.1/servers/b2daebb8-dfea-4ab9-8253-008a21f906e1 => generated 1710 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 05:06:45.779748 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-952b7dea-8c44-4ca6-9800-625620a69b43 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Calling method '>' {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:06:45.780393 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.compute.api [None req-952b7dea-8c44-4ca6-9800-625620a69b43 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] [instance: 08fb826b-e891-46c4-990d-ca03cf3f4222] Fetching instance by UUID {{(pid=120594) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:06:45.786793 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-952b7dea-8c44-4ca6-9800-625620a69b43 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:06:45.787271 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-952b7dea-8c44-4ca6-9800-625620a69b43 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:06:45.787702 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-952b7dea-8c44-4ca6-9800-625620a69b43 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:06:45.788419 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-952b7dea-8c44-4ca6-9800-625620a69b43 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:06:45.788877 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-952b7dea-8c44-4ca6-9800-625620a69b43 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:06:45.789297 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-952b7dea-8c44-4ca6-9800-625620a69b43 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:06:45.921066 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.policy [None req-952b7dea-8c44-4ca6-9800-625620a69b43 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0948754217fc4ff2ba0241fa35feaf90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1aaf20f480a423ea5feca81585aeeed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:06:45.931430 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.policy [None req-952b7dea-8c44-4ca6-9800-625620a69b43 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0948754217fc4ff2ba0241fa35feaf90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1aaf20f480a423ea5feca81585aeeed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:06:45.933127 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.policy [None req-952b7dea-8c44-4ca6-9800-625620a69b43 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0948754217fc4ff2ba0241fa35feaf90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1aaf20f480a423ea5feca81585aeeed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:06:45.934541 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [None req-952b7dea-8c44-4ca6-9800-625620a69b43 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] 10.222.0.50 "GET /compute/v2.1/servers/08fb826b-e891-46c4-990d-ca03cf3f4222" status: 200 len: 1805 microversion: 2.20 time: 0.158629 Sep 24 05:06:45.935573 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 360/692] 10.222.0.50 () {60 vars in 1277 bytes} [Sat Sep 24 05:06:45 2022] GET /compute/v2.1/servers/08fb826b-e891-46c4-990d-ca03cf3f4222 => generated 1805 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 05:06:46.287817 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-0222566f-1af1-440c-9516-3dc629fe3b3c tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Calling method '>' {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:06:46.288539 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.compute.api [None req-0222566f-1af1-440c-9516-3dc629fe3b3c tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] [instance: b2daebb8-dfea-4ab9-8253-008a21f906e1] Fetching instance by UUID {{(pid=120593) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:06:46.296172 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-0222566f-1af1-440c-9516-3dc629fe3b3c tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:06:46.296660 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-0222566f-1af1-440c-9516-3dc629fe3b3c tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:06:46.297161 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-0222566f-1af1-440c-9516-3dc629fe3b3c tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:06:46.297865 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-0222566f-1af1-440c-9516-3dc629fe3b3c tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:06:46.298388 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-0222566f-1af1-440c-9516-3dc629fe3b3c tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:06:46.298840 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-0222566f-1af1-440c-9516-3dc629fe3b3c tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:06:46.429624 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-0222566f-1af1-440c-9516-3dc629fe3b3c tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b1b0448e7f54e3aaae49e411699269e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66ec8bde739145dda504995dbea0914a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:06:46.440063 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-0222566f-1af1-440c-9516-3dc629fe3b3c tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] 10.222.0.50 "GET /compute/v2.1/servers/b2daebb8-dfea-4ab9-8253-008a21f906e1" status: 200 len: 1710 microversion: 2.1 time: 0.155556 Sep 24 05:06:46.440933 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 333/693] 10.222.0.50 () {58 vars in 1236 bytes} [Sat Sep 24 05:06:46 2022] GET /compute/v2.1/servers/b2daebb8-dfea-4ab9-8253-008a21f906e1 => generated 1710 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 05:06:46.960134 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-28840b3d-3909-4c49-9bf8-e13f145cc425 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Calling method '>' {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:06:46.961400 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.compute.api [None req-28840b3d-3909-4c49-9bf8-e13f145cc425 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] [instance: 08fb826b-e891-46c4-990d-ca03cf3f4222] Fetching instance by UUID {{(pid=120594) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:06:46.967800 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-28840b3d-3909-4c49-9bf8-e13f145cc425 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:06:46.968274 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-28840b3d-3909-4c49-9bf8-e13f145cc425 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:06:46.968703 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-28840b3d-3909-4c49-9bf8-e13f145cc425 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:06:46.969386 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-28840b3d-3909-4c49-9bf8-e13f145cc425 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:06:46.969833 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-28840b3d-3909-4c49-9bf8-e13f145cc425 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:06:46.970276 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-28840b3d-3909-4c49-9bf8-e13f145cc425 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:06:47.098669 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.policy [None req-28840b3d-3909-4c49-9bf8-e13f145cc425 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0948754217fc4ff2ba0241fa35feaf90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1aaf20f480a423ea5feca81585aeeed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:06:47.107232 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.policy [None req-28840b3d-3909-4c49-9bf8-e13f145cc425 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0948754217fc4ff2ba0241fa35feaf90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1aaf20f480a423ea5feca81585aeeed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:06:47.108660 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.policy [None req-28840b3d-3909-4c49-9bf8-e13f145cc425 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0948754217fc4ff2ba0241fa35feaf90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1aaf20f480a423ea5feca81585aeeed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:06:47.109798 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [None req-28840b3d-3909-4c49-9bf8-e13f145cc425 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] 10.222.0.50 "GET /compute/v2.1/servers/08fb826b-e891-46c4-990d-ca03cf3f4222" status: 200 len: 1805 microversion: 2.20 time: 0.153562 Sep 24 05:06:47.110401 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 361/694] 10.222.0.50 () {60 vars in 1277 bytes} [Sat Sep 24 05:06:46 2022] GET /compute/v2.1/servers/08fb826b-e891-46c4-990d-ca03cf3f4222 => generated 1805 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 05:06:47.464601 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-5cd6aead-911b-4eca-ae1c-3bfef8b731fa tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Calling method '>' {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:06:47.465196 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.compute.api [None req-5cd6aead-911b-4eca-ae1c-3bfef8b731fa tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] [instance: b2daebb8-dfea-4ab9-8253-008a21f906e1] Fetching instance by UUID {{(pid=120593) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:06:47.471514 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-5cd6aead-911b-4eca-ae1c-3bfef8b731fa tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:06:47.471987 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-5cd6aead-911b-4eca-ae1c-3bfef8b731fa tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:06:47.472408 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-5cd6aead-911b-4eca-ae1c-3bfef8b731fa tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:06:47.473083 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-5cd6aead-911b-4eca-ae1c-3bfef8b731fa tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:06:47.473556 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-5cd6aead-911b-4eca-ae1c-3bfef8b731fa tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:06:47.473969 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-5cd6aead-911b-4eca-ae1c-3bfef8b731fa tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:06:47.599302 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-5cd6aead-911b-4eca-ae1c-3bfef8b731fa tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b1b0448e7f54e3aaae49e411699269e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66ec8bde739145dda504995dbea0914a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:06:47.608045 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-5cd6aead-911b-4eca-ae1c-3bfef8b731fa tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] 10.222.0.50 "GET /compute/v2.1/servers/b2daebb8-dfea-4ab9-8253-008a21f906e1" status: 200 len: 1710 microversion: 2.1 time: 0.147247 Sep 24 05:06:47.608608 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 334/695] 10.222.0.50 () {58 vars in 1236 bytes} [Sat Sep 24 05:06:47 2022] GET /compute/v2.1/servers/b2daebb8-dfea-4ab9-8253-008a21f906e1 => generated 1710 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 05:06:48.135289 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-bd6ddbfa-ce1d-4839-8f19-126c1c4908c9 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Calling method '>' {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:06:48.135970 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.compute.api [None req-bd6ddbfa-ce1d-4839-8f19-126c1c4908c9 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] [instance: 08fb826b-e891-46c4-990d-ca03cf3f4222] Fetching instance by UUID {{(pid=120594) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:06:48.142485 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-bd6ddbfa-ce1d-4839-8f19-126c1c4908c9 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:06:48.142967 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-bd6ddbfa-ce1d-4839-8f19-126c1c4908c9 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:06:48.143403 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-bd6ddbfa-ce1d-4839-8f19-126c1c4908c9 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:06:48.144096 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-bd6ddbfa-ce1d-4839-8f19-126c1c4908c9 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:06:48.144550 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-bd6ddbfa-ce1d-4839-8f19-126c1c4908c9 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:06:48.145214 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-bd6ddbfa-ce1d-4839-8f19-126c1c4908c9 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:06:48.302018 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.policy [None req-bd6ddbfa-ce1d-4839-8f19-126c1c4908c9 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0948754217fc4ff2ba0241fa35feaf90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1aaf20f480a423ea5feca81585aeeed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:06:48.313924 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.policy [None req-bd6ddbfa-ce1d-4839-8f19-126c1c4908c9 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0948754217fc4ff2ba0241fa35feaf90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1aaf20f480a423ea5feca81585aeeed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:06:48.315659 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.policy [None req-bd6ddbfa-ce1d-4839-8f19-126c1c4908c9 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0948754217fc4ff2ba0241fa35feaf90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1aaf20f480a423ea5feca81585aeeed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:06:48.316943 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [None req-bd6ddbfa-ce1d-4839-8f19-126c1c4908c9 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] 10.222.0.50 "GET /compute/v2.1/servers/08fb826b-e891-46c4-990d-ca03cf3f4222" status: 200 len: 1805 microversion: 2.20 time: 0.185684 Sep 24 05:06:48.324742 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 362/696] 10.222.0.50 () {60 vars in 1277 bytes} [Sat Sep 24 05:06:48 2022] GET /compute/v2.1/servers/08fb826b-e891-46c4-990d-ca03cf3f4222 => generated 1805 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 05:06:48.631164 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-e3553415-8a68-4c7f-8484-db911fdd9782 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Calling method '>' {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:06:48.631807 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.compute.api [None req-e3553415-8a68-4c7f-8484-db911fdd9782 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] [instance: b2daebb8-dfea-4ab9-8253-008a21f906e1] Fetching instance by UUID {{(pid=120593) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:06:48.638321 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-e3553415-8a68-4c7f-8484-db911fdd9782 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:06:48.638804 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-e3553415-8a68-4c7f-8484-db911fdd9782 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:06:48.639240 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-e3553415-8a68-4c7f-8484-db911fdd9782 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:06:48.639926 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-e3553415-8a68-4c7f-8484-db911fdd9782 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:06:48.640376 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-e3553415-8a68-4c7f-8484-db911fdd9782 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:06:48.640818 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-e3553415-8a68-4c7f-8484-db911fdd9782 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:06:48.771484 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-e3553415-8a68-4c7f-8484-db911fdd9782 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b1b0448e7f54e3aaae49e411699269e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66ec8bde739145dda504995dbea0914a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:06:48.780202 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-e3553415-8a68-4c7f-8484-db911fdd9782 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] 10.222.0.50 "GET /compute/v2.1/servers/b2daebb8-dfea-4ab9-8253-008a21f906e1" status: 200 len: 1710 microversion: 2.1 time: 0.153063 Sep 24 05:06:48.790121 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 335/697] 10.222.0.50 () {58 vars in 1236 bytes} [Sat Sep 24 05:06:48 2022] GET /compute/v2.1/servers/b2daebb8-dfea-4ab9-8253-008a21f906e1 => generated 1710 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 05:06:49.342422 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-296c5225-5e45-441e-8f66-b0888e689138 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Calling method '>' {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:06:49.343012 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.compute.api [None req-296c5225-5e45-441e-8f66-b0888e689138 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] [instance: 08fb826b-e891-46c4-990d-ca03cf3f4222] Fetching instance by UUID {{(pid=120594) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:06:49.349404 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-296c5225-5e45-441e-8f66-b0888e689138 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:06:49.349888 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-296c5225-5e45-441e-8f66-b0888e689138 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:06:49.350360 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-296c5225-5e45-441e-8f66-b0888e689138 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:06:49.351698 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-296c5225-5e45-441e-8f66-b0888e689138 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:06:49.352149 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-296c5225-5e45-441e-8f66-b0888e689138 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:06:49.352570 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-296c5225-5e45-441e-8f66-b0888e689138 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:06:49.477964 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.policy [None req-296c5225-5e45-441e-8f66-b0888e689138 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0948754217fc4ff2ba0241fa35feaf90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1aaf20f480a423ea5feca81585aeeed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:06:49.486508 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.policy [None req-296c5225-5e45-441e-8f66-b0888e689138 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0948754217fc4ff2ba0241fa35feaf90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1aaf20f480a423ea5feca81585aeeed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:06:49.487945 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.policy [None req-296c5225-5e45-441e-8f66-b0888e689138 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0948754217fc4ff2ba0241fa35feaf90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1aaf20f480a423ea5feca81585aeeed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:06:49.489078 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [None req-296c5225-5e45-441e-8f66-b0888e689138 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] 10.222.0.50 "GET /compute/v2.1/servers/08fb826b-e891-46c4-990d-ca03cf3f4222" status: 200 len: 1805 microversion: 2.20 time: 0.150599 Sep 24 05:06:49.489919 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 363/698] 10.222.0.50 () {60 vars in 1277 bytes} [Sat Sep 24 05:06:49 2022] GET /compute/v2.1/servers/08fb826b-e891-46c4-990d-ca03cf3f4222 => generated 1805 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 05:06:49.805017 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-f71a196b-44af-4ec4-83e9-7dd0f2917e54 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Calling method '>' {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:06:49.806197 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.compute.api [None req-f71a196b-44af-4ec4-83e9-7dd0f2917e54 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] [instance: b2daebb8-dfea-4ab9-8253-008a21f906e1] Fetching instance by UUID {{(pid=120593) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:06:49.812589 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-f71a196b-44af-4ec4-83e9-7dd0f2917e54 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:06:49.813062 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-f71a196b-44af-4ec4-83e9-7dd0f2917e54 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:06:49.813491 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-f71a196b-44af-4ec4-83e9-7dd0f2917e54 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:06:49.814202 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-f71a196b-44af-4ec4-83e9-7dd0f2917e54 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:06:49.814653 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-f71a196b-44af-4ec4-83e9-7dd0f2917e54 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:06:49.815069 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-f71a196b-44af-4ec4-83e9-7dd0f2917e54 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:06:49.954120 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-f71a196b-44af-4ec4-83e9-7dd0f2917e54 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b1b0448e7f54e3aaae49e411699269e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66ec8bde739145dda504995dbea0914a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:06:49.963135 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-f71a196b-44af-4ec4-83e9-7dd0f2917e54 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] 10.222.0.50 "GET /compute/v2.1/servers/b2daebb8-dfea-4ab9-8253-008a21f906e1" status: 200 len: 1710 microversion: 2.1 time: 0.161911 Sep 24 05:06:49.963697 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 336/699] 10.222.0.50 () {58 vars in 1236 bytes} [Sat Sep 24 05:06:49 2022] GET /compute/v2.1/servers/b2daebb8-dfea-4ab9-8253-008a21f906e1 => generated 1710 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 05:06:50.513696 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-dbc515ca-cd2a-44fd-8506-e4eac42be5b8 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Calling method '>' {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:06:50.514362 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.compute.api [None req-dbc515ca-cd2a-44fd-8506-e4eac42be5b8 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] [instance: 08fb826b-e891-46c4-990d-ca03cf3f4222] Fetching instance by UUID {{(pid=120594) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:06:50.520756 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-dbc515ca-cd2a-44fd-8506-e4eac42be5b8 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:06:50.521224 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-dbc515ca-cd2a-44fd-8506-e4eac42be5b8 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:06:50.521651 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-dbc515ca-cd2a-44fd-8506-e4eac42be5b8 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:06:50.522355 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-dbc515ca-cd2a-44fd-8506-e4eac42be5b8 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:06:50.522796 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-dbc515ca-cd2a-44fd-8506-e4eac42be5b8 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:06:50.523212 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-dbc515ca-cd2a-44fd-8506-e4eac42be5b8 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:06:50.660670 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.policy [None req-dbc515ca-cd2a-44fd-8506-e4eac42be5b8 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0948754217fc4ff2ba0241fa35feaf90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1aaf20f480a423ea5feca81585aeeed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:06:50.669695 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.policy [None req-dbc515ca-cd2a-44fd-8506-e4eac42be5b8 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0948754217fc4ff2ba0241fa35feaf90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1aaf20f480a423ea5feca81585aeeed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:06:50.671257 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.policy [None req-dbc515ca-cd2a-44fd-8506-e4eac42be5b8 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0948754217fc4ff2ba0241fa35feaf90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1aaf20f480a423ea5feca81585aeeed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:06:50.672405 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [None req-dbc515ca-cd2a-44fd-8506-e4eac42be5b8 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] 10.222.0.50 "GET /compute/v2.1/servers/08fb826b-e891-46c4-990d-ca03cf3f4222" status: 200 len: 1805 microversion: 2.20 time: 0.162542 Sep 24 05:06:50.673145 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 364/700] 10.222.0.50 () {60 vars in 1277 bytes} [Sat Sep 24 05:06:50 2022] GET /compute/v2.1/servers/08fb826b-e891-46c4-990d-ca03cf3f4222 => generated 1805 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 05:06:50.986189 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-27eead73-e68d-43fe-800b-5c6780d8a239 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Calling method '>' {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:06:50.986833 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.compute.api [None req-27eead73-e68d-43fe-800b-5c6780d8a239 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] [instance: b2daebb8-dfea-4ab9-8253-008a21f906e1] Fetching instance by UUID {{(pid=120593) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:06:50.993972 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-27eead73-e68d-43fe-800b-5c6780d8a239 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:06:50.994475 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-27eead73-e68d-43fe-800b-5c6780d8a239 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:06:50.994912 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-27eead73-e68d-43fe-800b-5c6780d8a239 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:06:50.995601 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-27eead73-e68d-43fe-800b-5c6780d8a239 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:06:50.996054 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-27eead73-e68d-43fe-800b-5c6780d8a239 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:06:50.996478 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-27eead73-e68d-43fe-800b-5c6780d8a239 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:06:51.148015 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-27eead73-e68d-43fe-800b-5c6780d8a239 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b1b0448e7f54e3aaae49e411699269e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66ec8bde739145dda504995dbea0914a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:06:51.158528 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-27eead73-e68d-43fe-800b-5c6780d8a239 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] 10.222.0.50 "GET /compute/v2.1/servers/b2daebb8-dfea-4ab9-8253-008a21f906e1" status: 200 len: 1710 microversion: 2.1 time: 0.176013 Sep 24 05:06:51.159437 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 337/701] 10.222.0.50 () {58 vars in 1236 bytes} [Sat Sep 24 05:06:50 2022] GET /compute/v2.1/servers/b2daebb8-dfea-4ab9-8253-008a21f906e1 => generated 1710 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 05:06:51.699060 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-3b631679-ce83-4a2b-b099-d840ea74d411 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Calling method '>' {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:06:51.700438 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.compute.api [None req-3b631679-ce83-4a2b-b099-d840ea74d411 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] [instance: 08fb826b-e891-46c4-990d-ca03cf3f4222] Fetching instance by UUID {{(pid=120594) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:06:51.708070 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-3b631679-ce83-4a2b-b099-d840ea74d411 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:06:51.708640 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-3b631679-ce83-4a2b-b099-d840ea74d411 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:06:51.709145 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-3b631679-ce83-4a2b-b099-d840ea74d411 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:06:51.709856 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-3b631679-ce83-4a2b-b099-d840ea74d411 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:06:51.710333 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-3b631679-ce83-4a2b-b099-d840ea74d411 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:06:51.710755 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-3b631679-ce83-4a2b-b099-d840ea74d411 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:06:51.838378 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.policy [None req-3b631679-ce83-4a2b-b099-d840ea74d411 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0948754217fc4ff2ba0241fa35feaf90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1aaf20f480a423ea5feca81585aeeed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:06:51.846790 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.policy [None req-3b631679-ce83-4a2b-b099-d840ea74d411 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0948754217fc4ff2ba0241fa35feaf90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1aaf20f480a423ea5feca81585aeeed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:06:51.848228 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.policy [None req-3b631679-ce83-4a2b-b099-d840ea74d411 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0948754217fc4ff2ba0241fa35feaf90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1aaf20f480a423ea5feca81585aeeed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:06:51.849402 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [None req-3b631679-ce83-4a2b-b099-d840ea74d411 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] 10.222.0.50 "GET /compute/v2.1/servers/08fb826b-e891-46c4-990d-ca03cf3f4222" status: 200 len: 1805 microversion: 2.20 time: 0.154875 Sep 24 05:06:51.849962 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 365/702] 10.222.0.50 () {60 vars in 1277 bytes} [Sat Sep 24 05:06:51 2022] GET /compute/v2.1/servers/08fb826b-e891-46c4-990d-ca03cf3f4222 => generated 1805 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 05:06:52.194423 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-9ed5b863-9939-43ff-9afc-b6b4c368f12b tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Calling method '>' {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:06:52.196110 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.compute.api [None req-9ed5b863-9939-43ff-9afc-b6b4c368f12b tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] [instance: b2daebb8-dfea-4ab9-8253-008a21f906e1] Fetching instance by UUID {{(pid=120593) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:06:52.204568 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-9ed5b863-9939-43ff-9afc-b6b4c368f12b tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:06:52.205471 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-9ed5b863-9939-43ff-9afc-b6b4c368f12b tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:06:52.206406 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-9ed5b863-9939-43ff-9afc-b6b4c368f12b tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:06:52.207778 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-9ed5b863-9939-43ff-9afc-b6b4c368f12b tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:06:52.208507 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-9ed5b863-9939-43ff-9afc-b6b4c368f12b tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:06:52.209208 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-9ed5b863-9939-43ff-9afc-b6b4c368f12b tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:06:52.348241 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-9ed5b863-9939-43ff-9afc-b6b4c368f12b tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b1b0448e7f54e3aaae49e411699269e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66ec8bde739145dda504995dbea0914a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:06:52.357178 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-9ed5b863-9939-43ff-9afc-b6b4c368f12b tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] 10.222.0.50 "GET /compute/v2.1/servers/b2daebb8-dfea-4ab9-8253-008a21f906e1" status: 200 len: 1710 microversion: 2.1 time: 0.167162 Sep 24 05:06:52.357738 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 338/703] 10.222.0.50 () {58 vars in 1236 bytes} [Sat Sep 24 05:06:52 2022] GET /compute/v2.1/servers/b2daebb8-dfea-4ab9-8253-008a21f906e1 => generated 1710 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 05:06:52.875221 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-e8810e6a-9080-4756-814e-a1eba76f017d tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Calling method '>' {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:06:52.876068 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.compute.api [None req-e8810e6a-9080-4756-814e-a1eba76f017d tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] [instance: 08fb826b-e891-46c4-990d-ca03cf3f4222] Fetching instance by UUID {{(pid=120594) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:06:52.882942 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-e8810e6a-9080-4756-814e-a1eba76f017d tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:06:52.884098 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-e8810e6a-9080-4756-814e-a1eba76f017d tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:06:52.884539 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-e8810e6a-9080-4756-814e-a1eba76f017d tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:06:52.885317 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-e8810e6a-9080-4756-814e-a1eba76f017d tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:06:52.886027 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-e8810e6a-9080-4756-814e-a1eba76f017d tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:06:52.886521 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-e8810e6a-9080-4756-814e-a1eba76f017d tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:06:53.030322 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.policy [None req-e8810e6a-9080-4756-814e-a1eba76f017d tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0948754217fc4ff2ba0241fa35feaf90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1aaf20f480a423ea5feca81585aeeed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:06:53.032481 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG dbcounter [-] [120594] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=120594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 05:06:53.040333 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.policy [None req-e8810e6a-9080-4756-814e-a1eba76f017d tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0948754217fc4ff2ba0241fa35feaf90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1aaf20f480a423ea5feca81585aeeed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:06:53.041775 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.policy [None req-e8810e6a-9080-4756-814e-a1eba76f017d tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0948754217fc4ff2ba0241fa35feaf90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1aaf20f480a423ea5feca81585aeeed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:06:53.042946 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [None req-e8810e6a-9080-4756-814e-a1eba76f017d tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] 10.222.0.50 "GET /compute/v2.1/servers/08fb826b-e891-46c4-990d-ca03cf3f4222" status: 200 len: 1805 microversion: 2.20 time: 0.171772 Sep 24 05:06:53.043508 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 366/704] 10.222.0.50 () {60 vars in 1277 bytes} [Sat Sep 24 05:06:52 2022] GET /compute/v2.1/servers/08fb826b-e891-46c4-990d-ca03cf3f4222 => generated 1805 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 24 05:06:53.380513 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-a239956a-b879-46f8-958b-c6a4b45944b1 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Calling method '>' {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:06:53.381117 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.compute.api [None req-a239956a-b879-46f8-958b-c6a4b45944b1 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] [instance: b2daebb8-dfea-4ab9-8253-008a21f906e1] Fetching instance by UUID {{(pid=120593) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:06:53.387995 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-a239956a-b879-46f8-958b-c6a4b45944b1 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:06:53.388479 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-a239956a-b879-46f8-958b-c6a4b45944b1 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:06:53.388939 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-a239956a-b879-46f8-958b-c6a4b45944b1 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:06:53.389624 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-a239956a-b879-46f8-958b-c6a4b45944b1 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:06:53.390130 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-a239956a-b879-46f8-958b-c6a4b45944b1 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:06:53.390555 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-a239956a-b879-46f8-958b-c6a4b45944b1 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:06:53.516751 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-a239956a-b879-46f8-958b-c6a4b45944b1 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b1b0448e7f54e3aaae49e411699269e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66ec8bde739145dda504995dbea0914a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:06:53.525712 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-a239956a-b879-46f8-958b-c6a4b45944b1 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] 10.222.0.50 "GET /compute/v2.1/servers/b2daebb8-dfea-4ab9-8253-008a21f906e1" status: 200 len: 1710 microversion: 2.1 time: 0.149343 Sep 24 05:06:53.526318 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 339/705] 10.222.0.50 () {58 vars in 1236 bytes} [Sat Sep 24 05:06:53 2022] GET /compute/v2.1/servers/b2daebb8-dfea-4ab9-8253-008a21f906e1 => generated 1710 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 05:06:54.069524 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-b95bc5e2-2610-4925-a908-5273fb35de8e tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Calling method '>' {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:06:54.070262 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.compute.api [None req-b95bc5e2-2610-4925-a908-5273fb35de8e tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] [instance: 08fb826b-e891-46c4-990d-ca03cf3f4222] Fetching instance by UUID {{(pid=120594) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:06:54.077380 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-b95bc5e2-2610-4925-a908-5273fb35de8e tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:06:54.077890 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-b95bc5e2-2610-4925-a908-5273fb35de8e tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:06:54.078348 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-b95bc5e2-2610-4925-a908-5273fb35de8e tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:06:54.079037 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-b95bc5e2-2610-4925-a908-5273fb35de8e tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:06:54.079501 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-b95bc5e2-2610-4925-a908-5273fb35de8e tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:06:54.079920 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-b95bc5e2-2610-4925-a908-5273fb35de8e tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:06:54.210466 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.policy [None req-b95bc5e2-2610-4925-a908-5273fb35de8e tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0948754217fc4ff2ba0241fa35feaf90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1aaf20f480a423ea5feca81585aeeed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:06:54.219594 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.policy [None req-b95bc5e2-2610-4925-a908-5273fb35de8e tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0948754217fc4ff2ba0241fa35feaf90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1aaf20f480a423ea5feca81585aeeed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:06:54.221033 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.policy [None req-b95bc5e2-2610-4925-a908-5273fb35de8e tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0948754217fc4ff2ba0241fa35feaf90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1aaf20f480a423ea5feca81585aeeed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:06:54.222206 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [None req-b95bc5e2-2610-4925-a908-5273fb35de8e tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] 10.222.0.50 "GET /compute/v2.1/servers/08fb826b-e891-46c4-990d-ca03cf3f4222" status: 200 len: 1805 microversion: 2.20 time: 0.157310 Sep 24 05:06:54.222932 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 367/706] 10.222.0.50 () {60 vars in 1277 bytes} [Sat Sep 24 05:06:54 2022] GET /compute/v2.1/servers/08fb826b-e891-46c4-990d-ca03cf3f4222 => generated 1805 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 05:06:54.549523 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-6ad63e65-d6c6-440c-af97-0a5b8c3deaa6 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Calling method '>' {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:06:54.550167 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.compute.api [None req-6ad63e65-d6c6-440c-af97-0a5b8c3deaa6 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] [instance: b2daebb8-dfea-4ab9-8253-008a21f906e1] Fetching instance by UUID {{(pid=120593) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:06:54.556961 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-6ad63e65-d6c6-440c-af97-0a5b8c3deaa6 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:06:54.557434 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-6ad63e65-d6c6-440c-af97-0a5b8c3deaa6 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:06:54.557861 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-6ad63e65-d6c6-440c-af97-0a5b8c3deaa6 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:06:54.558566 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-6ad63e65-d6c6-440c-af97-0a5b8c3deaa6 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:06:54.559013 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-6ad63e65-d6c6-440c-af97-0a5b8c3deaa6 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:06:54.559429 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-6ad63e65-d6c6-440c-af97-0a5b8c3deaa6 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:06:54.702898 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-6ad63e65-d6c6-440c-af97-0a5b8c3deaa6 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b1b0448e7f54e3aaae49e411699269e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66ec8bde739145dda504995dbea0914a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:06:54.711231 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-6ad63e65-d6c6-440c-af97-0a5b8c3deaa6 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] 10.222.0.50 "GET /compute/v2.1/servers/b2daebb8-dfea-4ab9-8253-008a21f906e1" status: 200 len: 1710 microversion: 2.1 time: 0.166516 Sep 24 05:06:54.711849 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 340/707] 10.222.0.50 () {58 vars in 1236 bytes} [Sat Sep 24 05:06:54 2022] GET /compute/v2.1/servers/b2daebb8-dfea-4ab9-8253-008a21f906e1 => generated 1710 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 05:06:55.246975 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-ded1e182-82fe-493c-8a70-7990094df245 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Calling method '>' {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:06:55.247576 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.compute.api [None req-ded1e182-82fe-493c-8a70-7990094df245 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] [instance: 08fb826b-e891-46c4-990d-ca03cf3f4222] Fetching instance by UUID {{(pid=120594) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:06:55.253890 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-ded1e182-82fe-493c-8a70-7990094df245 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:06:55.254394 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-ded1e182-82fe-493c-8a70-7990094df245 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:06:55.254825 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-ded1e182-82fe-493c-8a70-7990094df245 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:06:55.255500 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-ded1e182-82fe-493c-8a70-7990094df245 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:06:55.255943 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-ded1e182-82fe-493c-8a70-7990094df245 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:06:55.256358 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-ded1e182-82fe-493c-8a70-7990094df245 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:06:55.385168 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.policy [None req-ded1e182-82fe-493c-8a70-7990094df245 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0948754217fc4ff2ba0241fa35feaf90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1aaf20f480a423ea5feca81585aeeed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:06:55.393766 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.policy [None req-ded1e182-82fe-493c-8a70-7990094df245 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0948754217fc4ff2ba0241fa35feaf90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1aaf20f480a423ea5feca81585aeeed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:06:55.395240 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.policy [None req-ded1e182-82fe-493c-8a70-7990094df245 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0948754217fc4ff2ba0241fa35feaf90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1aaf20f480a423ea5feca81585aeeed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:06:55.396381 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [None req-ded1e182-82fe-493c-8a70-7990094df245 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] 10.222.0.50 "GET /compute/v2.1/servers/08fb826b-e891-46c4-990d-ca03cf3f4222" status: 200 len: 1805 microversion: 2.20 time: 0.153381 Sep 24 05:06:55.396945 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 368/708] 10.222.0.50 () {60 vars in 1277 bytes} [Sat Sep 24 05:06:55 2022] GET /compute/v2.1/servers/08fb826b-e891-46c4-990d-ca03cf3f4222 => generated 1805 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 05:06:55.733849 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-36bfa306-c2cb-49c7-bf22-cb8b116a8448 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Calling method '>' {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:06:55.734498 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.compute.api [None req-36bfa306-c2cb-49c7-bf22-cb8b116a8448 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] [instance: b2daebb8-dfea-4ab9-8253-008a21f906e1] Fetching instance by UUID {{(pid=120593) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:06:55.740851 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-36bfa306-c2cb-49c7-bf22-cb8b116a8448 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:06:55.741326 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-36bfa306-c2cb-49c7-bf22-cb8b116a8448 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:06:55.741760 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-36bfa306-c2cb-49c7-bf22-cb8b116a8448 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:06:55.742477 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-36bfa306-c2cb-49c7-bf22-cb8b116a8448 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:06:55.743607 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-36bfa306-c2cb-49c7-bf22-cb8b116a8448 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:06:55.744031 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-36bfa306-c2cb-49c7-bf22-cb8b116a8448 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:06:55.867599 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-36bfa306-c2cb-49c7-bf22-cb8b116a8448 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b1b0448e7f54e3aaae49e411699269e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66ec8bde739145dda504995dbea0914a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:06:55.876251 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-36bfa306-c2cb-49c7-bf22-cb8b116a8448 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] 10.222.0.50 "GET /compute/v2.1/servers/b2daebb8-dfea-4ab9-8253-008a21f906e1" status: 200 len: 1710 microversion: 2.1 time: 0.146271 Sep 24 05:06:55.876806 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 341/709] 10.222.0.50 () {58 vars in 1236 bytes} [Sat Sep 24 05:06:55 2022] GET /compute/v2.1/servers/b2daebb8-dfea-4ab9-8253-008a21f906e1 => generated 1710 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 05:06:56.425988 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-05cc6391-3926-4973-8357-48f7b97ecb8b tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Calling method '>' {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:06:56.426605 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.compute.api [None req-05cc6391-3926-4973-8357-48f7b97ecb8b tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] [instance: 08fb826b-e891-46c4-990d-ca03cf3f4222] Fetching instance by UUID {{(pid=120594) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:06:56.433578 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-05cc6391-3926-4973-8357-48f7b97ecb8b tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:06:56.434077 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-05cc6391-3926-4973-8357-48f7b97ecb8b tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:06:56.434511 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-05cc6391-3926-4973-8357-48f7b97ecb8b tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:06:56.435185 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-05cc6391-3926-4973-8357-48f7b97ecb8b tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:06:56.435627 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-05cc6391-3926-4973-8357-48f7b97ecb8b tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:06:56.436041 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-05cc6391-3926-4973-8357-48f7b97ecb8b tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:06:56.564851 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.policy [None req-05cc6391-3926-4973-8357-48f7b97ecb8b tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0948754217fc4ff2ba0241fa35feaf90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1aaf20f480a423ea5feca81585aeeed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:06:56.574328 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.policy [None req-05cc6391-3926-4973-8357-48f7b97ecb8b tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0948754217fc4ff2ba0241fa35feaf90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1aaf20f480a423ea5feca81585aeeed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:06:56.575852 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.policy [None req-05cc6391-3926-4973-8357-48f7b97ecb8b tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0948754217fc4ff2ba0241fa35feaf90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1aaf20f480a423ea5feca81585aeeed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:06:56.576976 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [None req-05cc6391-3926-4973-8357-48f7b97ecb8b tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] 10.222.0.50 "GET /compute/v2.1/servers/08fb826b-e891-46c4-990d-ca03cf3f4222" status: 200 len: 1805 microversion: 2.20 time: 0.154907 Sep 24 05:06:56.577534 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 369/710] 10.222.0.50 () {60 vars in 1277 bytes} [Sat Sep 24 05:06:56 2022] GET /compute/v2.1/servers/08fb826b-e891-46c4-990d-ca03cf3f4222 => generated 1805 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 05:06:56.914021 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-ffde1dbf-170c-4e08-8dde-d4c5d4e44fab tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Calling method '>' {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:06:56.914645 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.compute.api [None req-ffde1dbf-170c-4e08-8dde-d4c5d4e44fab tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] [instance: b2daebb8-dfea-4ab9-8253-008a21f906e1] Fetching instance by UUID {{(pid=120593) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:06:56.920943 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-ffde1dbf-170c-4e08-8dde-d4c5d4e44fab tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:06:56.921501 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-ffde1dbf-170c-4e08-8dde-d4c5d4e44fab tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:06:56.921934 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-ffde1dbf-170c-4e08-8dde-d4c5d4e44fab tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:06:56.922680 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-ffde1dbf-170c-4e08-8dde-d4c5d4e44fab tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:06:56.923133 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-ffde1dbf-170c-4e08-8dde-d4c5d4e44fab tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:06:56.923555 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-ffde1dbf-170c-4e08-8dde-d4c5d4e44fab tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:06:57.057482 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-ffde1dbf-170c-4e08-8dde-d4c5d4e44fab tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b1b0448e7f54e3aaae49e411699269e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66ec8bde739145dda504995dbea0914a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:06:57.065901 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-ffde1dbf-170c-4e08-8dde-d4c5d4e44fab tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] 10.222.0.50 "GET /compute/v2.1/servers/b2daebb8-dfea-4ab9-8253-008a21f906e1" status: 200 len: 1710 microversion: 2.1 time: 0.155735 Sep 24 05:06:57.066510 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 342/711] 10.222.0.50 () {58 vars in 1236 bytes} [Sat Sep 24 05:06:56 2022] GET /compute/v2.1/servers/b2daebb8-dfea-4ab9-8253-008a21f906e1 => generated 1710 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 05:06:57.603114 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-57831770-c263-4282-8f17-e90171b4b8af tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Calling method '>' {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:06:57.603653 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.compute.api [None req-57831770-c263-4282-8f17-e90171b4b8af tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] [instance: 08fb826b-e891-46c4-990d-ca03cf3f4222] Fetching instance by UUID {{(pid=120594) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:06:57.610447 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-57831770-c263-4282-8f17-e90171b4b8af tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:06:57.610920 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-57831770-c263-4282-8f17-e90171b4b8af tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:06:57.611351 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-57831770-c263-4282-8f17-e90171b4b8af tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:06:57.612031 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-57831770-c263-4282-8f17-e90171b4b8af tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:06:57.612474 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-57831770-c263-4282-8f17-e90171b4b8af tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:06:57.612891 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-57831770-c263-4282-8f17-e90171b4b8af tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:06:57.745961 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.policy [None req-57831770-c263-4282-8f17-e90171b4b8af tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0948754217fc4ff2ba0241fa35feaf90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1aaf20f480a423ea5feca81585aeeed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:06:57.754741 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.policy [None req-57831770-c263-4282-8f17-e90171b4b8af tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0948754217fc4ff2ba0241fa35feaf90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1aaf20f480a423ea5feca81585aeeed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:06:57.756159 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.policy [None req-57831770-c263-4282-8f17-e90171b4b8af tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0948754217fc4ff2ba0241fa35feaf90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1aaf20f480a423ea5feca81585aeeed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:06:57.757385 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [None req-57831770-c263-4282-8f17-e90171b4b8af tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] 10.222.0.50 "GET /compute/v2.1/servers/08fb826b-e891-46c4-990d-ca03cf3f4222" status: 200 len: 1805 microversion: 2.20 time: 0.158905 Sep 24 05:06:57.758219 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 370/712] 10.222.0.50 () {60 vars in 1277 bytes} [Sat Sep 24 05:06:57 2022] GET /compute/v2.1/servers/08fb826b-e891-46c4-990d-ca03cf3f4222 => generated 1805 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 05:06:58.088887 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-9587466a-5185-4f46-8494-44fa1cfcf393 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Calling method '>' {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:06:58.089498 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.compute.api [None req-9587466a-5185-4f46-8494-44fa1cfcf393 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] [instance: b2daebb8-dfea-4ab9-8253-008a21f906e1] Fetching instance by UUID {{(pid=120593) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:06:58.095937 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-9587466a-5185-4f46-8494-44fa1cfcf393 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:06:58.096427 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-9587466a-5185-4f46-8494-44fa1cfcf393 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:06:58.096864 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-9587466a-5185-4f46-8494-44fa1cfcf393 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:06:58.097552 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-9587466a-5185-4f46-8494-44fa1cfcf393 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:06:58.098025 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-9587466a-5185-4f46-8494-44fa1cfcf393 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:06:58.098452 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-9587466a-5185-4f46-8494-44fa1cfcf393 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:06:58.229505 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-9587466a-5185-4f46-8494-44fa1cfcf393 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b1b0448e7f54e3aaae49e411699269e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66ec8bde739145dda504995dbea0914a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:06:58.237664 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-9587466a-5185-4f46-8494-44fa1cfcf393 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] 10.222.0.50 "GET /compute/v2.1/servers/b2daebb8-dfea-4ab9-8253-008a21f906e1" status: 200 len: 1710 microversion: 2.1 time: 0.152805 Sep 24 05:06:58.238255 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 343/713] 10.222.0.50 () {58 vars in 1236 bytes} [Sat Sep 24 05:06:58 2022] GET /compute/v2.1/servers/b2daebb8-dfea-4ab9-8253-008a21f906e1 => generated 1710 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 05:06:58.783399 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-ed183cdc-806c-4c4e-9067-7c67e9a1f23f tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Calling method '>' {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:06:58.784024 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.compute.api [None req-ed183cdc-806c-4c4e-9067-7c67e9a1f23f tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] [instance: 08fb826b-e891-46c4-990d-ca03cf3f4222] Fetching instance by UUID {{(pid=120594) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:06:58.790440 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-ed183cdc-806c-4c4e-9067-7c67e9a1f23f tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:06:58.790904 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-ed183cdc-806c-4c4e-9067-7c67e9a1f23f tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:06:58.791327 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-ed183cdc-806c-4c4e-9067-7c67e9a1f23f tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:06:58.792004 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-ed183cdc-806c-4c4e-9067-7c67e9a1f23f tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:06:58.792443 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-ed183cdc-806c-4c4e-9067-7c67e9a1f23f tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:06:58.792858 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-ed183cdc-806c-4c4e-9067-7c67e9a1f23f tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:06:58.932903 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.policy [None req-ed183cdc-806c-4c4e-9067-7c67e9a1f23f tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0948754217fc4ff2ba0241fa35feaf90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1aaf20f480a423ea5feca81585aeeed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:06:58.941833 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.policy [None req-ed183cdc-806c-4c4e-9067-7c67e9a1f23f tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0948754217fc4ff2ba0241fa35feaf90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1aaf20f480a423ea5feca81585aeeed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:06:58.943290 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.policy [None req-ed183cdc-806c-4c4e-9067-7c67e9a1f23f tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0948754217fc4ff2ba0241fa35feaf90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1aaf20f480a423ea5feca81585aeeed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:06:58.944429 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [None req-ed183cdc-806c-4c4e-9067-7c67e9a1f23f tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] 10.222.0.50 "GET /compute/v2.1/servers/08fb826b-e891-46c4-990d-ca03cf3f4222" status: 200 len: 1805 microversion: 2.20 time: 0.164976 Sep 24 05:06:58.944984 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 371/714] 10.222.0.50 () {60 vars in 1277 bytes} [Sat Sep 24 05:06:58 2022] GET /compute/v2.1/servers/08fb826b-e891-46c4-990d-ca03cf3f4222 => generated 1805 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 05:06:59.261201 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-f1782faf-636b-4c19-b9b4-6f33a35cd39e tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Calling method '>' {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:06:59.261809 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.compute.api [None req-f1782faf-636b-4c19-b9b4-6f33a35cd39e tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] [instance: b2daebb8-dfea-4ab9-8253-008a21f906e1] Fetching instance by UUID {{(pid=120593) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:06:59.268135 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-f1782faf-636b-4c19-b9b4-6f33a35cd39e tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:06:59.268613 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-f1782faf-636b-4c19-b9b4-6f33a35cd39e tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:06:59.269050 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-f1782faf-636b-4c19-b9b4-6f33a35cd39e tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:06:59.269737 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-f1782faf-636b-4c19-b9b4-6f33a35cd39e tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:06:59.270218 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-f1782faf-636b-4c19-b9b4-6f33a35cd39e tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:06:59.270641 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-f1782faf-636b-4c19-b9b4-6f33a35cd39e tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:06:59.402438 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-f1782faf-636b-4c19-b9b4-6f33a35cd39e tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b1b0448e7f54e3aaae49e411699269e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66ec8bde739145dda504995dbea0914a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:06:59.410519 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-f1782faf-636b-4c19-b9b4-6f33a35cd39e tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] 10.222.0.50 "GET /compute/v2.1/servers/b2daebb8-dfea-4ab9-8253-008a21f906e1" status: 200 len: 1714 microversion: 2.1 time: 0.153796 Sep 24 05:06:59.411091 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 344/715] 10.222.0.50 () {58 vars in 1236 bytes} [Sat Sep 24 05:06:59 2022] GET /compute/v2.1/servers/b2daebb8-dfea-4ab9-8253-008a21f906e1 => generated 1714 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 05:06:59.969939 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-63394501-71af-495f-a1a4-d428332a1bd2 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Calling method '>' {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:06:59.970586 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.compute.api [None req-63394501-71af-495f-a1a4-d428332a1bd2 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] [instance: 08fb826b-e891-46c4-990d-ca03cf3f4222] Fetching instance by UUID {{(pid=120594) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:06:59.976928 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-63394501-71af-495f-a1a4-d428332a1bd2 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:06:59.978031 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-63394501-71af-495f-a1a4-d428332a1bd2 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:06:59.978469 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-63394501-71af-495f-a1a4-d428332a1bd2 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:06:59.979153 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-63394501-71af-495f-a1a4-d428332a1bd2 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:06:59.979599 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-63394501-71af-495f-a1a4-d428332a1bd2 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:06:59.980017 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-63394501-71af-495f-a1a4-d428332a1bd2 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:07:00.109618 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.policy [None req-63394501-71af-495f-a1a4-d428332a1bd2 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0948754217fc4ff2ba0241fa35feaf90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1aaf20f480a423ea5feca81585aeeed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:07:00.118878 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.policy [None req-63394501-71af-495f-a1a4-d428332a1bd2 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0948754217fc4ff2ba0241fa35feaf90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1aaf20f480a423ea5feca81585aeeed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:07:00.120324 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.policy [None req-63394501-71af-495f-a1a4-d428332a1bd2 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0948754217fc4ff2ba0241fa35feaf90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1aaf20f480a423ea5feca81585aeeed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:07:00.121468 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [None req-63394501-71af-495f-a1a4-d428332a1bd2 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] 10.222.0.50 "GET /compute/v2.1/servers/08fb826b-e891-46c4-990d-ca03cf3f4222" status: 200 len: 1805 microversion: 2.20 time: 0.155443 Sep 24 05:07:00.122063 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 372/716] 10.222.0.50 () {60 vars in 1277 bytes} [Sat Sep 24 05:06:59 2022] GET /compute/v2.1/servers/08fb826b-e891-46c4-990d-ca03cf3f4222 => generated 1805 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 05:07:01.146765 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-f6b6e583-b2bf-47de-907d-b30523f1e7a6 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Calling method '>' {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:07:01.147340 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.compute.api [None req-f6b6e583-b2bf-47de-907d-b30523f1e7a6 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] [instance: 08fb826b-e891-46c4-990d-ca03cf3f4222] Fetching instance by UUID {{(pid=120593) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:07:01.154814 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-f6b6e583-b2bf-47de-907d-b30523f1e7a6 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:07:01.155294 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-f6b6e583-b2bf-47de-907d-b30523f1e7a6 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:07:01.155727 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-f6b6e583-b2bf-47de-907d-b30523f1e7a6 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:07:01.156412 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-f6b6e583-b2bf-47de-907d-b30523f1e7a6 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:07:01.156861 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-f6b6e583-b2bf-47de-907d-b30523f1e7a6 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:07:01.157310 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-f6b6e583-b2bf-47de-907d-b30523f1e7a6 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:07:01.282376 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-f6b6e583-b2bf-47de-907d-b30523f1e7a6 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0948754217fc4ff2ba0241fa35feaf90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1aaf20f480a423ea5feca81585aeeed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:07:01.291309 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-f6b6e583-b2bf-47de-907d-b30523f1e7a6 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0948754217fc4ff2ba0241fa35feaf90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1aaf20f480a423ea5feca81585aeeed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:07:01.292739 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-f6b6e583-b2bf-47de-907d-b30523f1e7a6 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0948754217fc4ff2ba0241fa35feaf90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1aaf20f480a423ea5feca81585aeeed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:07:01.293881 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-f6b6e583-b2bf-47de-907d-b30523f1e7a6 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] 10.222.0.50 "GET /compute/v2.1/servers/08fb826b-e891-46c4-990d-ca03cf3f4222" status: 200 len: 1805 microversion: 2.20 time: 0.151198 Sep 24 05:07:01.294468 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 345/717] 10.222.0.50 () {60 vars in 1277 bytes} [Sat Sep 24 05:07:01 2022] GET /compute/v2.1/servers/08fb826b-e891-46c4-990d-ca03cf3f4222 => generated 1805 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 05:07:02.320614 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-0d357df3-d804-41c5-86f3-41ef6033ab3e tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Calling method '>' {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:07:02.321493 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.compute.api [None req-0d357df3-d804-41c5-86f3-41ef6033ab3e tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] [instance: 08fb826b-e891-46c4-990d-ca03cf3f4222] Fetching instance by UUID {{(pid=120594) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:07:02.328683 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-0d357df3-d804-41c5-86f3-41ef6033ab3e tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:07:02.329161 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-0d357df3-d804-41c5-86f3-41ef6033ab3e tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:07:02.329593 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-0d357df3-d804-41c5-86f3-41ef6033ab3e tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:07:02.330435 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-0d357df3-d804-41c5-86f3-41ef6033ab3e tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:07:02.330882 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-0d357df3-d804-41c5-86f3-41ef6033ab3e tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:07:02.331424 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-0d357df3-d804-41c5-86f3-41ef6033ab3e tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:07:02.469127 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.policy [None req-0d357df3-d804-41c5-86f3-41ef6033ab3e tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0948754217fc4ff2ba0241fa35feaf90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1aaf20f480a423ea5feca81585aeeed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:07:02.478816 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.policy [None req-0d357df3-d804-41c5-86f3-41ef6033ab3e tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0948754217fc4ff2ba0241fa35feaf90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1aaf20f480a423ea5feca81585aeeed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:07:02.480365 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.policy [None req-0d357df3-d804-41c5-86f3-41ef6033ab3e tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0948754217fc4ff2ba0241fa35feaf90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1aaf20f480a423ea5feca81585aeeed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:07:02.481547 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [None req-0d357df3-d804-41c5-86f3-41ef6033ab3e tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] 10.222.0.50 "GET /compute/v2.1/servers/08fb826b-e891-46c4-990d-ca03cf3f4222" status: 200 len: 1805 microversion: 2.20 time: 0.166184 Sep 24 05:07:02.482322 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 373/718] 10.222.0.50 () {60 vars in 1277 bytes} [Sat Sep 24 05:07:02 2022] GET /compute/v2.1/servers/08fb826b-e891-46c4-990d-ca03cf3f4222 => generated 1805 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 05:07:03.009144 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-ac5f2a8a-7676-443a-b0c5-dc7beb42369f tempest-VolumesSnapshotTestJSON-4159203 tempest-VolumesSnapshotTestJSON-4159203-project] Calling method '>' {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:07:03.009661 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.compute.api [None req-ac5f2a8a-7676-443a-b0c5-dc7beb42369f tempest-VolumesSnapshotTestJSON-4159203 tempest-VolumesSnapshotTestJSON-4159203-project] [instance: 87e09804-74dc-4329-97d5-02be092fd866] Fetching instance by UUID {{(pid=120593) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:07:03.015935 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-ac5f2a8a-7676-443a-b0c5-dc7beb42369f tempest-VolumesSnapshotTestJSON-4159203 tempest-VolumesSnapshotTestJSON-4159203-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:07:03.016412 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-ac5f2a8a-7676-443a-b0c5-dc7beb42369f tempest-VolumesSnapshotTestJSON-4159203 tempest-VolumesSnapshotTestJSON-4159203-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:07:03.016841 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-ac5f2a8a-7676-443a-b0c5-dc7beb42369f tempest-VolumesSnapshotTestJSON-4159203 tempest-VolumesSnapshotTestJSON-4159203-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:07:03.017518 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-ac5f2a8a-7676-443a-b0c5-dc7beb42369f tempest-VolumesSnapshotTestJSON-4159203 tempest-VolumesSnapshotTestJSON-4159203-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:07:03.017964 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-ac5f2a8a-7676-443a-b0c5-dc7beb42369f tempest-VolumesSnapshotTestJSON-4159203 tempest-VolumesSnapshotTestJSON-4159203-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:07:03.018405 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-ac5f2a8a-7676-443a-b0c5-dc7beb42369f tempest-VolumesSnapshotTestJSON-4159203 tempest-VolumesSnapshotTestJSON-4159203-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:07:03.022301 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG dbcounter [-] [120593] Writing DB stats nova_cell1:SELECT=100 {{(pid=120593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 05:07:03.044910 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.compute.api [None req-ac5f2a8a-7676-443a-b0c5-dc7beb42369f tempest-VolumesSnapshotTestJSON-4159203 tempest-VolumesSnapshotTestJSON-4159203-project] [instance: 87e09804-74dc-4329-97d5-02be092fd866] Going to try to terminate instance {{(pid=120593) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 24 05:07:03.126185 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-ac5f2a8a-7676-443a-b0c5-dc7beb42369f tempest-VolumesSnapshotTestJSON-4159203 tempest-VolumesSnapshotTestJSON-4159203-project] 10.222.0.50 "DELETE /compute/v2.1/servers/87e09804-74dc-4329-97d5-02be092fd866" status: 204 len: 0 microversion: 2.1 time: 0.121094 Sep 24 05:07:03.126768 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 346/719] 10.222.0.50 () {58 vars in 1239 bytes} [Sat Sep 24 05:07:03 2022] DELETE /compute/v2.1/servers/87e09804-74dc-4329-97d5-02be092fd866 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 24 05:07:03.134795 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-c9ca5775-567a-4240-9d02-b0af0b864785 tempest-VolumesSnapshotTestJSON-4159203 tempest-VolumesSnapshotTestJSON-4159203-project] Calling method '>' {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:07:03.135407 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.compute.api [None req-c9ca5775-567a-4240-9d02-b0af0b864785 tempest-VolumesSnapshotTestJSON-4159203 tempest-VolumesSnapshotTestJSON-4159203-project] [instance: 87e09804-74dc-4329-97d5-02be092fd866] Fetching instance by UUID {{(pid=120594) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:07:03.141271 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-c9ca5775-567a-4240-9d02-b0af0b864785 tempest-VolumesSnapshotTestJSON-4159203 tempest-VolumesSnapshotTestJSON-4159203-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:07:03.141753 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-c9ca5775-567a-4240-9d02-b0af0b864785 tempest-VolumesSnapshotTestJSON-4159203 tempest-VolumesSnapshotTestJSON-4159203-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:07:03.142231 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-c9ca5775-567a-4240-9d02-b0af0b864785 tempest-VolumesSnapshotTestJSON-4159203 tempest-VolumesSnapshotTestJSON-4159203-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:07:03.142953 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-c9ca5775-567a-4240-9d02-b0af0b864785 tempest-VolumesSnapshotTestJSON-4159203 tempest-VolumesSnapshotTestJSON-4159203-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:07:03.143406 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-c9ca5775-567a-4240-9d02-b0af0b864785 tempest-VolumesSnapshotTestJSON-4159203 tempest-VolumesSnapshotTestJSON-4159203-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:07:03.143833 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-c9ca5775-567a-4240-9d02-b0af0b864785 tempest-VolumesSnapshotTestJSON-4159203 tempest-VolumesSnapshotTestJSON-4159203-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:07:03.273648 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.policy [None req-c9ca5775-567a-4240-9d02-b0af0b864785 tempest-VolumesSnapshotTestJSON-4159203 tempest-VolumesSnapshotTestJSON-4159203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '358ce5f5c35f415eb79322ae6d187b1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e942295e9b3478abd521c6f3e60e888', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:07:03.282142 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [None req-c9ca5775-567a-4240-9d02-b0af0b864785 tempest-VolumesSnapshotTestJSON-4159203 tempest-VolumesSnapshotTestJSON-4159203-project] 10.222.0.50 "GET /compute/v2.1/servers/87e09804-74dc-4329-97d5-02be092fd866" status: 200 len: 1514 microversion: 2.1 time: 0.151124 Sep 24 05:07:03.282714 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 374/720] 10.222.0.50 () {58 vars in 1236 bytes} [Sat Sep 24 05:07:03 2022] GET /compute/v2.1/servers/87e09804-74dc-4329-97d5-02be092fd866 => generated 1514 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 05:07:03.508099 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-4878cac7-e2c8-4593-a667-98220884e11e tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Calling method '>' {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:07:03.511133 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.compute.api [None req-4878cac7-e2c8-4593-a667-98220884e11e tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] [instance: 08fb826b-e891-46c4-990d-ca03cf3f4222] Fetching instance by UUID {{(pid=120593) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:07:03.516964 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-4878cac7-e2c8-4593-a667-98220884e11e tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:07:03.517438 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-4878cac7-e2c8-4593-a667-98220884e11e tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:07:03.517869 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-4878cac7-e2c8-4593-a667-98220884e11e tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:07:03.518581 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-4878cac7-e2c8-4593-a667-98220884e11e tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:07:03.519030 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-4878cac7-e2c8-4593-a667-98220884e11e tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:07:03.519448 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-4878cac7-e2c8-4593-a667-98220884e11e tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:07:03.648926 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-4878cac7-e2c8-4593-a667-98220884e11e tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0948754217fc4ff2ba0241fa35feaf90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1aaf20f480a423ea5feca81585aeeed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:07:03.659197 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-4878cac7-e2c8-4593-a667-98220884e11e tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0948754217fc4ff2ba0241fa35feaf90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1aaf20f480a423ea5feca81585aeeed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:07:03.660693 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-4878cac7-e2c8-4593-a667-98220884e11e tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0948754217fc4ff2ba0241fa35feaf90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1aaf20f480a423ea5feca81585aeeed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:07:03.661928 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-4878cac7-e2c8-4593-a667-98220884e11e tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] 10.222.0.50 "GET /compute/v2.1/servers/08fb826b-e891-46c4-990d-ca03cf3f4222" status: 200 len: 1805 microversion: 2.20 time: 0.158075 Sep 24 05:07:03.662584 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 347/721] 10.222.0.50 () {60 vars in 1277 bytes} [Sat Sep 24 05:07:03 2022] GET /compute/v2.1/servers/08fb826b-e891-46c4-990d-ca03cf3f4222 => generated 1805 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 05:07:04.304703 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-03b5edca-ae2a-4994-a8f9-7e9741aa6a3f tempest-VolumesSnapshotTestJSON-4159203 tempest-VolumesSnapshotTestJSON-4159203-project] Calling method '>' {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:07:04.305347 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.compute.api [None req-03b5edca-ae2a-4994-a8f9-7e9741aa6a3f tempest-VolumesSnapshotTestJSON-4159203 tempest-VolumesSnapshotTestJSON-4159203-project] [instance: 87e09804-74dc-4329-97d5-02be092fd866] Fetching instance by UUID {{(pid=120594) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:07:04.311892 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-03b5edca-ae2a-4994-a8f9-7e9741aa6a3f tempest-VolumesSnapshotTestJSON-4159203 tempest-VolumesSnapshotTestJSON-4159203-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:07:04.312370 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-03b5edca-ae2a-4994-a8f9-7e9741aa6a3f tempest-VolumesSnapshotTestJSON-4159203 tempest-VolumesSnapshotTestJSON-4159203-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:07:04.312806 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-03b5edca-ae2a-4994-a8f9-7e9741aa6a3f tempest-VolumesSnapshotTestJSON-4159203 tempest-VolumesSnapshotTestJSON-4159203-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:07:04.313520 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-03b5edca-ae2a-4994-a8f9-7e9741aa6a3f tempest-VolumesSnapshotTestJSON-4159203 tempest-VolumesSnapshotTestJSON-4159203-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:07:04.313966 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-03b5edca-ae2a-4994-a8f9-7e9741aa6a3f tempest-VolumesSnapshotTestJSON-4159203 tempest-VolumesSnapshotTestJSON-4159203-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:07:04.314417 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-03b5edca-ae2a-4994-a8f9-7e9741aa6a3f tempest-VolumesSnapshotTestJSON-4159203 tempest-VolumesSnapshotTestJSON-4159203-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:07:04.448638 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.policy [None req-03b5edca-ae2a-4994-a8f9-7e9741aa6a3f tempest-VolumesSnapshotTestJSON-4159203 tempest-VolumesSnapshotTestJSON-4159203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '358ce5f5c35f415eb79322ae6d187b1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e942295e9b3478abd521c6f3e60e888', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:07:04.456176 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [None req-03b5edca-ae2a-4994-a8f9-7e9741aa6a3f tempest-VolumesSnapshotTestJSON-4159203 tempest-VolumesSnapshotTestJSON-4159203-project] 10.222.0.50 "GET /compute/v2.1/servers/87e09804-74dc-4329-97d5-02be092fd866" status: 200 len: 1514 microversion: 2.1 time: 0.155424 Sep 24 05:07:04.456732 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 375/722] 10.222.0.50 () {58 vars in 1236 bytes} [Sat Sep 24 05:07:04 2022] GET /compute/v2.1/servers/87e09804-74dc-4329-97d5-02be092fd866 => generated 1514 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 05:07:04.687776 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-6659b111-a356-4eb4-9f2e-2483e827ec24 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Calling method '>' {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:07:04.688385 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.compute.api [None req-6659b111-a356-4eb4-9f2e-2483e827ec24 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] [instance: 08fb826b-e891-46c4-990d-ca03cf3f4222] Fetching instance by UUID {{(pid=120593) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:07:04.694988 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-6659b111-a356-4eb4-9f2e-2483e827ec24 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:07:04.695466 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-6659b111-a356-4eb4-9f2e-2483e827ec24 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:07:04.695898 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-6659b111-a356-4eb4-9f2e-2483e827ec24 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:07:04.696595 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-6659b111-a356-4eb4-9f2e-2483e827ec24 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:07:04.697047 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-6659b111-a356-4eb4-9f2e-2483e827ec24 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:07:04.697466 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-6659b111-a356-4eb4-9f2e-2483e827ec24 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:07:04.830141 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-6659b111-a356-4eb4-9f2e-2483e827ec24 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0948754217fc4ff2ba0241fa35feaf90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1aaf20f480a423ea5feca81585aeeed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:07:04.838572 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-6659b111-a356-4eb4-9f2e-2483e827ec24 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0948754217fc4ff2ba0241fa35feaf90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1aaf20f480a423ea5feca81585aeeed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:07:04.839989 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-6659b111-a356-4eb4-9f2e-2483e827ec24 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0948754217fc4ff2ba0241fa35feaf90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1aaf20f480a423ea5feca81585aeeed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:07:04.841118 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-6659b111-a356-4eb4-9f2e-2483e827ec24 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] 10.222.0.50 "GET /compute/v2.1/servers/08fb826b-e891-46c4-990d-ca03cf3f4222" status: 200 len: 1805 microversion: 2.20 time: 0.157326 Sep 24 05:07:04.841665 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 348/723] 10.222.0.50 () {60 vars in 1277 bytes} [Sat Sep 24 05:07:04 2022] GET /compute/v2.1/servers/08fb826b-e891-46c4-990d-ca03cf3f4222 => generated 1805 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 05:07:05.478695 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-d8a1405c-d3fc-4140-9e94-aa4e17d1594d tempest-VolumesSnapshotTestJSON-4159203 tempest-VolumesSnapshotTestJSON-4159203-project] Calling method '>' {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:07:05.479317 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.compute.api [None req-d8a1405c-d3fc-4140-9e94-aa4e17d1594d tempest-VolumesSnapshotTestJSON-4159203 tempest-VolumesSnapshotTestJSON-4159203-project] [instance: 87e09804-74dc-4329-97d5-02be092fd866] Fetching instance by UUID {{(pid=120594) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:07:05.485964 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-d8a1405c-d3fc-4140-9e94-aa4e17d1594d tempest-VolumesSnapshotTestJSON-4159203 tempest-VolumesSnapshotTestJSON-4159203-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:07:05.486487 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-d8a1405c-d3fc-4140-9e94-aa4e17d1594d tempest-VolumesSnapshotTestJSON-4159203 tempest-VolumesSnapshotTestJSON-4159203-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:07:05.486966 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-d8a1405c-d3fc-4140-9e94-aa4e17d1594d tempest-VolumesSnapshotTestJSON-4159203 tempest-VolumesSnapshotTestJSON-4159203-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:07:05.487698 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-d8a1405c-d3fc-4140-9e94-aa4e17d1594d tempest-VolumesSnapshotTestJSON-4159203 tempest-VolumesSnapshotTestJSON-4159203-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:07:05.488188 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-d8a1405c-d3fc-4140-9e94-aa4e17d1594d tempest-VolumesSnapshotTestJSON-4159203 tempest-VolumesSnapshotTestJSON-4159203-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:07:05.488643 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-d8a1405c-d3fc-4140-9e94-aa4e17d1594d tempest-VolumesSnapshotTestJSON-4159203 tempest-VolumesSnapshotTestJSON-4159203-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:07:05.619024 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.policy [None req-d8a1405c-d3fc-4140-9e94-aa4e17d1594d tempest-VolumesSnapshotTestJSON-4159203 tempest-VolumesSnapshotTestJSON-4159203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '358ce5f5c35f415eb79322ae6d187b1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e942295e9b3478abd521c6f3e60e888', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:07:05.626582 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [None req-d8a1405c-d3fc-4140-9e94-aa4e17d1594d tempest-VolumesSnapshotTestJSON-4159203 tempest-VolumesSnapshotTestJSON-4159203-project] 10.222.0.50 "GET /compute/v2.1/servers/87e09804-74dc-4329-97d5-02be092fd866" status: 200 len: 1514 microversion: 2.1 time: 0.151720 Sep 24 05:07:05.627147 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 376/724] 10.222.0.50 () {58 vars in 1236 bytes} [Sat Sep 24 05:07:05 2022] GET /compute/v2.1/servers/87e09804-74dc-4329-97d5-02be092fd866 => generated 1514 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 05:07:05.865924 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-18bd28d8-1f03-4f34-a1c0-669938adce5c tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Calling method '>' {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:07:05.866555 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.compute.api [None req-18bd28d8-1f03-4f34-a1c0-669938adce5c tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] [instance: 08fb826b-e891-46c4-990d-ca03cf3f4222] Fetching instance by UUID {{(pid=120593) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:07:05.869002 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG dbcounter [-] [120593] Writing DB stats nova_api:SELECT=65,nova_api:UPDATE=1 {{(pid=120593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 05:07:05.874393 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-18bd28d8-1f03-4f34-a1c0-669938adce5c tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:07:05.874883 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-18bd28d8-1f03-4f34-a1c0-669938adce5c tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:07:05.875326 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-18bd28d8-1f03-4f34-a1c0-669938adce5c tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:07:05.876027 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-18bd28d8-1f03-4f34-a1c0-669938adce5c tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:07:05.876485 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-18bd28d8-1f03-4f34-a1c0-669938adce5c tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:07:05.876914 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-18bd28d8-1f03-4f34-a1c0-669938adce5c tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:07:06.004707 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-18bd28d8-1f03-4f34-a1c0-669938adce5c tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0948754217fc4ff2ba0241fa35feaf90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1aaf20f480a423ea5feca81585aeeed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:07:06.013364 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-18bd28d8-1f03-4f34-a1c0-669938adce5c tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0948754217fc4ff2ba0241fa35feaf90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1aaf20f480a423ea5feca81585aeeed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:07:06.014838 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-18bd28d8-1f03-4f34-a1c0-669938adce5c tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0948754217fc4ff2ba0241fa35feaf90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1aaf20f480a423ea5feca81585aeeed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:07:06.015993 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-18bd28d8-1f03-4f34-a1c0-669938adce5c tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] 10.222.0.50 "GET /compute/v2.1/servers/08fb826b-e891-46c4-990d-ca03cf3f4222" status: 200 len: 1805 microversion: 2.20 time: 0.154072 Sep 24 05:07:06.016769 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 349/725] 10.222.0.50 () {60 vars in 1277 bytes} [Sat Sep 24 05:07:05 2022] GET /compute/v2.1/servers/08fb826b-e891-46c4-990d-ca03cf3f4222 => generated 1805 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 05:07:06.189092 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [req-9d7bb3fb-6955-43d6-a781-808151653850 req-7e554b4e-af39-4d1e-836b-c16c3df45022 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "87e09804-74dc-4329-97d5-02be092fd866", "name": "network-vif-deleted", "tag": "3709860a-1e61-4d69-8a8e-fb0135138d67"}]} {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 05:07:06.199705 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [req-9d7bb3fb-6955-43d6-a781-808151653850 req-7e554b4e-af39-4d1e-836b-c16c3df45022 service nova] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:07:06.200183 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [req-9d7bb3fb-6955-43d6-a781-808151653850 req-7e554b4e-af39-4d1e-836b-c16c3df45022 service nova] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:07:06.200635 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [req-9d7bb3fb-6955-43d6-a781-808151653850 req-7e554b4e-af39-4d1e-836b-c16c3df45022 service nova] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:07:06.211533 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: INFO nova.api.openstack.compute.server_external_events [req-9d7bb3fb-6955-43d6-a781-808151653850 req-7e554b4e-af39-4d1e-836b-c16c3df45022 service nova] Creating event network-vif-deleted:3709860a-1e61-4d69-8a8e-fb0135138d67 for instance 87e09804-74dc-4329-97d5-02be092fd866 on hv-cinder-85918 Sep 24 05:07:06.217459 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [req-9d7bb3fb-6955-43d6-a781-808151653850 req-7e554b4e-af39-4d1e-836b-c16c3df45022 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032529 Sep 24 05:07:06.218132 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 377/726] 10.222.0.50 () {64 vars in 1317 bytes} [Sat Sep 24 05:07:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 05:07:06.649702 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-2229eb07-a1e8-48a2-8a92-0bb495e364d5 tempest-VolumesSnapshotTestJSON-4159203 tempest-VolumesSnapshotTestJSON-4159203-project] Calling method '>' {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:07:06.650267 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.compute.api [None req-2229eb07-a1e8-48a2-8a92-0bb495e364d5 tempest-VolumesSnapshotTestJSON-4159203 tempest-VolumesSnapshotTestJSON-4159203-project] [instance: 87e09804-74dc-4329-97d5-02be092fd866] Fetching instance by UUID {{(pid=120593) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:07:06.656428 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-2229eb07-a1e8-48a2-8a92-0bb495e364d5 tempest-VolumesSnapshotTestJSON-4159203 tempest-VolumesSnapshotTestJSON-4159203-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:07:06.656907 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-2229eb07-a1e8-48a2-8a92-0bb495e364d5 tempest-VolumesSnapshotTestJSON-4159203 tempest-VolumesSnapshotTestJSON-4159203-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:07:06.657339 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-2229eb07-a1e8-48a2-8a92-0bb495e364d5 tempest-VolumesSnapshotTestJSON-4159203 tempest-VolumesSnapshotTestJSON-4159203-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:07:06.658053 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-2229eb07-a1e8-48a2-8a92-0bb495e364d5 tempest-VolumesSnapshotTestJSON-4159203 tempest-VolumesSnapshotTestJSON-4159203-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:07:06.658510 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-2229eb07-a1e8-48a2-8a92-0bb495e364d5 tempest-VolumesSnapshotTestJSON-4159203 tempest-VolumesSnapshotTestJSON-4159203-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:07:06.658935 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-2229eb07-a1e8-48a2-8a92-0bb495e364d5 tempest-VolumesSnapshotTestJSON-4159203 tempest-VolumesSnapshotTestJSON-4159203-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:07:06.689906 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-2229eb07-a1e8-48a2-8a92-0bb495e364d5 tempest-VolumesSnapshotTestJSON-4159203 tempest-VolumesSnapshotTestJSON-4159203-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:07:06.690425 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-2229eb07-a1e8-48a2-8a92-0bb495e364d5 tempest-VolumesSnapshotTestJSON-4159203 tempest-VolumesSnapshotTestJSON-4159203-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:07:06.690847 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-2229eb07-a1e8-48a2-8a92-0bb495e364d5 tempest-VolumesSnapshotTestJSON-4159203 tempest-VolumesSnapshotTestJSON-4159203-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:07:06.691287 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.objects.instance [None req-2229eb07-a1e8-48a2-8a92-0bb495e364d5 tempest-VolumesSnapshotTestJSON-4159203 tempest-VolumesSnapshotTestJSON-4159203-project] Lazy-loading 'fault' on Instance uuid 87e09804-74dc-4329-97d5-02be092fd866 {{(pid=120593) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 24 05:07:06.737990 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-2229eb07-a1e8-48a2-8a92-0bb495e364d5 tempest-VolumesSnapshotTestJSON-4159203 tempest-VolumesSnapshotTestJSON-4159203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '358ce5f5c35f415eb79322ae6d187b1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e942295e9b3478abd521c6f3e60e888', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:07:06.745597 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-2229eb07-a1e8-48a2-8a92-0bb495e364d5 tempest-VolumesSnapshotTestJSON-4159203 tempest-VolumesSnapshotTestJSON-4159203-project] 10.222.0.50 "GET /compute/v2.1/servers/87e09804-74dc-4329-97d5-02be092fd866" status: 200 len: 1309 microversion: 2.1 time: 0.099925 Sep 24 05:07:06.746181 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 350/727] 10.222.0.50 () {58 vars in 1236 bytes} [Sat Sep 24 05:07:06 2022] GET /compute/v2.1/servers/87e09804-74dc-4329-97d5-02be092fd866 => generated 1309 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 05:07:07.043495 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-0fc857c6-bd26-406e-8d78-0ffdc5e6cc0a tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Calling method '>' {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:07:07.044214 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.compute.api [None req-0fc857c6-bd26-406e-8d78-0ffdc5e6cc0a tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] [instance: 08fb826b-e891-46c4-990d-ca03cf3f4222] Fetching instance by UUID {{(pid=120594) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:07:07.050354 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-0fc857c6-bd26-406e-8d78-0ffdc5e6cc0a tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:07:07.050828 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-0fc857c6-bd26-406e-8d78-0ffdc5e6cc0a tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:07:07.051258 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-0fc857c6-bd26-406e-8d78-0ffdc5e6cc0a tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:07:07.051935 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-0fc857c6-bd26-406e-8d78-0ffdc5e6cc0a tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:07:07.052380 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-0fc857c6-bd26-406e-8d78-0ffdc5e6cc0a tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:07:07.052794 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-0fc857c6-bd26-406e-8d78-0ffdc5e6cc0a tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:07:07.183852 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.policy [None req-0fc857c6-bd26-406e-8d78-0ffdc5e6cc0a tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0948754217fc4ff2ba0241fa35feaf90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1aaf20f480a423ea5feca81585aeeed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:07:07.192193 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.policy [None req-0fc857c6-bd26-406e-8d78-0ffdc5e6cc0a tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0948754217fc4ff2ba0241fa35feaf90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1aaf20f480a423ea5feca81585aeeed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:07:07.193618 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.policy [None req-0fc857c6-bd26-406e-8d78-0ffdc5e6cc0a tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0948754217fc4ff2ba0241fa35feaf90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1aaf20f480a423ea5feca81585aeeed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:07:07.194780 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [None req-0fc857c6-bd26-406e-8d78-0ffdc5e6cc0a tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] 10.222.0.50 "GET /compute/v2.1/servers/08fb826b-e891-46c4-990d-ca03cf3f4222" status: 200 len: 1805 microversion: 2.20 time: 0.156590 Sep 24 05:07:07.195333 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 378/728] 10.222.0.50 () {60 vars in 1277 bytes} [Sat Sep 24 05:07:07 2022] GET /compute/v2.1/servers/08fb826b-e891-46c4-990d-ca03cf3f4222 => generated 1805 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 05:07:07.768354 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-877f9f54-7dfa-418f-b3f6-c346423604e1 tempest-VolumesSnapshotTestJSON-4159203 tempest-VolumesSnapshotTestJSON-4159203-project] Calling method '>' {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:07:07.768961 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.compute.api [None req-877f9f54-7dfa-418f-b3f6-c346423604e1 tempest-VolumesSnapshotTestJSON-4159203 tempest-VolumesSnapshotTestJSON-4159203-project] [instance: 87e09804-74dc-4329-97d5-02be092fd866] Fetching instance by UUID {{(pid=120593) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:07:07.776468 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-877f9f54-7dfa-418f-b3f6-c346423604e1 tempest-VolumesSnapshotTestJSON-4159203 tempest-VolumesSnapshotTestJSON-4159203-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:07:07.776968 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-877f9f54-7dfa-418f-b3f6-c346423604e1 tempest-VolumesSnapshotTestJSON-4159203 tempest-VolumesSnapshotTestJSON-4159203-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:07:07.777405 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-877f9f54-7dfa-418f-b3f6-c346423604e1 tempest-VolumesSnapshotTestJSON-4159203 tempest-VolumesSnapshotTestJSON-4159203-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:07:07.778130 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-877f9f54-7dfa-418f-b3f6-c346423604e1 tempest-VolumesSnapshotTestJSON-4159203 tempest-VolumesSnapshotTestJSON-4159203-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:07:07.778582 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-877f9f54-7dfa-418f-b3f6-c346423604e1 tempest-VolumesSnapshotTestJSON-4159203 tempest-VolumesSnapshotTestJSON-4159203-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:07:07.779002 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-877f9f54-7dfa-418f-b3f6-c346423604e1 tempest-VolumesSnapshotTestJSON-4159203 tempest-VolumesSnapshotTestJSON-4159203-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:07:07.808795 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-877f9f54-7dfa-418f-b3f6-c346423604e1 tempest-VolumesSnapshotTestJSON-4159203 tempest-VolumesSnapshotTestJSON-4159203-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:07:07.809259 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-877f9f54-7dfa-418f-b3f6-c346423604e1 tempest-VolumesSnapshotTestJSON-4159203 tempest-VolumesSnapshotTestJSON-4159203-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:07:07.809684 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-877f9f54-7dfa-418f-b3f6-c346423604e1 tempest-VolumesSnapshotTestJSON-4159203 tempest-VolumesSnapshotTestJSON-4159203-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:07:07.810142 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.objects.instance [None req-877f9f54-7dfa-418f-b3f6-c346423604e1 tempest-VolumesSnapshotTestJSON-4159203 tempest-VolumesSnapshotTestJSON-4159203-project] Lazy-loading 'fault' on Instance uuid 87e09804-74dc-4329-97d5-02be092fd866 {{(pid=120593) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 24 05:07:07.850248 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-877f9f54-7dfa-418f-b3f6-c346423604e1 tempest-VolumesSnapshotTestJSON-4159203 tempest-VolumesSnapshotTestJSON-4159203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '358ce5f5c35f415eb79322ae6d187b1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e942295e9b3478abd521c6f3e60e888', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:07:07.857858 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-877f9f54-7dfa-418f-b3f6-c346423604e1 tempest-VolumesSnapshotTestJSON-4159203 tempest-VolumesSnapshotTestJSON-4159203-project] 10.222.0.50 "GET /compute/v2.1/servers/87e09804-74dc-4329-97d5-02be092fd866" status: 200 len: 1309 microversion: 2.1 time: 0.093384 Sep 24 05:07:07.858448 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 351/729] 10.222.0.50 () {58 vars in 1236 bytes} [Sat Sep 24 05:07:07 2022] GET /compute/v2.1/servers/87e09804-74dc-4329-97d5-02be092fd866 => generated 1309 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 05:07:08.220034 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-c88f87c2-6e73-4b0e-a524-b7739b0a4198 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Calling method '>' {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:07:08.220637 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.compute.api [None req-c88f87c2-6e73-4b0e-a524-b7739b0a4198 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] [instance: 08fb826b-e891-46c4-990d-ca03cf3f4222] Fetching instance by UUID {{(pid=120594) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:07:08.227086 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-c88f87c2-6e73-4b0e-a524-b7739b0a4198 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:07:08.227504 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-c88f87c2-6e73-4b0e-a524-b7739b0a4198 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:07:08.227935 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-c88f87c2-6e73-4b0e-a524-b7739b0a4198 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:07:08.228682 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-c88f87c2-6e73-4b0e-a524-b7739b0a4198 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:07:08.229126 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-c88f87c2-6e73-4b0e-a524-b7739b0a4198 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:07:08.229547 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-c88f87c2-6e73-4b0e-a524-b7739b0a4198 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:07:08.357988 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.policy [None req-c88f87c2-6e73-4b0e-a524-b7739b0a4198 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0948754217fc4ff2ba0241fa35feaf90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1aaf20f480a423ea5feca81585aeeed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:07:08.372786 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.policy [None req-c88f87c2-6e73-4b0e-a524-b7739b0a4198 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0948754217fc4ff2ba0241fa35feaf90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1aaf20f480a423ea5feca81585aeeed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:07:08.374522 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.policy [None req-c88f87c2-6e73-4b0e-a524-b7739b0a4198 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0948754217fc4ff2ba0241fa35feaf90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1aaf20f480a423ea5feca81585aeeed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:07:08.375876 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [None req-c88f87c2-6e73-4b0e-a524-b7739b0a4198 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] 10.222.0.50 "GET /compute/v2.1/servers/08fb826b-e891-46c4-990d-ca03cf3f4222" status: 200 len: 1805 microversion: 2.20 time: 0.159767 Sep 24 05:07:08.376445 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 379/730] 10.222.0.50 () {60 vars in 1277 bytes} [Sat Sep 24 05:07:08 2022] GET /compute/v2.1/servers/08fb826b-e891-46c4-990d-ca03cf3f4222 => generated 1805 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 05:07:08.880491 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-f646566f-e827-4422-81a3-1c03feaf4298 tempest-VolumesSnapshotTestJSON-4159203 tempest-VolumesSnapshotTestJSON-4159203-project] Calling method '>' {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:07:08.881025 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.compute.api [None req-f646566f-e827-4422-81a3-1c03feaf4298 tempest-VolumesSnapshotTestJSON-4159203 tempest-VolumesSnapshotTestJSON-4159203-project] [instance: 87e09804-74dc-4329-97d5-02be092fd866] Fetching instance by UUID {{(pid=120593) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:07:08.887393 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-f646566f-e827-4422-81a3-1c03feaf4298 tempest-VolumesSnapshotTestJSON-4159203 tempest-VolumesSnapshotTestJSON-4159203-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:07:08.887871 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-f646566f-e827-4422-81a3-1c03feaf4298 tempest-VolumesSnapshotTestJSON-4159203 tempest-VolumesSnapshotTestJSON-4159203-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:07:08.888299 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-f646566f-e827-4422-81a3-1c03feaf4298 tempest-VolumesSnapshotTestJSON-4159203 tempest-VolumesSnapshotTestJSON-4159203-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:07:08.888982 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-f646566f-e827-4422-81a3-1c03feaf4298 tempest-VolumesSnapshotTestJSON-4159203 tempest-VolumesSnapshotTestJSON-4159203-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:07:08.889433 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-f646566f-e827-4422-81a3-1c03feaf4298 tempest-VolumesSnapshotTestJSON-4159203 tempest-VolumesSnapshotTestJSON-4159203-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:07:08.889879 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-f646566f-e827-4422-81a3-1c03feaf4298 tempest-VolumesSnapshotTestJSON-4159203 tempest-VolumesSnapshotTestJSON-4159203-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:07:08.922709 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-f646566f-e827-4422-81a3-1c03feaf4298 tempest-VolumesSnapshotTestJSON-4159203 tempest-VolumesSnapshotTestJSON-4159203-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:07:08.923178 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-f646566f-e827-4422-81a3-1c03feaf4298 tempest-VolumesSnapshotTestJSON-4159203 tempest-VolumesSnapshotTestJSON-4159203-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:07:08.923609 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-f646566f-e827-4422-81a3-1c03feaf4298 tempest-VolumesSnapshotTestJSON-4159203 tempest-VolumesSnapshotTestJSON-4159203-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:07:08.924051 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.objects.instance [None req-f646566f-e827-4422-81a3-1c03feaf4298 tempest-VolumesSnapshotTestJSON-4159203 tempest-VolumesSnapshotTestJSON-4159203-project] Lazy-loading 'fault' on Instance uuid 87e09804-74dc-4329-97d5-02be092fd866 {{(pid=120593) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 24 05:07:08.965947 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-f646566f-e827-4422-81a3-1c03feaf4298 tempest-VolumesSnapshotTestJSON-4159203 tempest-VolumesSnapshotTestJSON-4159203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '358ce5f5c35f415eb79322ae6d187b1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e942295e9b3478abd521c6f3e60e888', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:07:08.974431 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-f646566f-e827-4422-81a3-1c03feaf4298 tempest-VolumesSnapshotTestJSON-4159203 tempest-VolumesSnapshotTestJSON-4159203-project] 10.222.0.50 "GET /compute/v2.1/servers/87e09804-74dc-4329-97d5-02be092fd866" status: 200 len: 1309 microversion: 2.1 time: 0.097725 Sep 24 05:07:08.975004 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 352/731] 10.222.0.50 () {58 vars in 1236 bytes} [Sat Sep 24 05:07:08 2022] GET /compute/v2.1/servers/87e09804-74dc-4329-97d5-02be092fd866 => generated 1309 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 05:07:09.401700 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-e4741b47-d191-4c36-ab14-d92d4586b057 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Calling method '>' {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:07:09.402449 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.compute.api [None req-e4741b47-d191-4c36-ab14-d92d4586b057 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] [instance: 08fb826b-e891-46c4-990d-ca03cf3f4222] Fetching instance by UUID {{(pid=120594) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:07:09.408769 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-e4741b47-d191-4c36-ab14-d92d4586b057 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:07:09.409245 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-e4741b47-d191-4c36-ab14-d92d4586b057 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:07:09.409679 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-e4741b47-d191-4c36-ab14-d92d4586b057 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:07:09.410402 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-e4741b47-d191-4c36-ab14-d92d4586b057 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:07:09.410852 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-e4741b47-d191-4c36-ab14-d92d4586b057 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:07:09.411272 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-e4741b47-d191-4c36-ab14-d92d4586b057 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:07:09.537105 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.policy [None req-e4741b47-d191-4c36-ab14-d92d4586b057 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0948754217fc4ff2ba0241fa35feaf90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1aaf20f480a423ea5feca81585aeeed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:07:09.545427 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.policy [None req-e4741b47-d191-4c36-ab14-d92d4586b057 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0948754217fc4ff2ba0241fa35feaf90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1aaf20f480a423ea5feca81585aeeed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:07:09.546880 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.policy [None req-e4741b47-d191-4c36-ab14-d92d4586b057 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0948754217fc4ff2ba0241fa35feaf90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1aaf20f480a423ea5feca81585aeeed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:07:09.548011 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [None req-e4741b47-d191-4c36-ab14-d92d4586b057 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] 10.222.0.50 "GET /compute/v2.1/servers/08fb826b-e891-46c4-990d-ca03cf3f4222" status: 200 len: 1805 microversion: 2.20 time: 0.151267 Sep 24 05:07:09.548563 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 380/732] 10.222.0.50 () {60 vars in 1277 bytes} [Sat Sep 24 05:07:09 2022] GET /compute/v2.1/servers/08fb826b-e891-46c4-990d-ca03cf3f4222 => generated 1805 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 05:07:09.997961 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-79f8968e-3e68-4eeb-91e3-95635e52ec6c tempest-VolumesSnapshotTestJSON-4159203 tempest-VolumesSnapshotTestJSON-4159203-project] Calling method '>' {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:07:09.998589 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.compute.api [None req-79f8968e-3e68-4eeb-91e3-95635e52ec6c tempest-VolumesSnapshotTestJSON-4159203 tempest-VolumesSnapshotTestJSON-4159203-project] [instance: 87e09804-74dc-4329-97d5-02be092fd866] Fetching instance by UUID {{(pid=120593) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:07:10.004911 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-79f8968e-3e68-4eeb-91e3-95635e52ec6c tempest-VolumesSnapshotTestJSON-4159203 tempest-VolumesSnapshotTestJSON-4159203-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:07:10.005396 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-79f8968e-3e68-4eeb-91e3-95635e52ec6c tempest-VolumesSnapshotTestJSON-4159203 tempest-VolumesSnapshotTestJSON-4159203-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:07:10.005829 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-79f8968e-3e68-4eeb-91e3-95635e52ec6c tempest-VolumesSnapshotTestJSON-4159203 tempest-VolumesSnapshotTestJSON-4159203-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:07:10.006544 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-79f8968e-3e68-4eeb-91e3-95635e52ec6c tempest-VolumesSnapshotTestJSON-4159203 tempest-VolumesSnapshotTestJSON-4159203-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:07:10.006996 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-79f8968e-3e68-4eeb-91e3-95635e52ec6c tempest-VolumesSnapshotTestJSON-4159203 tempest-VolumesSnapshotTestJSON-4159203-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:07:10.007422 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-79f8968e-3e68-4eeb-91e3-95635e52ec6c tempest-VolumesSnapshotTestJSON-4159203 tempest-VolumesSnapshotTestJSON-4159203-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:07:10.021807 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.wsgi [None req-79f8968e-3e68-4eeb-91e3-95635e52ec6c tempest-VolumesSnapshotTestJSON-4159203 tempest-VolumesSnapshotTestJSON-4159203-project] HTTP exception thrown: Instance 87e09804-74dc-4329-97d5-02be092fd866 could not be found. Sep 24 05:07:10.023493 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-79f8968e-3e68-4eeb-91e3-95635e52ec6c tempest-VolumesSnapshotTestJSON-4159203 tempest-VolumesSnapshotTestJSON-4159203-project] Request method failure captured: Sep 24 05:07:10.023493 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: request: GET /compute/v2.1/servers/87e09804-74dc-4329-97d5-02be092fd866 HTTP/1.1 Sep 24 05:07:10.023493 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: Accept: application/json Sep 24 05:07:10.023493 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: Accept-Encoding: identity Sep 24 05:07:10.023493 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: Connection: close Sep 24 05:07:10.023493 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: Content-Length: 0 Sep 24 05:07:10.023493 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: Content-Type: application/json Sep 24 05:07:10.023493 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: Host: 10.222.0.50 Sep 24 05:07:10.023493 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: Openstack-System-Scope: None Sep 24 05:07:10.023493 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: User-Agent: python-urllib3/1.26.12 Sep 24 05:07:10.023493 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: X-Auth-Token: gAAAAABjLo_WMEcGDomIoaxlVSNKcL813mdQFpOl2BMAhWW6IVTY6YJG4G9orsaEKecGTgr1Ih1ol9mrVzDyNk536qPtyyn0_XteLafzruAcSBCrnZctBI2r_1VRnmdvkGII8XDPi8C-KWR9TNOvshlk38PwemEHVpOZ0i41rYlmwAVORrvIvX0 Sep 24 05:07:10.023493 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: X-Domain-Id: None Sep 24 05:07:10.023493 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: X-Domain-Name: None Sep 24 05:07:10.023493 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: X-Identity-Status: Confirmed Sep 24 05:07:10.023493 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: X-Is-Admin-Project: True Sep 24 05:07:10.023493 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: X-Project-Domain-Id: default Sep 24 05:07:10.023493 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: X-Project-Domain-Name: Default Sep 24 05:07:10.023493 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: X-Project-Id: 0e942295e9b3478abd521c6f3e60e888 Sep 24 05:07:10.023493 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: X-Project-Name: tempest-VolumesSnapshotTestJSON-4159203 Sep 24 05:07:10.023493 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: X-Role: member,reader Sep 24 05:07:10.023493 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: X-Roles: member,reader Sep 24 05:07:10.025047 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/0e942295e9b3478abd521c6f3e60e888"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/0e942295e9b3478abd521c6f3e60e888"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/0e942295e9b3478abd521c6f3e60e888"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.50:8080", "publicURL": "http://10.222.0.50:8080/v1/AUTH_0e942295e9b3478abd521c6f3e60e888"}]}] Sep 24 05:07:10.025047 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: X-Tenant: tempest-VolumesSnapshotTestJSON-4159203 Sep 24 05:07:10.025047 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: X-Tenant-Id: 0e942295e9b3478abd521c6f3e60e888 Sep 24 05:07:10.025047 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-4159203 Sep 24 05:07:10.025047 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: X-User: tempest-VolumesSnapshotTestJSON-4159203-project Sep 24 05:07:10.025047 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: X-User-Domain-Id: default Sep 24 05:07:10.025047 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: X-User-Domain-Name: Default Sep 24 05:07:10.025047 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: X-User-Id: 358ce5f5c35f415eb79322ae6d187b1d Sep 24 05:07:10.025047 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: X-User-Name: tempest-VolumesSnapshotTestJSON-4159203-project Sep 24 05:07:10.025047 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: method: > Sep 24 05:07:10.025047 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: exception: Instance 87e09804-74dc-4329-97d5-02be092fd866 could not be found. Sep 24 05:07:10.025047 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: action_args: {'id': '87e09804-74dc-4329-97d5-02be092fd866'} Sep 24 05:07:10.026679 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 24 05:07:10.026679 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 05:07:10.026679 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 24 05:07:10.026679 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 24 05:07:10.026679 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 24 05:07:10.026679 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 24 05:07:10.026679 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 24 05:07:10.026679 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 24 05:07:10.026679 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 24 05:07:10.026679 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 24 05:07:10.026679 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 87e09804-74dc-4329-97d5-02be092fd866 could not be found. Sep 24 05:07:10.026679 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi Sep 24 05:07:10.026679 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 05:07:10.026679 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi Sep 24 05:07:10.026679 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 05:07:10.026679 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 05:07:10.026679 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 05:07:10.026679 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 24 05:07:10.026679 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 24 05:07:10.026679 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 24 05:07:10.027945 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 24 05:07:10.027945 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 24 05:07:10.027945 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 24 05:07:10.027945 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 24 05:07:10.027945 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 24 05:07:10.027945 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 24 05:07:10.027945 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 24 05:07:10.027945 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 87e09804-74dc-4329-97d5-02be092fd866 could not be found. Sep 24 05:07:10.027945 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi Sep 24 05:07:10.027945 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 05:07:10.027945 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi Sep 24 05:07:10.027945 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 05:07:10.027945 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 05:07:10.027945 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 05:07:10.027945 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 24 05:07:10.027945 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 24 05:07:10.027945 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 87e09804-74dc-4329-97d5-02be092fd866 could not be found. Sep 24 05:07:10.027945 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi Sep 24 05:07:10.029035 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-79f8968e-3e68-4eeb-91e3-95635e52ec6c tempest-VolumesSnapshotTestJSON-4159203 tempest-VolumesSnapshotTestJSON-4159203-project] Returning 404 to user: Instance 87e09804-74dc-4329-97d5-02be092fd866 could not be found. {{(pid=120593) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 24 05:07:10.029035 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-79f8968e-3e68-4eeb-91e3-95635e52ec6c tempest-VolumesSnapshotTestJSON-4159203 tempest-VolumesSnapshotTestJSON-4159203-project] 10.222.0.50 "GET /compute/v2.1/servers/87e09804-74dc-4329-97d5-02be092fd866" status: 404 len: 111 microversion: 2.1 time: 0.030933 Sep 24 05:07:10.029035 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 353/733] 10.222.0.50 () {58 vars in 1236 bytes} [Sat Sep 24 05:07:09 2022] GET /compute/v2.1/servers/87e09804-74dc-4329-97d5-02be092fd866 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 24 05:07:10.573683 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-241b37b4-773d-4855-a12c-8908dc9c2b78 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Calling method '>' {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:07:10.574309 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.compute.api [None req-241b37b4-773d-4855-a12c-8908dc9c2b78 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] [instance: 08fb826b-e891-46c4-990d-ca03cf3f4222] Fetching instance by UUID {{(pid=120594) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:07:10.580711 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-241b37b4-773d-4855-a12c-8908dc9c2b78 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:07:10.581181 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-241b37b4-773d-4855-a12c-8908dc9c2b78 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:07:10.581609 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-241b37b4-773d-4855-a12c-8908dc9c2b78 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:07:10.582316 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-241b37b4-773d-4855-a12c-8908dc9c2b78 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:07:10.582759 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-241b37b4-773d-4855-a12c-8908dc9c2b78 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:07:10.583175 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-241b37b4-773d-4855-a12c-8908dc9c2b78 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:07:10.721767 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.policy [None req-241b37b4-773d-4855-a12c-8908dc9c2b78 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0948754217fc4ff2ba0241fa35feaf90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1aaf20f480a423ea5feca81585aeeed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:07:10.730801 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.policy [None req-241b37b4-773d-4855-a12c-8908dc9c2b78 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0948754217fc4ff2ba0241fa35feaf90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1aaf20f480a423ea5feca81585aeeed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:07:10.732231 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.policy [None req-241b37b4-773d-4855-a12c-8908dc9c2b78 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0948754217fc4ff2ba0241fa35feaf90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1aaf20f480a423ea5feca81585aeeed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:07:10.733405 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [None req-241b37b4-773d-4855-a12c-8908dc9c2b78 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] 10.222.0.50 "GET /compute/v2.1/servers/08fb826b-e891-46c4-990d-ca03cf3f4222" status: 200 len: 1805 microversion: 2.20 time: 0.163642 Sep 24 05:07:10.733967 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 381/734] 10.222.0.50 () {60 vars in 1277 bytes} [Sat Sep 24 05:07:10 2022] GET /compute/v2.1/servers/08fb826b-e891-46c4-990d-ca03cf3f4222 => generated 1805 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 05:07:11.758844 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-26ae823b-70e4-4b52-9e5d-448662ddab56 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Calling method '>' {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:07:11.759481 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.compute.api [None req-26ae823b-70e4-4b52-9e5d-448662ddab56 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] [instance: 08fb826b-e891-46c4-990d-ca03cf3f4222] Fetching instance by UUID {{(pid=120593) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:07:11.765969 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-26ae823b-70e4-4b52-9e5d-448662ddab56 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:07:11.766481 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-26ae823b-70e4-4b52-9e5d-448662ddab56 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:07:11.766916 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-26ae823b-70e4-4b52-9e5d-448662ddab56 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:07:11.767595 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-26ae823b-70e4-4b52-9e5d-448662ddab56 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:07:11.768044 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-26ae823b-70e4-4b52-9e5d-448662ddab56 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:07:11.768465 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-26ae823b-70e4-4b52-9e5d-448662ddab56 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:07:11.893876 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-26ae823b-70e4-4b52-9e5d-448662ddab56 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0948754217fc4ff2ba0241fa35feaf90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1aaf20f480a423ea5feca81585aeeed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:07:11.903101 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-26ae823b-70e4-4b52-9e5d-448662ddab56 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0948754217fc4ff2ba0241fa35feaf90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1aaf20f480a423ea5feca81585aeeed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:07:11.904496 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-26ae823b-70e4-4b52-9e5d-448662ddab56 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0948754217fc4ff2ba0241fa35feaf90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1aaf20f480a423ea5feca81585aeeed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:07:11.905699 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-26ae823b-70e4-4b52-9e5d-448662ddab56 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] 10.222.0.50 "GET /compute/v2.1/servers/08fb826b-e891-46c4-990d-ca03cf3f4222" status: 200 len: 1805 microversion: 2.20 time: 0.150746 Sep 24 05:07:11.906326 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 354/735] 10.222.0.50 () {60 vars in 1277 bytes} [Sat Sep 24 05:07:11 2022] GET /compute/v2.1/servers/08fb826b-e891-46c4-990d-ca03cf3f4222 => generated 1805 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 05:07:12.121063 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [req-f3767fbf-7cdb-40a6-a61d-276b0225fa9a req-cd09cae8-0393-4992-8c17-9d79df37305c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "08fb826b-e891-46c4-990d-ca03cf3f4222", "name": "network-vif-plugged", "status": "completed", "tag": "4de1eabe-932e-4cda-804d-49eeff37c34c"}]} {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 05:07:12.132204 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [req-f3767fbf-7cdb-40a6-a61d-276b0225fa9a req-cd09cae8-0393-4992-8c17-9d79df37305c service nova] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:07:12.132694 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [req-f3767fbf-7cdb-40a6-a61d-276b0225fa9a req-cd09cae8-0393-4992-8c17-9d79df37305c service nova] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:07:12.133125 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [req-f3767fbf-7cdb-40a6-a61d-276b0225fa9a req-cd09cae8-0393-4992-8c17-9d79df37305c service nova] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:07:12.144384 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: INFO nova.api.openstack.compute.server_external_events [req-f3767fbf-7cdb-40a6-a61d-276b0225fa9a req-cd09cae8-0393-4992-8c17-9d79df37305c service nova] Creating event network-vif-plugged:4de1eabe-932e-4cda-804d-49eeff37c34c for instance 08fb826b-e891-46c4-990d-ca03cf3f4222 on hv-cinder-85918 Sep 24 05:07:12.149776 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [req-f3767fbf-7cdb-40a6-a61d-276b0225fa9a req-cd09cae8-0393-4992-8c17-9d79df37305c service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.091532 Sep 24 05:07:12.151282 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 382/736] 10.222.0.50 () {64 vars in 1317 bytes} [Sat Sep 24 05:07:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 05:07:12.932032 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-58df7da0-08b0-4df9-99bc-21619c75af4d tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Calling method '>' {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:07:12.932573 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.compute.api [None req-58df7da0-08b0-4df9-99bc-21619c75af4d tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] [instance: 08fb826b-e891-46c4-990d-ca03cf3f4222] Fetching instance by UUID {{(pid=120593) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:07:12.938948 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-58df7da0-08b0-4df9-99bc-21619c75af4d tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:07:12.939430 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-58df7da0-08b0-4df9-99bc-21619c75af4d tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:07:12.939877 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-58df7da0-08b0-4df9-99bc-21619c75af4d tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:07:12.940569 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-58df7da0-08b0-4df9-99bc-21619c75af4d tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:07:12.941023 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-58df7da0-08b0-4df9-99bc-21619c75af4d tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:07:12.941448 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-58df7da0-08b0-4df9-99bc-21619c75af4d tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:07:13.065567 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-58df7da0-08b0-4df9-99bc-21619c75af4d tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0948754217fc4ff2ba0241fa35feaf90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1aaf20f480a423ea5feca81585aeeed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:07:13.074124 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-58df7da0-08b0-4df9-99bc-21619c75af4d tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0948754217fc4ff2ba0241fa35feaf90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1aaf20f480a423ea5feca81585aeeed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:07:13.075543 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-58df7da0-08b0-4df9-99bc-21619c75af4d tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0948754217fc4ff2ba0241fa35feaf90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1aaf20f480a423ea5feca81585aeeed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:07:13.076680 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-58df7da0-08b0-4df9-99bc-21619c75af4d tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] 10.222.0.50 "GET /compute/v2.1/servers/08fb826b-e891-46c4-990d-ca03cf3f4222" status: 200 len: 1805 microversion: 2.20 time: 0.149297 Sep 24 05:07:13.077230 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 355/737] 10.222.0.50 () {60 vars in 1277 bytes} [Sat Sep 24 05:07:12 2022] GET /compute/v2.1/servers/08fb826b-e891-46c4-990d-ca03cf3f4222 => generated 1805 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 05:07:14.102363 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-d531e34f-e70f-4733-b8f5-34735d663c90 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Calling method '>' {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:07:14.103064 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.compute.api [None req-d531e34f-e70f-4733-b8f5-34735d663c90 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] [instance: 08fb826b-e891-46c4-990d-ca03cf3f4222] Fetching instance by UUID {{(pid=120594) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:07:14.105696 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 24 05:07:14.105859 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: Sat Sep 24 05:07:14 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/08fb826b-e891-46c4-990d-ca03cf3f4222 (ip 10.222.0.50) !!! Sep 24 05:07:14.112359 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-d531e34f-e70f-4733-b8f5-34735d663c90 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:07:14.112843 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-d531e34f-e70f-4733-b8f5-34735d663c90 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:07:14.113281 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-d531e34f-e70f-4733-b8f5-34735d663c90 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:07:14.113977 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-d531e34f-e70f-4733-b8f5-34735d663c90 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:07:14.114454 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-d531e34f-e70f-4733-b8f5-34735d663c90 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:07:14.114881 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-d531e34f-e70f-4733-b8f5-34735d663c90 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:07:14.246828 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.policy [None req-d531e34f-e70f-4733-b8f5-34735d663c90 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0948754217fc4ff2ba0241fa35feaf90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1aaf20f480a423ea5feca81585aeeed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:07:14.255330 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.policy [None req-d531e34f-e70f-4733-b8f5-34735d663c90 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0948754217fc4ff2ba0241fa35feaf90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1aaf20f480a423ea5feca81585aeeed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:07:14.256761 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.policy [None req-d531e34f-e70f-4733-b8f5-34735d663c90 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0948754217fc4ff2ba0241fa35feaf90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1aaf20f480a423ea5feca81585aeeed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:07:14.257891 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [None req-d531e34f-e70f-4733-b8f5-34735d663c90 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] 10.222.0.50 "GET /compute/v2.1/servers/08fb826b-e891-46c4-990d-ca03cf3f4222" status: 200 len: 1805 microversion: 2.20 time: 0.160117 Sep 24 05:07:14.258475 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 383/738] 10.222.0.50 () {60 vars in 1277 bytes} [Sat Sep 24 05:07:14 2022] GET /compute/v2.1/servers/08fb826b-e891-46c4-990d-ca03cf3f4222 => generated 1805 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 05:07:15.283535 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-66d1a19f-54de-463c-a392-9ab29afbe328 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Calling method '>' {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:07:15.284176 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.compute.api [None req-66d1a19f-54de-463c-a392-9ab29afbe328 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] [instance: 08fb826b-e891-46c4-990d-ca03cf3f4222] Fetching instance by UUID {{(pid=120593) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:07:15.290578 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-66d1a19f-54de-463c-a392-9ab29afbe328 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:07:15.291289 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-66d1a19f-54de-463c-a392-9ab29afbe328 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:07:15.291733 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-66d1a19f-54de-463c-a392-9ab29afbe328 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:07:15.292422 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-66d1a19f-54de-463c-a392-9ab29afbe328 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:07:15.292874 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-66d1a19f-54de-463c-a392-9ab29afbe328 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:07:15.293301 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-66d1a19f-54de-463c-a392-9ab29afbe328 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:07:15.417888 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-66d1a19f-54de-463c-a392-9ab29afbe328 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0948754217fc4ff2ba0241fa35feaf90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1aaf20f480a423ea5feca81585aeeed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:07:15.426586 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-66d1a19f-54de-463c-a392-9ab29afbe328 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0948754217fc4ff2ba0241fa35feaf90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1aaf20f480a423ea5feca81585aeeed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:07:15.428026 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-66d1a19f-54de-463c-a392-9ab29afbe328 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0948754217fc4ff2ba0241fa35feaf90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1aaf20f480a423ea5feca81585aeeed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:07:15.429173 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-66d1a19f-54de-463c-a392-9ab29afbe328 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] 10.222.0.50 "GET /compute/v2.1/servers/08fb826b-e891-46c4-990d-ca03cf3f4222" status: 200 len: 1805 microversion: 2.20 time: 0.149572 Sep 24 05:07:15.429730 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 356/739] 10.222.0.50 () {60 vars in 1277 bytes} [Sat Sep 24 05:07:15 2022] GET /compute/v2.1/servers/08fb826b-e891-46c4-990d-ca03cf3f4222 => generated 1805 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 05:07:16.455345 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-c8893eaf-9b75-4fa5-b2f7-58b59f004121 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Calling method '>' {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:07:16.455950 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.compute.api [None req-c8893eaf-9b75-4fa5-b2f7-58b59f004121 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] [instance: 08fb826b-e891-46c4-990d-ca03cf3f4222] Fetching instance by UUID {{(pid=120594) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:07:16.458398 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG dbcounter [-] [120594] Writing DB stats nova_api:SELECT=50 {{(pid=120594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 05:07:16.463646 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-c8893eaf-9b75-4fa5-b2f7-58b59f004121 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:07:16.464158 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-c8893eaf-9b75-4fa5-b2f7-58b59f004121 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:07:16.465155 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-c8893eaf-9b75-4fa5-b2f7-58b59f004121 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:07:16.465867 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-c8893eaf-9b75-4fa5-b2f7-58b59f004121 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:07:16.466366 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-c8893eaf-9b75-4fa5-b2f7-58b59f004121 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:07:16.466789 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-c8893eaf-9b75-4fa5-b2f7-58b59f004121 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:07:16.599040 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.policy [None req-c8893eaf-9b75-4fa5-b2f7-58b59f004121 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0948754217fc4ff2ba0241fa35feaf90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1aaf20f480a423ea5feca81585aeeed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:07:16.601227 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG dbcounter [-] [120594] Writing DB stats nova_cell1:SELECT=100 {{(pid=120594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 05:07:16.609619 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.policy [None req-c8893eaf-9b75-4fa5-b2f7-58b59f004121 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0948754217fc4ff2ba0241fa35feaf90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1aaf20f480a423ea5feca81585aeeed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:07:16.611094 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.policy [None req-c8893eaf-9b75-4fa5-b2f7-58b59f004121 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0948754217fc4ff2ba0241fa35feaf90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1aaf20f480a423ea5feca81585aeeed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:07:16.612237 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [None req-c8893eaf-9b75-4fa5-b2f7-58b59f004121 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] 10.222.0.50 "GET /compute/v2.1/servers/08fb826b-e891-46c4-990d-ca03cf3f4222" status: 200 len: 1805 microversion: 2.20 time: 0.160816 Sep 24 05:07:16.612801 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 384/740] 10.222.0.50 () {60 vars in 1277 bytes} [Sat Sep 24 05:07:16 2022] GET /compute/v2.1/servers/08fb826b-e891-46c4-990d-ca03cf3f4222 => generated 1805 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 05:07:17.638273 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-67e81e08-e5bd-43ae-a44f-8dda52ef7f87 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Calling method '>' {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:07:17.638881 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.compute.api [None req-67e81e08-e5bd-43ae-a44f-8dda52ef7f87 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] [instance: 08fb826b-e891-46c4-990d-ca03cf3f4222] Fetching instance by UUID {{(pid=120593) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:07:17.645229 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-67e81e08-e5bd-43ae-a44f-8dda52ef7f87 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:07:17.645708 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-67e81e08-e5bd-43ae-a44f-8dda52ef7f87 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:07:17.646201 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-67e81e08-e5bd-43ae-a44f-8dda52ef7f87 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:07:17.646887 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-67e81e08-e5bd-43ae-a44f-8dda52ef7f87 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:07:17.647338 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-67e81e08-e5bd-43ae-a44f-8dda52ef7f87 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:07:17.647761 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-67e81e08-e5bd-43ae-a44f-8dda52ef7f87 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:07:17.773967 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-67e81e08-e5bd-43ae-a44f-8dda52ef7f87 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0948754217fc4ff2ba0241fa35feaf90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1aaf20f480a423ea5feca81585aeeed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:07:17.783258 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-67e81e08-e5bd-43ae-a44f-8dda52ef7f87 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0948754217fc4ff2ba0241fa35feaf90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1aaf20f480a423ea5feca81585aeeed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:07:17.784690 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-67e81e08-e5bd-43ae-a44f-8dda52ef7f87 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0948754217fc4ff2ba0241fa35feaf90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1aaf20f480a423ea5feca81585aeeed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:07:17.785826 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-67e81e08-e5bd-43ae-a44f-8dda52ef7f87 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] 10.222.0.50 "GET /compute/v2.1/servers/08fb826b-e891-46c4-990d-ca03cf3f4222" status: 200 len: 1805 microversion: 2.20 time: 0.151495 Sep 24 05:07:17.786429 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 357/741] 10.222.0.50 () {60 vars in 1277 bytes} [Sat Sep 24 05:07:17 2022] GET /compute/v2.1/servers/08fb826b-e891-46c4-990d-ca03cf3f4222 => generated 1805 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 05:07:18.811992 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-3af6aa40-bd93-4ba4-b43e-469642777797 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Calling method '>' {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:07:18.812602 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.compute.api [None req-3af6aa40-bd93-4ba4-b43e-469642777797 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] [instance: 08fb826b-e891-46c4-990d-ca03cf3f4222] Fetching instance by UUID {{(pid=120594) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:07:18.818970 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-3af6aa40-bd93-4ba4-b43e-469642777797 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:07:18.819452 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-3af6aa40-bd93-4ba4-b43e-469642777797 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:07:18.819937 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-3af6aa40-bd93-4ba4-b43e-469642777797 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:07:18.820580 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-3af6aa40-bd93-4ba4-b43e-469642777797 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:07:18.821037 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-3af6aa40-bd93-4ba4-b43e-469642777797 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:07:18.821461 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-3af6aa40-bd93-4ba4-b43e-469642777797 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:07:18.957266 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.policy [None req-3af6aa40-bd93-4ba4-b43e-469642777797 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0948754217fc4ff2ba0241fa35feaf90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1aaf20f480a423ea5feca81585aeeed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:07:18.965853 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.policy [None req-3af6aa40-bd93-4ba4-b43e-469642777797 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0948754217fc4ff2ba0241fa35feaf90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1aaf20f480a423ea5feca81585aeeed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:07:18.967362 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.policy [None req-3af6aa40-bd93-4ba4-b43e-469642777797 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0948754217fc4ff2ba0241fa35feaf90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1aaf20f480a423ea5feca81585aeeed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:07:18.968511 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [None req-3af6aa40-bd93-4ba4-b43e-469642777797 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] 10.222.0.50 "GET /compute/v2.1/servers/08fb826b-e891-46c4-990d-ca03cf3f4222" status: 200 len: 1805 microversion: 2.20 time: 0.160511 Sep 24 05:07:18.969231 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 385/742] 10.222.0.50 () {60 vars in 1277 bytes} [Sat Sep 24 05:07:18 2022] GET /compute/v2.1/servers/08fb826b-e891-46c4-990d-ca03cf3f4222 => generated 1805 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 05:07:19.995324 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-5f7bf87a-f1d5-4dc0-9fd4-2fb4ee90b4fb tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Calling method '>' {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:07:19.995930 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.compute.api [None req-5f7bf87a-f1d5-4dc0-9fd4-2fb4ee90b4fb tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] [instance: 08fb826b-e891-46c4-990d-ca03cf3f4222] Fetching instance by UUID {{(pid=120593) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:07:20.001871 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-5f7bf87a-f1d5-4dc0-9fd4-2fb4ee90b4fb tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:07:20.002384 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-5f7bf87a-f1d5-4dc0-9fd4-2fb4ee90b4fb tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:07:20.002818 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-5f7bf87a-f1d5-4dc0-9fd4-2fb4ee90b4fb tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:07:20.003501 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-5f7bf87a-f1d5-4dc0-9fd4-2fb4ee90b4fb tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:07:20.003950 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-5f7bf87a-f1d5-4dc0-9fd4-2fb4ee90b4fb tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:07:20.004372 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-5f7bf87a-f1d5-4dc0-9fd4-2fb4ee90b4fb tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:07:20.148121 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-5f7bf87a-f1d5-4dc0-9fd4-2fb4ee90b4fb tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0948754217fc4ff2ba0241fa35feaf90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1aaf20f480a423ea5feca81585aeeed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:07:20.156938 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-5f7bf87a-f1d5-4dc0-9fd4-2fb4ee90b4fb tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0948754217fc4ff2ba0241fa35feaf90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1aaf20f480a423ea5feca81585aeeed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:07:20.158403 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-5f7bf87a-f1d5-4dc0-9fd4-2fb4ee90b4fb tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0948754217fc4ff2ba0241fa35feaf90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1aaf20f480a423ea5feca81585aeeed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:07:20.159545 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-5f7bf87a-f1d5-4dc0-9fd4-2fb4ee90b4fb tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] 10.222.0.50 "GET /compute/v2.1/servers/08fb826b-e891-46c4-990d-ca03cf3f4222" status: 200 len: 1792 microversion: 2.20 time: 0.168760 Sep 24 05:07:20.160098 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 358/743] 10.222.0.50 () {60 vars in 1277 bytes} [Sat Sep 24 05:07:19 2022] GET /compute/v2.1/servers/08fb826b-e891-46c4-990d-ca03cf3f4222 => generated 1792 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 05:07:26.212555 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-75bebd53-dede-424c-8497-cd98c57089cf tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "1dcf8fbf-c105-4513-b34f-0f4cb8fcca61"}} {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 05:07:26.215065 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.compute.api [None req-75bebd53-dede-424c-8497-cd98c57089cf tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] [instance: 3e1c080b-492d-4c55-880a-14e89c938fce] Fetching instance by UUID {{(pid=120594) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:07:26.220949 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-75bebd53-dede-424c-8497-cd98c57089cf tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:07:26.221430 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-75bebd53-dede-424c-8497-cd98c57089cf tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:07:26.221864 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-75bebd53-dede-424c-8497-cd98c57089cf tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:07:26.222585 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-75bebd53-dede-424c-8497-cd98c57089cf tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:07:26.223039 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-75bebd53-dede-424c-8497-cd98c57089cf tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:07:26.223459 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-75bebd53-dede-424c-8497-cd98c57089cf tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:07:26.653159 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [None req-75bebd53-dede-424c-8497-cd98c57089cf tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] 10.222.0.50 "POST /compute/v2.1/servers/3e1c080b-492d-4c55-880a-14e89c938fce/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.541909 Sep 24 05:07:26.653770 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 386/744] 10.222.0.50 () {60 vars in 1323 bytes} [Sat Sep 24 05:07:26 2022] POST /compute/v2.1/servers/3e1c080b-492d-4c55-880a-14e89c938fce/os-volume_attachments => generated 194 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 05:07:34.191740 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-685b6633-7ac8-4bae-b04f-643f3df6a5eb tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 05:07:34.194043 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.compute.api [None req-685b6633-7ac8-4bae-b04f-643f3df6a5eb tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] [instance: 3e1c080b-492d-4c55-880a-14e89c938fce] Fetching instance by UUID {{(pid=120593) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:07:34.196510 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG dbcounter [-] [120593] Writing DB stats nova_api:SELECT=25 {{(pid=120593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 05:07:34.197224 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG dbcounter [-] [120593] Writing DB stats nova_cell1:SELECT=87,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 05:07:34.203216 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-685b6633-7ac8-4bae-b04f-643f3df6a5eb tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:07:34.203766 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-685b6633-7ac8-4bae-b04f-643f3df6a5eb tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:07:34.204206 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-685b6633-7ac8-4bae-b04f-643f3df6a5eb tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:07:34.204972 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-685b6633-7ac8-4bae-b04f-643f3df6a5eb tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:07:34.205482 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-685b6633-7ac8-4bae-b04f-643f3df6a5eb tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:07:34.205918 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-685b6633-7ac8-4bae-b04f-643f3df6a5eb tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:07:34.230600 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.objects.instance [None req-685b6633-7ac8-4bae-b04f-643f3df6a5eb tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Lazy-loading 'flavor' on Instance uuid 3e1c080b-492d-4c55-880a-14e89c938fce {{(pid=120593) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 24 05:07:34.348103 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-685b6633-7ac8-4bae-b04f-643f3df6a5eb tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] 10.222.0.50 "POST /compute/v2.1/servers/3e1c080b-492d-4c55-880a-14e89c938fce/action" status: 200 len: 32 microversion: 2.1 time: 0.160290 Sep 24 05:07:34.348754 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 359/745] 10.222.0.50 () {60 vars in 1278 bytes} [Sat Sep 24 05:07:34 2022] POST /compute/v2.1/servers/3e1c080b-492d-4c55-880a-14e89c938fce/action => generated 32 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 24 05:07:34.359664 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-50e37188-d91e-4f9b-b5af-53d66d816f2d tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Calling method '>' {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:07:34.360359 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.compute.api [None req-50e37188-d91e-4f9b-b5af-53d66d816f2d tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] [instance: 3e1c080b-492d-4c55-880a-14e89c938fce] Fetching instance by UUID {{(pid=120594) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:07:34.366614 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-50e37188-d91e-4f9b-b5af-53d66d816f2d tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:07:34.367103 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-50e37188-d91e-4f9b-b5af-53d66d816f2d tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:07:34.367537 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-50e37188-d91e-4f9b-b5af-53d66d816f2d tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:07:34.368267 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-50e37188-d91e-4f9b-b5af-53d66d816f2d tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:07:34.368731 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-50e37188-d91e-4f9b-b5af-53d66d816f2d tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:07:34.369229 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-50e37188-d91e-4f9b-b5af-53d66d816f2d tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:07:34.500284 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.policy [None req-50e37188-d91e-4f9b-b5af-53d66d816f2d tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cdd0da2c7bc4139bcd48ef36a2ee183', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a18a3756ba2b460d977f738a115ebfe0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:07:34.508588 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [None req-50e37188-d91e-4f9b-b5af-53d66d816f2d tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] 10.222.0.50 "GET /compute/v2.1/servers/3e1c080b-492d-4c55-880a-14e89c938fce" status: 200 len: 1735 microversion: 2.1 time: 0.153506 Sep 24 05:07:34.509536 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 387/746] 10.222.0.50 () {58 vars in 1236 bytes} [Sat Sep 24 05:07:34 2022] GET /compute/v2.1/servers/3e1c080b-492d-4c55-880a-14e89c938fce => generated 1735 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 05:07:35.534026 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-a1489b47-0e54-417f-a7da-8da794080e2d tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Calling method '>' {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:07:35.534669 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.compute.api [None req-a1489b47-0e54-417f-a7da-8da794080e2d tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] [instance: 3e1c080b-492d-4c55-880a-14e89c938fce] Fetching instance by UUID {{(pid=120593) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:07:35.541564 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-a1489b47-0e54-417f-a7da-8da794080e2d tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:07:35.542078 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-a1489b47-0e54-417f-a7da-8da794080e2d tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:07:35.542520 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-a1489b47-0e54-417f-a7da-8da794080e2d tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:07:35.543215 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-a1489b47-0e54-417f-a7da-8da794080e2d tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:07:35.543667 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-a1489b47-0e54-417f-a7da-8da794080e2d tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:07:35.544092 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-a1489b47-0e54-417f-a7da-8da794080e2d tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:07:35.675524 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-a1489b47-0e54-417f-a7da-8da794080e2d tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cdd0da2c7bc4139bcd48ef36a2ee183', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a18a3756ba2b460d977f738a115ebfe0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:07:35.684281 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-a1489b47-0e54-417f-a7da-8da794080e2d tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] 10.222.0.50 "GET /compute/v2.1/servers/3e1c080b-492d-4c55-880a-14e89c938fce" status: 200 len: 1735 microversion: 2.1 time: 0.155543 Sep 24 05:07:35.684845 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 360/747] 10.222.0.50 () {58 vars in 1236 bytes} [Sat Sep 24 05:07:35 2022] GET /compute/v2.1/servers/3e1c080b-492d-4c55-880a-14e89c938fce => generated 1735 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 05:07:36.707124 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-2737b2b7-6f19-40f3-9707-e7b3f26cf0e3 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Calling method '>' {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:07:36.707820 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.compute.api [None req-2737b2b7-6f19-40f3-9707-e7b3f26cf0e3 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] [instance: 3e1c080b-492d-4c55-880a-14e89c938fce] Fetching instance by UUID {{(pid=120594) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:07:36.714802 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-2737b2b7-6f19-40f3-9707-e7b3f26cf0e3 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:07:36.715278 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-2737b2b7-6f19-40f3-9707-e7b3f26cf0e3 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:07:36.715709 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-2737b2b7-6f19-40f3-9707-e7b3f26cf0e3 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:07:36.716398 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-2737b2b7-6f19-40f3-9707-e7b3f26cf0e3 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:07:36.716845 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-2737b2b7-6f19-40f3-9707-e7b3f26cf0e3 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:07:36.717285 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-2737b2b7-6f19-40f3-9707-e7b3f26cf0e3 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:07:36.850839 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.policy [None req-2737b2b7-6f19-40f3-9707-e7b3f26cf0e3 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cdd0da2c7bc4139bcd48ef36a2ee183', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a18a3756ba2b460d977f738a115ebfe0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:07:36.859016 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [None req-2737b2b7-6f19-40f3-9707-e7b3f26cf0e3 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] 10.222.0.50 "GET /compute/v2.1/servers/3e1c080b-492d-4c55-880a-14e89c938fce" status: 200 len: 1735 microversion: 2.1 time: 0.156160 Sep 24 05:07:36.859579 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 388/748] 10.222.0.50 () {58 vars in 1236 bytes} [Sat Sep 24 05:07:36 2022] GET /compute/v2.1/servers/3e1c080b-492d-4c55-880a-14e89c938fce => generated 1735 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 05:07:37.881374 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-5e0ad97b-2547-40f5-97b5-a86e788604f7 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Calling method '>' {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:07:37.882103 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.compute.api [None req-5e0ad97b-2547-40f5-97b5-a86e788604f7 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] [instance: 3e1c080b-492d-4c55-880a-14e89c938fce] Fetching instance by UUID {{(pid=120593) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:07:37.888595 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-5e0ad97b-2547-40f5-97b5-a86e788604f7 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:07:37.889076 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-5e0ad97b-2547-40f5-97b5-a86e788604f7 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:07:37.889752 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-5e0ad97b-2547-40f5-97b5-a86e788604f7 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:07:37.890690 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-5e0ad97b-2547-40f5-97b5-a86e788604f7 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:07:37.891598 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-5e0ad97b-2547-40f5-97b5-a86e788604f7 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:07:37.892254 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-5e0ad97b-2547-40f5-97b5-a86e788604f7 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:07:38.051624 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-5e0ad97b-2547-40f5-97b5-a86e788604f7 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cdd0da2c7bc4139bcd48ef36a2ee183', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a18a3756ba2b460d977f738a115ebfe0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:07:38.060918 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-5e0ad97b-2547-40f5-97b5-a86e788604f7 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] 10.222.0.50 "GET /compute/v2.1/servers/3e1c080b-492d-4c55-880a-14e89c938fce" status: 200 len: 1735 microversion: 2.1 time: 0.183511 Sep 24 05:07:38.061513 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 361/749] 10.222.0.50 () {58 vars in 1236 bytes} [Sat Sep 24 05:07:37 2022] GET /compute/v2.1/servers/3e1c080b-492d-4c55-880a-14e89c938fce => generated 1735 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 05:07:39.085344 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-9972c0b8-c24c-4df0-a158-fa74c3330cb4 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Calling method '>' {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:07:39.086322 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.compute.api [None req-9972c0b8-c24c-4df0-a158-fa74c3330cb4 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] [instance: 3e1c080b-492d-4c55-880a-14e89c938fce] Fetching instance by UUID {{(pid=120594) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:07:39.094018 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-9972c0b8-c24c-4df0-a158-fa74c3330cb4 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:07:39.094734 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-9972c0b8-c24c-4df0-a158-fa74c3330cb4 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:07:39.095162 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-9972c0b8-c24c-4df0-a158-fa74c3330cb4 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:07:39.095858 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-9972c0b8-c24c-4df0-a158-fa74c3330cb4 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:07:39.096522 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-9972c0b8-c24c-4df0-a158-fa74c3330cb4 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:07:39.096960 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-9972c0b8-c24c-4df0-a158-fa74c3330cb4 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:07:39.250748 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.policy [None req-9972c0b8-c24c-4df0-a158-fa74c3330cb4 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cdd0da2c7bc4139bcd48ef36a2ee183', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a18a3756ba2b460d977f738a115ebfe0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:07:39.259388 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [None req-9972c0b8-c24c-4df0-a158-fa74c3330cb4 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] 10.222.0.50 "GET /compute/v2.1/servers/3e1c080b-492d-4c55-880a-14e89c938fce" status: 200 len: 1735 microversion: 2.1 time: 0.179173 Sep 24 05:07:39.260452 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 389/750] 10.222.0.50 () {58 vars in 1236 bytes} [Sat Sep 24 05:07:39 2022] GET /compute/v2.1/servers/3e1c080b-492d-4c55-880a-14e89c938fce => generated 1735 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 05:07:40.283780 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-b2149d70-4796-4e6a-af57-9ee9f5c90d79 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Calling method '>' {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:07:40.284548 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.compute.api [None req-b2149d70-4796-4e6a-af57-9ee9f5c90d79 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] [instance: 3e1c080b-492d-4c55-880a-14e89c938fce] Fetching instance by UUID {{(pid=120593) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:07:40.292321 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-b2149d70-4796-4e6a-af57-9ee9f5c90d79 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:07:40.292914 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-b2149d70-4796-4e6a-af57-9ee9f5c90d79 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:07:40.293410 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-b2149d70-4796-4e6a-af57-9ee9f5c90d79 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:07:40.294269 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-b2149d70-4796-4e6a-af57-9ee9f5c90d79 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:07:40.294765 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-b2149d70-4796-4e6a-af57-9ee9f5c90d79 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:07:40.295446 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-b2149d70-4796-4e6a-af57-9ee9f5c90d79 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:07:40.468865 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-b2149d70-4796-4e6a-af57-9ee9f5c90d79 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cdd0da2c7bc4139bcd48ef36a2ee183', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a18a3756ba2b460d977f738a115ebfe0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:07:40.481298 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-b2149d70-4796-4e6a-af57-9ee9f5c90d79 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] 10.222.0.50 "GET /compute/v2.1/servers/3e1c080b-492d-4c55-880a-14e89c938fce" status: 200 len: 1735 microversion: 2.1 time: 0.202088 Sep 24 05:07:40.481886 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 362/751] 10.222.0.50 () {58 vars in 1236 bytes} [Sat Sep 24 05:07:40 2022] GET /compute/v2.1/servers/3e1c080b-492d-4c55-880a-14e89c938fce => generated 1735 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 05:07:41.505110 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-8c3b6857-dcd5-4e35-bb8d-8adaee0d03af tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Calling method '>' {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:07:41.506511 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.compute.api [None req-8c3b6857-dcd5-4e35-bb8d-8adaee0d03af tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] [instance: 3e1c080b-492d-4c55-880a-14e89c938fce] Fetching instance by UUID {{(pid=120594) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:07:41.514314 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-8c3b6857-dcd5-4e35-bb8d-8adaee0d03af tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:07:41.515066 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-8c3b6857-dcd5-4e35-bb8d-8adaee0d03af tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:07:41.515769 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-8c3b6857-dcd5-4e35-bb8d-8adaee0d03af tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:07:41.516630 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-8c3b6857-dcd5-4e35-bb8d-8adaee0d03af tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:07:41.517082 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-8c3b6857-dcd5-4e35-bb8d-8adaee0d03af tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:07:41.517500 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-8c3b6857-dcd5-4e35-bb8d-8adaee0d03af tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:07:41.688588 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.policy [None req-8c3b6857-dcd5-4e35-bb8d-8adaee0d03af tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cdd0da2c7bc4139bcd48ef36a2ee183', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a18a3756ba2b460d977f738a115ebfe0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:07:41.698501 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [None req-8c3b6857-dcd5-4e35-bb8d-8adaee0d03af tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] 10.222.0.50 "GET /compute/v2.1/servers/3e1c080b-492d-4c55-880a-14e89c938fce" status: 200 len: 1735 microversion: 2.1 time: 0.197543 Sep 24 05:07:41.699343 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 390/752] 10.222.0.50 () {58 vars in 1236 bytes} [Sat Sep 24 05:07:41 2022] GET /compute/v2.1/servers/3e1c080b-492d-4c55-880a-14e89c938fce => generated 1735 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 05:07:42.722146 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-92d37c39-7338-4f2c-856a-5ab48d6cf830 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Calling method '>' {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:07:42.722146 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.compute.api [None req-92d37c39-7338-4f2c-856a-5ab48d6cf830 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] [instance: 3e1c080b-492d-4c55-880a-14e89c938fce] Fetching instance by UUID {{(pid=120593) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:07:42.731937 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-92d37c39-7338-4f2c-856a-5ab48d6cf830 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:07:42.733453 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-92d37c39-7338-4f2c-856a-5ab48d6cf830 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:07:42.733916 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-92d37c39-7338-4f2c-856a-5ab48d6cf830 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:07:42.734850 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-92d37c39-7338-4f2c-856a-5ab48d6cf830 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:07:42.744028 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-92d37c39-7338-4f2c-856a-5ab48d6cf830 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:07:42.744254 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-92d37c39-7338-4f2c-856a-5ab48d6cf830 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:07:42.896633 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-92d37c39-7338-4f2c-856a-5ab48d6cf830 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cdd0da2c7bc4139bcd48ef36a2ee183', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a18a3756ba2b460d977f738a115ebfe0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:07:42.905611 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-92d37c39-7338-4f2c-856a-5ab48d6cf830 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] 10.222.0.50 "GET /compute/v2.1/servers/3e1c080b-492d-4c55-880a-14e89c938fce" status: 200 len: 1735 microversion: 2.1 time: 0.188737 Sep 24 05:07:42.906272 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 363/753] 10.222.0.50 () {58 vars in 1236 bytes} [Sat Sep 24 05:07:42 2022] GET /compute/v2.1/servers/3e1c080b-492d-4c55-880a-14e89c938fce => generated 1735 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 05:07:43.929426 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-30b2d00f-6126-413f-bfe1-c9f73ba5d161 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Calling method '>' {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:07:43.930123 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.compute.api [None req-30b2d00f-6126-413f-bfe1-c9f73ba5d161 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] [instance: 3e1c080b-492d-4c55-880a-14e89c938fce] Fetching instance by UUID {{(pid=120594) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:07:43.937016 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-30b2d00f-6126-413f-bfe1-c9f73ba5d161 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:07:43.937501 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-30b2d00f-6126-413f-bfe1-c9f73ba5d161 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:07:43.937938 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-30b2d00f-6126-413f-bfe1-c9f73ba5d161 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:07:43.938688 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-30b2d00f-6126-413f-bfe1-c9f73ba5d161 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:07:43.939137 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-30b2d00f-6126-413f-bfe1-c9f73ba5d161 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:07:43.939562 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-30b2d00f-6126-413f-bfe1-c9f73ba5d161 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:07:44.138752 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.policy [None req-30b2d00f-6126-413f-bfe1-c9f73ba5d161 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cdd0da2c7bc4139bcd48ef36a2ee183', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a18a3756ba2b460d977f738a115ebfe0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:07:44.148758 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [None req-30b2d00f-6126-413f-bfe1-c9f73ba5d161 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] 10.222.0.50 "GET /compute/v2.1/servers/3e1c080b-492d-4c55-880a-14e89c938fce" status: 200 len: 1735 microversion: 2.1 time: 0.223150 Sep 24 05:07:44.149723 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 391/754] 10.222.0.50 () {58 vars in 1236 bytes} [Sat Sep 24 05:07:43 2022] GET /compute/v2.1/servers/3e1c080b-492d-4c55-880a-14e89c938fce => generated 1735 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 05:07:45.176793 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-f26a3bcc-5c8b-4262-8cb9-8e110e835635 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Calling method '>' {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:07:45.181416 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.compute.api [None req-f26a3bcc-5c8b-4262-8cb9-8e110e835635 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] [instance: 3e1c080b-492d-4c55-880a-14e89c938fce] Fetching instance by UUID {{(pid=120593) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:07:45.210372 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-f26a3bcc-5c8b-4262-8cb9-8e110e835635 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:07:45.215094 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-f26a3bcc-5c8b-4262-8cb9-8e110e835635 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:07:45.215291 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-f26a3bcc-5c8b-4262-8cb9-8e110e835635 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:07:45.216026 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-f26a3bcc-5c8b-4262-8cb9-8e110e835635 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:07:45.216482 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-f26a3bcc-5c8b-4262-8cb9-8e110e835635 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:07:45.217852 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-f26a3bcc-5c8b-4262-8cb9-8e110e835635 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:07:45.562371 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-f26a3bcc-5c8b-4262-8cb9-8e110e835635 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cdd0da2c7bc4139bcd48ef36a2ee183', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a18a3756ba2b460d977f738a115ebfe0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:07:45.570765 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-f26a3bcc-5c8b-4262-8cb9-8e110e835635 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] 10.222.0.50 "GET /compute/v2.1/servers/3e1c080b-492d-4c55-880a-14e89c938fce" status: 200 len: 1735 microversion: 2.1 time: 0.398792 Sep 24 05:07:45.571993 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 364/755] 10.222.0.50 () {58 vars in 1236 bytes} [Sat Sep 24 05:07:45 2022] GET /compute/v2.1/servers/3e1c080b-492d-4c55-880a-14e89c938fce => generated 1735 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 05:07:46.600700 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-5a91000d-f658-4789-9c27-34bc8567e051 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Calling method '>' {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:07:46.602632 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.compute.api [None req-5a91000d-f658-4789-9c27-34bc8567e051 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] [instance: 3e1c080b-492d-4c55-880a-14e89c938fce] Fetching instance by UUID {{(pid=120594) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:07:46.606411 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG dbcounter [-] [120594] Writing DB stats nova_api:SELECT=16 {{(pid=120594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 05:07:46.633516 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-5a91000d-f658-4789-9c27-34bc8567e051 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:07:46.634079 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-5a91000d-f658-4789-9c27-34bc8567e051 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:07:46.634503 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-5a91000d-f658-4789-9c27-34bc8567e051 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:07:46.639269 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-5a91000d-f658-4789-9c27-34bc8567e051 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:07:46.639798 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-5a91000d-f658-4789-9c27-34bc8567e051 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:07:46.640239 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-5a91000d-f658-4789-9c27-34bc8567e051 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:07:46.648950 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG dbcounter [-] [120594] Writing DB stats nova_cell1:SELECT=49,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 05:07:46.888180 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.policy [None req-5a91000d-f658-4789-9c27-34bc8567e051 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cdd0da2c7bc4139bcd48ef36a2ee183', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a18a3756ba2b460d977f738a115ebfe0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:07:46.898772 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [None req-5a91000d-f658-4789-9c27-34bc8567e051 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] 10.222.0.50 "GET /compute/v2.1/servers/3e1c080b-492d-4c55-880a-14e89c938fce" status: 200 len: 1735 microversion: 2.1 time: 0.307655 Sep 24 05:07:46.910534 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 392/756] 10.222.0.50 () {58 vars in 1236 bytes} [Sat Sep 24 05:07:46 2022] GET /compute/v2.1/servers/3e1c080b-492d-4c55-880a-14e89c938fce => generated 1735 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 05:07:47.924850 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-4d10079b-cc9f-406d-8771-ffd4433afbcc tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Calling method '>' {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:07:47.925468 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.compute.api [None req-4d10079b-cc9f-406d-8771-ffd4433afbcc tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] [instance: 3e1c080b-492d-4c55-880a-14e89c938fce] Fetching instance by UUID {{(pid=120593) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:07:47.932456 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-4d10079b-cc9f-406d-8771-ffd4433afbcc tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:07:47.933192 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-4d10079b-cc9f-406d-8771-ffd4433afbcc tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:07:47.933808 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-4d10079b-cc9f-406d-8771-ffd4433afbcc tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:07:47.934711 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-4d10079b-cc9f-406d-8771-ffd4433afbcc tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:07:47.935371 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-4d10079b-cc9f-406d-8771-ffd4433afbcc tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:07:47.936045 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-4d10079b-cc9f-406d-8771-ffd4433afbcc tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:07:48.097739 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-4d10079b-cc9f-406d-8771-ffd4433afbcc tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cdd0da2c7bc4139bcd48ef36a2ee183', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a18a3756ba2b460d977f738a115ebfe0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:07:48.108110 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-4d10079b-cc9f-406d-8771-ffd4433afbcc tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] 10.222.0.50 "GET /compute/v2.1/servers/3e1c080b-492d-4c55-880a-14e89c938fce" status: 200 len: 1735 microversion: 2.1 time: 0.188205 Sep 24 05:07:48.111102 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 365/757] 10.222.0.50 () {58 vars in 1236 bytes} [Sat Sep 24 05:07:47 2022] GET /compute/v2.1/servers/3e1c080b-492d-4c55-880a-14e89c938fce => generated 1735 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 05:07:48.361489 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-a4659beb-c7e3-4eb6-8300-fa34c5c395da tempest-TestVolumeBootPattern-1339481357 tempest-TestVolumeBootPattern-1339481357-project] Action: 'create', calling method: .version_select at 0x7f795068bf70>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-418909133", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGgkP4tGzKQ/VrG9hj4ip+KEvG8e/Hz9qNXGasFGSV0tLUr0KKTj/gSPSLHcMb/khoTX5TX5ERrRikbJMkq6AZNWTr2bJ+dKpogTkPILPJebV74HnQqj8Emby6KcS4tsUg=="}} {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 05:07:48.377738 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.quota [None req-a4659beb-c7e3-4eb6-8300-fa34c5c395da tempest-TestVolumeBootPattern-1339481357 tempest-TestVolumeBootPattern-1339481357-project] Getting quotas for project fef19544ec414094953daea6d545a361. Resources: {'key_pairs'} {{(pid=120594) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 24 05:07:48.381715 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.quota [None req-a4659beb-c7e3-4eb6-8300-fa34c5c395da tempest-TestVolumeBootPattern-1339481357 tempest-TestVolumeBootPattern-1339481357-project] Getting quotas for user 60edcebcccaa4da99ffddadd3e27c1c0 and project fef19544ec414094953daea6d545a361. Resources: {'key_pairs'} {{(pid=120594) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 24 05:07:48.407179 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [None req-a4659beb-c7e3-4eb6-8300-fa34c5c395da tempest-TestVolumeBootPattern-1339481357 tempest-TestVolumeBootPattern-1339481357-project] 10.222.0.50 "POST /compute/v2.1/os-keypairs" status: 200 len: 399 microversion: 2.1 time: 0.228016 Sep 24 05:07:48.407835 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 393/758] 10.222.0.50 () {60 vars in 1159 bytes} [Sat Sep 24 05:07:48 2022] POST /compute/v2.1/os-keypairs => generated 399 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 05:07:49.137054 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-35a95e52-46f8-4aee-b531-685dcf7ff3f3 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Calling method '>' {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:07:49.137675 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.compute.api [None req-35a95e52-46f8-4aee-b531-685dcf7ff3f3 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] [instance: 3e1c080b-492d-4c55-880a-14e89c938fce] Fetching instance by UUID {{(pid=120593) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:07:49.143831 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-35a95e52-46f8-4aee-b531-685dcf7ff3f3 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:07:49.144317 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-35a95e52-46f8-4aee-b531-685dcf7ff3f3 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:07:49.144752 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-35a95e52-46f8-4aee-b531-685dcf7ff3f3 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:07:49.145448 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-35a95e52-46f8-4aee-b531-685dcf7ff3f3 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:07:49.145903 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-35a95e52-46f8-4aee-b531-685dcf7ff3f3 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:07:49.146359 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-35a95e52-46f8-4aee-b531-685dcf7ff3f3 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:07:49.330107 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-35a95e52-46f8-4aee-b531-685dcf7ff3f3 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cdd0da2c7bc4139bcd48ef36a2ee183', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a18a3756ba2b460d977f738a115ebfe0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:07:49.340785 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-35a95e52-46f8-4aee-b531-685dcf7ff3f3 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] 10.222.0.50 "GET /compute/v2.1/servers/3e1c080b-492d-4c55-880a-14e89c938fce" status: 200 len: 1735 microversion: 2.1 time: 0.209591 Sep 24 05:07:49.341499 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 366/759] 10.222.0.50 () {58 vars in 1236 bytes} [Sat Sep 24 05:07:49 2022] GET /compute/v2.1/servers/3e1c080b-492d-4c55-880a-14e89c938fce => generated 1735 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 05:07:50.365292 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-3b09e7da-d33b-4c82-b393-278ad2096f14 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Calling method '>' {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:07:50.365903 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.compute.api [None req-3b09e7da-d33b-4c82-b393-278ad2096f14 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] [instance: 3e1c080b-492d-4c55-880a-14e89c938fce] Fetching instance by UUID {{(pid=120594) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:07:50.373680 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-3b09e7da-d33b-4c82-b393-278ad2096f14 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:07:50.374261 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-3b09e7da-d33b-4c82-b393-278ad2096f14 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:07:50.374672 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-3b09e7da-d33b-4c82-b393-278ad2096f14 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:07:50.375458 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-3b09e7da-d33b-4c82-b393-278ad2096f14 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:07:50.375917 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-3b09e7da-d33b-4c82-b393-278ad2096f14 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:07:50.376344 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-3b09e7da-d33b-4c82-b393-278ad2096f14 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:07:50.511672 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.policy [None req-3b09e7da-d33b-4c82-b393-278ad2096f14 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cdd0da2c7bc4139bcd48ef36a2ee183', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a18a3756ba2b460d977f738a115ebfe0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:07:50.521064 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [None req-3b09e7da-d33b-4c82-b393-278ad2096f14 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] 10.222.0.50 "GET /compute/v2.1/servers/3e1c080b-492d-4c55-880a-14e89c938fce" status: 200 len: 1715 microversion: 2.1 time: 0.159928 Sep 24 05:07:50.521976 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 394/760] 10.222.0.50 () {58 vars in 1236 bytes} [Sat Sep 24 05:07:50 2022] GET /compute/v2.1/servers/3e1c080b-492d-4c55-880a-14e89c938fce => generated 1715 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 05:07:50.651703 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-db40a8cb-5780-4adb-96c3-cddd3a66a94e tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Calling method '>' {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:07:50.653322 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.compute.api [None req-db40a8cb-5780-4adb-96c3-cddd3a66a94e tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] [instance: 3e1c080b-492d-4c55-880a-14e89c938fce] Fetching instance by UUID {{(pid=120593) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:07:50.660462 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-db40a8cb-5780-4adb-96c3-cddd3a66a94e tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:07:50.661202 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-db40a8cb-5780-4adb-96c3-cddd3a66a94e tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:07:50.661825 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-db40a8cb-5780-4adb-96c3-cddd3a66a94e tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:07:50.662969 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-db40a8cb-5780-4adb-96c3-cddd3a66a94e tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:07:50.663426 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-db40a8cb-5780-4adb-96c3-cddd3a66a94e tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:07:50.663851 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-db40a8cb-5780-4adb-96c3-cddd3a66a94e tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:07:50.754990 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.wsgi [None req-db40a8cb-5780-4adb-96c3-cddd3a66a94e tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] HTTP exception thrown: Cannot 'detach_volume' instance 3e1c080b-492d-4c55-880a-14e89c938fce while it is in vm_state rescued Sep 24 05:07:50.756857 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-db40a8cb-5780-4adb-96c3-cddd3a66a94e tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Request method failure captured: Sep 24 05:07:50.756857 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: request: DELETE /compute/v2.1/servers/3e1c080b-492d-4c55-880a-14e89c938fce/os-volume_attachments/1dcf8fbf-c105-4513-b34f-0f4cb8fcca61 HTTP/1.1 Sep 24 05:07:50.756857 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: Accept: application/json Sep 24 05:07:50.756857 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: Accept-Encoding: identity Sep 24 05:07:50.756857 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: Connection: close Sep 24 05:07:50.756857 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: Content-Length: 0 Sep 24 05:07:50.756857 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: Content-Type: application/json Sep 24 05:07:50.756857 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: Host: 10.222.0.50 Sep 24 05:07:50.756857 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: Openstack-System-Scope: None Sep 24 05:07:50.756857 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: User-Agent: python-urllib3/1.26.12 Sep 24 05:07:50.756857 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: X-Auth-Token: gAAAAABjLo8HTzNG_FPeaRlb1iKtn70N4qXi3bCZUsBH5ev83dMKRgyc3ir4exWyX_HELoYhUZuaNsGC0Iz7uIZoAOnFSUT1gUYQNLBWBHD4Hr9Zo2LmNKYYpHEOSNBOqs6trhPvBX0Mbw8c_gmqJ1Foarii5zl7NKWXL_yy02zfSiE1i-m0pa8 Sep 24 05:07:50.756857 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: X-Domain-Id: None Sep 24 05:07:50.756857 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: X-Domain-Name: None Sep 24 05:07:50.756857 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: X-Identity-Status: Confirmed Sep 24 05:07:50.756857 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: X-Is-Admin-Project: True Sep 24 05:07:50.756857 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: X-Project-Domain-Id: default Sep 24 05:07:50.756857 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: X-Project-Domain-Name: Default Sep 24 05:07:50.756857 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: X-Project-Id: a18a3756ba2b460d977f738a115ebfe0 Sep 24 05:07:50.756857 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1841571325 Sep 24 05:07:50.756857 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: X-Role: member,reader Sep 24 05:07:50.756857 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: X-Roles: member,reader Sep 24 05:07:50.758488 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/a18a3756ba2b460d977f738a115ebfe0"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/a18a3756ba2b460d977f738a115ebfe0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/a18a3756ba2b460d977f738a115ebfe0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.50:8080", "publicURL": "http://10.222.0.50:8080/v1/AUTH_a18a3756ba2b460d977f738a115ebfe0"}]}] Sep 24 05:07:50.758488 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1841571325 Sep 24 05:07:50.758488 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: X-Tenant-Id: a18a3756ba2b460d977f738a115ebfe0 Sep 24 05:07:50.758488 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1841571325 Sep 24 05:07:50.758488 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: X-User: tempest-ServerRescueNegativeTestJSON-1841571325-project Sep 24 05:07:50.758488 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: X-User-Domain-Id: default Sep 24 05:07:50.758488 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: X-User-Domain-Name: Default Sep 24 05:07:50.758488 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: X-User-Id: 8cdd0da2c7bc4139bcd48ef36a2ee183 Sep 24 05:07:50.758488 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1841571325-project Sep 24 05:07:50.758488 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: method: > Sep 24 05:07:50.758488 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: exception: Cannot 'detach_volume' instance 3e1c080b-492d-4c55-880a-14e89c938fce while it is in vm_state rescued Sep 24 05:07:50.759343 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: action_args: {'server_id': '3e1c080b-492d-4c55-880a-14e89c938fce', 'id': '1dcf8fbf-c105-4513-b34f-0f4cb8fcca61'} Sep 24 05:07:50.759343 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 24 05:07:50.759343 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 05:07:50.759343 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Sep 24 05:07:50.759343 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Sep 24 05:07:50.759343 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 24 05:07:50.759343 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 24 05:07:50.759343 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Sep 24 05:07:50.759343 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Sep 24 05:07:50.759343 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 3e1c080b-492d-4c55-880a-14e89c938fce in vm_state rescued. Cannot detach_volume while the instance is in this state. Sep 24 05:07:50.759343 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi Sep 24 05:07:50.759343 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 05:07:50.759343 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi Sep 24 05:07:50.759343 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 05:07:50.759343 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 05:07:50.759343 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 05:07:50.759343 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 24 05:07:50.759343 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 24 05:07:50.759343 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 24 05:07:50.759343 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 24 05:07:50.760889 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 573, in delete Sep 24 05:07:50.760889 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Sep 24 05:07:50.760889 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Sep 24 05:07:50.760889 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Sep 24 05:07:50.760889 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'detach_volume' instance 3e1c080b-492d-4c55-880a-14e89c938fce while it is in vm_state rescued Sep 24 05:07:50.760889 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi Sep 24 05:07:50.760889 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 05:07:50.760889 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi Sep 24 05:07:50.760889 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 05:07:50.760889 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 05:07:50.760889 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 05:07:50.760889 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 24 05:07:50.760889 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 24 05:07:50.760889 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'detach_volume' instance 3e1c080b-492d-4c55-880a-14e89c938fce while it is in vm_state rescued Sep 24 05:07:50.760889 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi Sep 24 05:07:50.762633 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-db40a8cb-5780-4adb-96c3-cddd3a66a94e tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Returning 409 to user: Cannot 'detach_volume' instance 3e1c080b-492d-4c55-880a-14e89c938fce while it is in vm_state rescued {{(pid=120593) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 24 05:07:50.763644 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-db40a8cb-5780-4adb-96c3-cddd3a66a94e tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] 10.222.0.50 "DELETE /compute/v2.1/servers/3e1c080b-492d-4c55-880a-14e89c938fce/os-volume_attachments/1dcf8fbf-c105-4513-b34f-0f4cb8fcca61" status: 409 len: 152 microversion: 2.1 time: 0.116057 Sep 24 05:07:50.767731 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 367/761] 10.222.0.50 () {58 vars in 1416 bytes} [Sat Sep 24 05:07:50 2022] DELETE /compute/v2.1/servers/3e1c080b-492d-4c55-880a-14e89c938fce/os-volume_attachments/1dcf8fbf-c105-4513-b34f-0f4cb8fcca61 => generated 152 bytes in 121 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Sep 24 05:07:50.773365 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-b4e1b228-fdbb-4efc-bebb-c426d5575a66 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 05:07:50.774067 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.compute.api [None req-b4e1b228-fdbb-4efc-bebb-c426d5575a66 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] [instance: 3e1c080b-492d-4c55-880a-14e89c938fce] Fetching instance by UUID {{(pid=120594) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:07:50.794726 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-b4e1b228-fdbb-4efc-bebb-c426d5575a66 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:07:50.795228 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-b4e1b228-fdbb-4efc-bebb-c426d5575a66 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:07:50.795676 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-b4e1b228-fdbb-4efc-bebb-c426d5575a66 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:07:50.796407 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-b4e1b228-fdbb-4efc-bebb-c426d5575a66 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:07:50.796861 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-b4e1b228-fdbb-4efc-bebb-c426d5575a66 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:07:50.797285 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-b4e1b228-fdbb-4efc-bebb-c426d5575a66 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:07:50.879532 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [None req-b4e1b228-fdbb-4efc-bebb-c426d5575a66 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] 10.222.0.50 "POST /compute/v2.1/servers/3e1c080b-492d-4c55-880a-14e89c938fce/action" status: 202 len: 0 microversion: 2.1 time: 0.110393 Sep 24 05:07:50.880899 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 395/762] 10.222.0.50 () {60 vars in 1278 bytes} [Sat Sep 24 05:07:50 2022] POST /compute/v2.1/servers/3e1c080b-492d-4c55-880a-14e89c938fce/action => generated 0 bytes in 113 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 24 05:07:50.889629 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-d10fab5f-89a5-4710-aa32-2085837db285 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Calling method '>' {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:07:50.890690 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.compute.api [None req-d10fab5f-89a5-4710-aa32-2085837db285 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] [instance: 3e1c080b-492d-4c55-880a-14e89c938fce] Fetching instance by UUID {{(pid=120593) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:07:50.898640 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-d10fab5f-89a5-4710-aa32-2085837db285 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:07:50.899144 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-d10fab5f-89a5-4710-aa32-2085837db285 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:07:50.899591 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-d10fab5f-89a5-4710-aa32-2085837db285 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:07:50.900976 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-d10fab5f-89a5-4710-aa32-2085837db285 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:07:50.901432 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-d10fab5f-89a5-4710-aa32-2085837db285 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:07:50.902071 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-d10fab5f-89a5-4710-aa32-2085837db285 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:07:51.104646 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-d10fab5f-89a5-4710-aa32-2085837db285 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cdd0da2c7bc4139bcd48ef36a2ee183', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a18a3756ba2b460d977f738a115ebfe0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:07:51.114639 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-d10fab5f-89a5-4710-aa32-2085837db285 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] 10.222.0.50 "GET /compute/v2.1/servers/3e1c080b-492d-4c55-880a-14e89c938fce" status: 200 len: 1723 microversion: 2.1 time: 0.229684 Sep 24 05:07:51.122366 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 368/763] 10.222.0.50 () {58 vars in 1236 bytes} [Sat Sep 24 05:07:50 2022] GET /compute/v2.1/servers/3e1c080b-492d-4c55-880a-14e89c938fce => generated 1723 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 24 05:07:52.139880 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-02b0ee60-2a54-4a9a-bb01-3eacf6854d78 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Calling method '>' {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:07:52.145360 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.compute.api [None req-02b0ee60-2a54-4a9a-bb01-3eacf6854d78 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] [instance: 3e1c080b-492d-4c55-880a-14e89c938fce] Fetching instance by UUID {{(pid=120594) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:07:52.152434 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-02b0ee60-2a54-4a9a-bb01-3eacf6854d78 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:07:52.153245 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-02b0ee60-2a54-4a9a-bb01-3eacf6854d78 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:07:52.153681 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-02b0ee60-2a54-4a9a-bb01-3eacf6854d78 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:07:52.154436 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-02b0ee60-2a54-4a9a-bb01-3eacf6854d78 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:07:52.154888 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-02b0ee60-2a54-4a9a-bb01-3eacf6854d78 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:07:52.155312 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-02b0ee60-2a54-4a9a-bb01-3eacf6854d78 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:07:52.316851 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.policy [None req-02b0ee60-2a54-4a9a-bb01-3eacf6854d78 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cdd0da2c7bc4139bcd48ef36a2ee183', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a18a3756ba2b460d977f738a115ebfe0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:07:52.326029 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [None req-02b0ee60-2a54-4a9a-bb01-3eacf6854d78 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] 10.222.0.50 "GET /compute/v2.1/servers/3e1c080b-492d-4c55-880a-14e89c938fce" status: 200 len: 1723 microversion: 2.1 time: 0.191200 Sep 24 05:07:52.326627 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 396/764] 10.222.0.50 () {58 vars in 1236 bytes} [Sat Sep 24 05:07:52 2022] GET /compute/v2.1/servers/3e1c080b-492d-4c55-880a-14e89c938fce => generated 1723 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 05:07:53.349103 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-c6758c58-e8b1-47d6-807f-849e824dc900 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Calling method '>' {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:07:53.349742 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.compute.api [None req-c6758c58-e8b1-47d6-807f-849e824dc900 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] [instance: 3e1c080b-492d-4c55-880a-14e89c938fce] Fetching instance by UUID {{(pid=120593) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:07:53.356655 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-c6758c58-e8b1-47d6-807f-849e824dc900 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:07:53.357204 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-c6758c58-e8b1-47d6-807f-849e824dc900 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:07:53.357574 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-c6758c58-e8b1-47d6-807f-849e824dc900 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:07:53.358307 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-c6758c58-e8b1-47d6-807f-849e824dc900 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:07:53.358765 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-c6758c58-e8b1-47d6-807f-849e824dc900 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:07:53.359194 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-c6758c58-e8b1-47d6-807f-849e824dc900 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:07:53.490889 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-c6758c58-e8b1-47d6-807f-849e824dc900 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cdd0da2c7bc4139bcd48ef36a2ee183', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a18a3756ba2b460d977f738a115ebfe0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:07:53.499567 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-c6758c58-e8b1-47d6-807f-849e824dc900 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] 10.222.0.50 "GET /compute/v2.1/servers/3e1c080b-492d-4c55-880a-14e89c938fce" status: 200 len: 1723 microversion: 2.1 time: 0.154315 Sep 24 05:07:53.500121 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 369/765] 10.222.0.50 () {58 vars in 1236 bytes} [Sat Sep 24 05:07:53 2022] GET /compute/v2.1/servers/3e1c080b-492d-4c55-880a-14e89c938fce => generated 1723 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 05:07:54.522347 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-13734b54-adb3-4ed3-a5e4-5c4a468df593 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Calling method '>' {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:07:54.522955 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.compute.api [None req-13734b54-adb3-4ed3-a5e4-5c4a468df593 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] [instance: 3e1c080b-492d-4c55-880a-14e89c938fce] Fetching instance by UUID {{(pid=120594) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:07:54.530675 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-13734b54-adb3-4ed3-a5e4-5c4a468df593 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:07:54.531216 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-13734b54-adb3-4ed3-a5e4-5c4a468df593 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:07:54.531931 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-13734b54-adb3-4ed3-a5e4-5c4a468df593 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:07:54.532822 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-13734b54-adb3-4ed3-a5e4-5c4a468df593 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:07:54.533380 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-13734b54-adb3-4ed3-a5e4-5c4a468df593 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:07:54.534142 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-13734b54-adb3-4ed3-a5e4-5c4a468df593 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:07:54.668592 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.policy [None req-13734b54-adb3-4ed3-a5e4-5c4a468df593 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cdd0da2c7bc4139bcd48ef36a2ee183', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a18a3756ba2b460d977f738a115ebfe0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:07:54.676792 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [None req-13734b54-adb3-4ed3-a5e4-5c4a468df593 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] 10.222.0.50 "GET /compute/v2.1/servers/3e1c080b-492d-4c55-880a-14e89c938fce" status: 200 len: 1723 microversion: 2.1 time: 0.158511 Sep 24 05:07:54.677375 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 397/766] 10.222.0.50 () {58 vars in 1236 bytes} [Sat Sep 24 05:07:54 2022] GET /compute/v2.1/servers/3e1c080b-492d-4c55-880a-14e89c938fce => generated 1723 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 05:07:55.700590 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-9cf227e8-d923-4ec9-be6d-16237bb11420 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Calling method '>' {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:07:55.701200 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.compute.api [None req-9cf227e8-d923-4ec9-be6d-16237bb11420 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] [instance: 3e1c080b-492d-4c55-880a-14e89c938fce] Fetching instance by UUID {{(pid=120593) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:07:55.707742 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-9cf227e8-d923-4ec9-be6d-16237bb11420 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:07:55.708254 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-9cf227e8-d923-4ec9-be6d-16237bb11420 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:07:55.708698 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-9cf227e8-d923-4ec9-be6d-16237bb11420 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:07:55.709389 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-9cf227e8-d923-4ec9-be6d-16237bb11420 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:07:55.709846 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-9cf227e8-d923-4ec9-be6d-16237bb11420 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:07:55.710468 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-9cf227e8-d923-4ec9-be6d-16237bb11420 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:07:55.843257 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-9cf227e8-d923-4ec9-be6d-16237bb11420 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cdd0da2c7bc4139bcd48ef36a2ee183', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a18a3756ba2b460d977f738a115ebfe0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:07:55.851467 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-9cf227e8-d923-4ec9-be6d-16237bb11420 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] 10.222.0.50 "GET /compute/v2.1/servers/3e1c080b-492d-4c55-880a-14e89c938fce" status: 200 len: 1723 microversion: 2.1 time: 0.154819 Sep 24 05:07:55.852029 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 370/767] 10.222.0.50 () {58 vars in 1236 bytes} [Sat Sep 24 05:07:55 2022] GET /compute/v2.1/servers/3e1c080b-492d-4c55-880a-14e89c938fce => generated 1723 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 05:07:56.875034 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-f5b5333a-573a-4e44-b573-a4b9ff229f1f tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Calling method '>' {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:07:56.875592 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.compute.api [None req-f5b5333a-573a-4e44-b573-a4b9ff229f1f tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] [instance: 3e1c080b-492d-4c55-880a-14e89c938fce] Fetching instance by UUID {{(pid=120594) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:07:56.881906 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-f5b5333a-573a-4e44-b573-a4b9ff229f1f tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:07:56.882410 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-f5b5333a-573a-4e44-b573-a4b9ff229f1f tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:07:56.882847 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-f5b5333a-573a-4e44-b573-a4b9ff229f1f tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:07:56.883521 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-f5b5333a-573a-4e44-b573-a4b9ff229f1f tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:07:56.883963 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-f5b5333a-573a-4e44-b573-a4b9ff229f1f tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:07:56.884376 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-f5b5333a-573a-4e44-b573-a4b9ff229f1f tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:07:57.015283 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.policy [None req-f5b5333a-573a-4e44-b573-a4b9ff229f1f tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cdd0da2c7bc4139bcd48ef36a2ee183', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a18a3756ba2b460d977f738a115ebfe0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:07:57.023359 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [None req-f5b5333a-573a-4e44-b573-a4b9ff229f1f tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] 10.222.0.50 "GET /compute/v2.1/servers/3e1c080b-492d-4c55-880a-14e89c938fce" status: 200 len: 1729 microversion: 2.1 time: 0.152221 Sep 24 05:07:57.023915 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 398/768] 10.222.0.50 () {58 vars in 1236 bytes} [Sat Sep 24 05:07:56 2022] GET /compute/v2.1/servers/3e1c080b-492d-4c55-880a-14e89c938fce => generated 1729 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 05:07:57.045946 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-500d88f8-a1fd-426b-80ae-7e328532c3ba tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Calling method '>' {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:07:57.046535 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.compute.api [None req-500d88f8-a1fd-426b-80ae-7e328532c3ba tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] [instance: 3e1c080b-492d-4c55-880a-14e89c938fce] Fetching instance by UUID {{(pid=120593) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:07:57.052682 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-500d88f8-a1fd-426b-80ae-7e328532c3ba tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:07:57.053159 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-500d88f8-a1fd-426b-80ae-7e328532c3ba tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:07:57.053590 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-500d88f8-a1fd-426b-80ae-7e328532c3ba tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:07:57.054309 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-500d88f8-a1fd-426b-80ae-7e328532c3ba tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:07:57.054759 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-500d88f8-a1fd-426b-80ae-7e328532c3ba tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:07:57.055178 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-500d88f8-a1fd-426b-80ae-7e328532c3ba tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:07:57.132422 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-500d88f8-a1fd-426b-80ae-7e328532c3ba tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] 10.222.0.50 "GET /compute/v2.1/servers/3e1c080b-492d-4c55-880a-14e89c938fce/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.090219 Sep 24 05:07:57.133049 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 371/769] 10.222.0.50 () {58 vars in 1275 bytes} [Sat Sep 24 05:07:57 2022] GET /compute/v2.1/servers/3e1c080b-492d-4c55-880a-14e89c938fce/os-interface => generated 285 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 05:07:58.040087 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [req-ceff7be1-3d9e-482a-bca0-8244648eca56 req-dc9dfc33-a4d5-4ef7-ba3f-5bf92eaae381 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3e1c080b-492d-4c55-880a-14e89c938fce", "tag": "a8325a52-865f-4aa2-a4eb-6cb94768def7"}]} {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 05:07:58.049920 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [req-ceff7be1-3d9e-482a-bca0-8244648eca56 req-dc9dfc33-a4d5-4ef7-ba3f-5bf92eaae381 service nova] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:07:58.050421 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [req-ceff7be1-3d9e-482a-bca0-8244648eca56 req-dc9dfc33-a4d5-4ef7-ba3f-5bf92eaae381 service nova] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:07:58.050850 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [req-ceff7be1-3d9e-482a-bca0-8244648eca56 req-dc9dfc33-a4d5-4ef7-ba3f-5bf92eaae381 service nova] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:07:58.070406 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: INFO nova.api.openstack.compute.server_external_events [req-ceff7be1-3d9e-482a-bca0-8244648eca56 req-dc9dfc33-a4d5-4ef7-ba3f-5bf92eaae381 service nova] Creating event network-changed:a8325a52-865f-4aa2-a4eb-6cb94768def7 for instance 3e1c080b-492d-4c55-880a-14e89c938fce on hv-cinder-85918 Sep 24 05:07:58.076809 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [req-ceff7be1-3d9e-482a-bca0-8244648eca56 req-dc9dfc33-a4d5-4ef7-ba3f-5bf92eaae381 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040249 Sep 24 05:07:58.078224 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 399/770] 10.222.0.50 () {64 vars in 1317 bytes} [Sat Sep 24 05:07:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 05:08:00.095499 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [req-7c9a0287-734c-4aed-885b-bb8b2e5000ad req-48893813-8e2a-4c62-bcfe-544af18abab6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3e1c080b-492d-4c55-880a-14e89c938fce", "tag": "a8325a52-865f-4aa2-a4eb-6cb94768def7"}]} {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 05:08:00.105574 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [req-7c9a0287-734c-4aed-885b-bb8b2e5000ad req-48893813-8e2a-4c62-bcfe-544af18abab6 service nova] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:08:00.106066 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [req-7c9a0287-734c-4aed-885b-bb8b2e5000ad req-48893813-8e2a-4c62-bcfe-544af18abab6 service nova] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:08:00.106496 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [req-7c9a0287-734c-4aed-885b-bb8b2e5000ad req-48893813-8e2a-4c62-bcfe-544af18abab6 service nova] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:08:00.117667 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.compute.server_external_events [req-7c9a0287-734c-4aed-885b-bb8b2e5000ad req-48893813-8e2a-4c62-bcfe-544af18abab6 service nova] Creating event network-changed:a8325a52-865f-4aa2-a4eb-6cb94768def7 for instance 3e1c080b-492d-4c55-880a-14e89c938fce on hv-cinder-85918 Sep 24 05:08:00.123126 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [req-7c9a0287-734c-4aed-885b-bb8b2e5000ad req-48893813-8e2a-4c62-bcfe-544af18abab6 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031812 Sep 24 05:08:00.123687 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 372/771] 10.222.0.50 () {64 vars in 1317 bytes} [Sat Sep 24 05:08:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 05:08:15.454009 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG dbcounter [-] [120594] Writing DB stats nova_cell0:SELECT=4 {{(pid=120594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 05:08:15.455708 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG dbcounter [-] [120594] Writing DB stats nova_api:SELECT=24,nova_api:INSERT=1 {{(pid=120594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 05:08:15.456385 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG dbcounter [-] [120594] Writing DB stats nova_cell1:SELECT=41,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 05:08:15.460922 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-73c34c2e-3f36-4c89-b33e-e503e51baf6f tempest-TestVolumeBootPattern-1339481357 tempest-TestVolumeBootPattern-1339481357-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-483117504", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-418909133", "security_groups": [{"name": "tempest-secgroup-smoke-1562507068"}], "block_device_mapping_v2": [{"uuid": "7bf50ac5-4831-47b0-a1e0-02a155eaedde", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "fcf1ce32-3017-4bcb-b05f-9527ef64d665"}]}} {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 05:08:15.573085 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.network.neutron [None req-73c34c2e-3f36-4c89-b33e-e503e51baf6f tempest-TestVolumeBootPattern-1339481357 tempest-TestVolumeBootPattern-1339481357-project] validate_networks() for [('fcf1ce32-3017-4bcb-b05f-9527ef64d665', None, None, None, None, None)] {{(pid=120594) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 24 05:08:16.134908 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.virt.hardware [None req-73c34c2e-3f36-4c89-b33e-e503e51baf6f tempest-TestVolumeBootPattern-1339481357 tempest-TestVolumeBootPattern-1339481357-project] Flavor limits 0:0:0 {{(pid=120594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 24 05:08:16.135330 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.virt.hardware [None req-73c34c2e-3f36-4c89-b33e-e503e51baf6f tempest-TestVolumeBootPattern-1339481357 tempest-TestVolumeBootPattern-1339481357-project] Image limits 0:0:0 {{(pid=120594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 24 05:08:16.135798 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.virt.hardware [None req-73c34c2e-3f36-4c89-b33e-e503e51baf6f tempest-TestVolumeBootPattern-1339481357 tempest-TestVolumeBootPattern-1339481357-project] Flavor pref 0:0:0 {{(pid=120594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 24 05:08:16.136232 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.virt.hardware [None req-73c34c2e-3f36-4c89-b33e-e503e51baf6f tempest-TestVolumeBootPattern-1339481357 tempest-TestVolumeBootPattern-1339481357-project] Image pref 0:0:0 {{(pid=120594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 24 05:08:16.136635 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.virt.hardware [None req-73c34c2e-3f36-4c89-b33e-e503e51baf6f tempest-TestVolumeBootPattern-1339481357 tempest-TestVolumeBootPattern-1339481357-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 24 05:08:16.146416 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-73c34c2e-3f36-4c89-b33e-e503e51baf6f tempest-TestVolumeBootPattern-1339481357 tempest-TestVolumeBootPattern-1339481357-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:08:16.146887 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-73c34c2e-3f36-4c89-b33e-e503e51baf6f tempest-TestVolumeBootPattern-1339481357 tempest-TestVolumeBootPattern-1339481357-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:08:16.147316 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-73c34c2e-3f36-4c89-b33e-e503e51baf6f tempest-TestVolumeBootPattern-1339481357 tempest-TestVolumeBootPattern-1339481357-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:08:16.148035 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-73c34c2e-3f36-4c89-b33e-e503e51baf6f tempest-TestVolumeBootPattern-1339481357 tempest-TestVolumeBootPattern-1339481357-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:08:16.148485 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-73c34c2e-3f36-4c89-b33e-e503e51baf6f tempest-TestVolumeBootPattern-1339481357 tempest-TestVolumeBootPattern-1339481357-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:08:16.148905 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-73c34c2e-3f36-4c89-b33e-e503e51baf6f tempest-TestVolumeBootPattern-1339481357 tempest-TestVolumeBootPattern-1339481357-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:08:16.165597 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.quota [None req-73c34c2e-3f36-4c89-b33e-e503e51baf6f tempest-TestVolumeBootPattern-1339481357 tempest-TestVolumeBootPattern-1339481357-project] Getting quotas for project fef19544ec414094953daea6d545a361. Resources: {'instances', 'ram', 'cores'} {{(pid=120594) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 24 05:08:16.170123 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.quota [None req-73c34c2e-3f36-4c89-b33e-e503e51baf6f tempest-TestVolumeBootPattern-1339481357 tempest-TestVolumeBootPattern-1339481357-project] Getting quotas for user 60edcebcccaa4da99ffddadd3e27c1c0 and project fef19544ec414094953daea6d545a361. Resources: {'instances', 'ram', 'cores'} {{(pid=120594) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 24 05:08:16.226467 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.compute.api [None req-73c34c2e-3f36-4c89-b33e-e503e51baf6f tempest-TestVolumeBootPattern-1339481357 tempest-TestVolumeBootPattern-1339481357-project] Going to run 1 instances... {{(pid=120594) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 24 05:08:16.228769 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.compute.api [None req-73c34c2e-3f36-4c89-b33e-e503e51baf6f tempest-TestVolumeBootPattern-1339481357 tempest-TestVolumeBootPattern-1339481357-project] [instance: dd7d8b54-2d8e-4a74-912f-4eab2ccf2125] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='7bf50ac5-4831-47b0-a1e0-02a155eaedde',volume_size=None,volume_type=None)] {{(pid=120594) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 24 05:08:16.356253 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [None req-73c34c2e-3f36-4c89-b33e-e503e51baf6f tempest-TestVolumeBootPattern-1339481357 tempest-TestVolumeBootPattern-1339481357-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.903029 Sep 24 05:08:16.356895 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 400/772] 10.222.0.50 () {60 vars in 1147 bytes} [Sat Sep 24 05:08:15 2022] POST /compute/v2.1/servers => generated 406 bytes in 904 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 24 05:08:16.366198 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG dbcounter [-] [120593] Writing DB stats nova_api:SELECT=28 {{(pid=120593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 05:08:16.366936 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG dbcounter [-] [120593] Writing DB stats nova_cell1:SELECT=87,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 05:08:16.373401 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-781d49c5-0a3d-4685-8e65-ffd977f06279 tempest-TestVolumeBootPattern-1339481357 tempest-TestVolumeBootPattern-1339481357-project] Calling method '>' {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:08:16.374133 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.compute.api [None req-781d49c5-0a3d-4685-8e65-ffd977f06279 tempest-TestVolumeBootPattern-1339481357 tempest-TestVolumeBootPattern-1339481357-project] [instance: dd7d8b54-2d8e-4a74-912f-4eab2ccf2125] Fetching instance by UUID {{(pid=120593) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:08:16.431270 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-781d49c5-0a3d-4685-8e65-ffd977f06279 tempest-TestVolumeBootPattern-1339481357 tempest-TestVolumeBootPattern-1339481357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60edcebcccaa4da99ffddadd3e27c1c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fef19544ec414094953daea6d545a361', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:08:16.440971 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-781d49c5-0a3d-4685-8e65-ffd977f06279 tempest-TestVolumeBootPattern-1339481357 tempest-TestVolumeBootPattern-1339481357-project] 10.222.0.50 "GET /compute/v2.1/servers/dd7d8b54-2d8e-4a74-912f-4eab2ccf2125" status: 200 len: 1093 microversion: 2.1 time: 0.076759 Sep 24 05:08:16.441546 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 373/773] 10.222.0.50 () {58 vars in 1236 bytes} [Sat Sep 24 05:08:16 2022] GET /compute/v2.1/servers/dd7d8b54-2d8e-4a74-912f-4eab2ccf2125 => generated 1093 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 05:08:17.462831 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-73869868-7fbe-47ab-afa3-b761ef9fe071 tempest-TestVolumeBootPattern-1339481357 tempest-TestVolumeBootPattern-1339481357-project] Calling method '>' {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:08:17.463434 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.compute.api [None req-73869868-7fbe-47ab-afa3-b761ef9fe071 tempest-TestVolumeBootPattern-1339481357 tempest-TestVolumeBootPattern-1339481357-project] [instance: dd7d8b54-2d8e-4a74-912f-4eab2ccf2125] Fetching instance by UUID {{(pid=120594) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:08:17.470638 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-73869868-7fbe-47ab-afa3-b761ef9fe071 tempest-TestVolumeBootPattern-1339481357 tempest-TestVolumeBootPattern-1339481357-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:08:17.471422 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-73869868-7fbe-47ab-afa3-b761ef9fe071 tempest-TestVolumeBootPattern-1339481357 tempest-TestVolumeBootPattern-1339481357-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:08:17.471868 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-73869868-7fbe-47ab-afa3-b761ef9fe071 tempest-TestVolumeBootPattern-1339481357 tempest-TestVolumeBootPattern-1339481357-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:08:17.472705 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-73869868-7fbe-47ab-afa3-b761ef9fe071 tempest-TestVolumeBootPattern-1339481357 tempest-TestVolumeBootPattern-1339481357-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:08:17.473150 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-73869868-7fbe-47ab-afa3-b761ef9fe071 tempest-TestVolumeBootPattern-1339481357 tempest-TestVolumeBootPattern-1339481357-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:08:17.473571 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-73869868-7fbe-47ab-afa3-b761ef9fe071 tempest-TestVolumeBootPattern-1339481357 tempest-TestVolumeBootPattern-1339481357-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:08:17.536373 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.policy [None req-73869868-7fbe-47ab-afa3-b761ef9fe071 tempest-TestVolumeBootPattern-1339481357 tempest-TestVolumeBootPattern-1339481357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60edcebcccaa4da99ffddadd3e27c1c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fef19544ec414094953daea6d545a361', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:08:17.544041 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [None req-73869868-7fbe-47ab-afa3-b761ef9fe071 tempest-TestVolumeBootPattern-1339481357 tempest-TestVolumeBootPattern-1339481357-project] 10.222.0.50 "GET /compute/v2.1/servers/dd7d8b54-2d8e-4a74-912f-4eab2ccf2125" status: 200 len: 1191 microversion: 2.1 time: 0.085080 Sep 24 05:08:17.545511 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 401/774] 10.222.0.50 () {58 vars in 1236 bytes} [Sat Sep 24 05:08:17 2022] GET /compute/v2.1/servers/dd7d8b54-2d8e-4a74-912f-4eab2ccf2125 => generated 1191 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 05:08:18.569162 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-ca7f7e62-fb54-4522-8c09-6e9c2d5b33eb tempest-TestVolumeBootPattern-1339481357 tempest-TestVolumeBootPattern-1339481357-project] Calling method '>' {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:08:18.569809 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.compute.api [None req-ca7f7e62-fb54-4522-8c09-6e9c2d5b33eb tempest-TestVolumeBootPattern-1339481357 tempest-TestVolumeBootPattern-1339481357-project] [instance: dd7d8b54-2d8e-4a74-912f-4eab2ccf2125] Fetching instance by UUID {{(pid=120593) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:08:18.576634 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-ca7f7e62-fb54-4522-8c09-6e9c2d5b33eb tempest-TestVolumeBootPattern-1339481357 tempest-TestVolumeBootPattern-1339481357-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:08:18.577174 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-ca7f7e62-fb54-4522-8c09-6e9c2d5b33eb tempest-TestVolumeBootPattern-1339481357 tempest-TestVolumeBootPattern-1339481357-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:08:18.577661 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-ca7f7e62-fb54-4522-8c09-6e9c2d5b33eb tempest-TestVolumeBootPattern-1339481357 tempest-TestVolumeBootPattern-1339481357-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:08:18.578498 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-ca7f7e62-fb54-4522-8c09-6e9c2d5b33eb tempest-TestVolumeBootPattern-1339481357 tempest-TestVolumeBootPattern-1339481357-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:08:18.579005 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-ca7f7e62-fb54-4522-8c09-6e9c2d5b33eb tempest-TestVolumeBootPattern-1339481357 tempest-TestVolumeBootPattern-1339481357-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:08:18.579491 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-ca7f7e62-fb54-4522-8c09-6e9c2d5b33eb tempest-TestVolumeBootPattern-1339481357 tempest-TestVolumeBootPattern-1339481357-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:08:18.724707 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-ca7f7e62-fb54-4522-8c09-6e9c2d5b33eb tempest-TestVolumeBootPattern-1339481357 tempest-TestVolumeBootPattern-1339481357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60edcebcccaa4da99ffddadd3e27c1c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fef19544ec414094953daea6d545a361', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:08:18.733389 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-ca7f7e62-fb54-4522-8c09-6e9c2d5b33eb tempest-TestVolumeBootPattern-1339481357 tempest-TestVolumeBootPattern-1339481357-project] 10.222.0.50 "GET /compute/v2.1/servers/dd7d8b54-2d8e-4a74-912f-4eab2ccf2125" status: 200 len: 1265 microversion: 2.1 time: 0.168131 Sep 24 05:08:18.734028 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 374/775] 10.222.0.50 () {58 vars in 1236 bytes} [Sat Sep 24 05:08:18 2022] GET /compute/v2.1/servers/dd7d8b54-2d8e-4a74-912f-4eab2ccf2125 => generated 1265 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 05:08:19.220898 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [req-e14b2853-ff7b-4007-9e35-55e1dbf2b797 req-cbc7dcfa-854d-4b0a-be21-3f28d5786a3c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dd7d8b54-2d8e-4a74-912f-4eab2ccf2125", "tag": "fa86687e-cf6d-40ae-a41d-fc0072b18085"}]} {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 05:08:19.230602 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [req-e14b2853-ff7b-4007-9e35-55e1dbf2b797 req-cbc7dcfa-854d-4b0a-be21-3f28d5786a3c service nova] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:08:19.231072 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [req-e14b2853-ff7b-4007-9e35-55e1dbf2b797 req-cbc7dcfa-854d-4b0a-be21-3f28d5786a3c service nova] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:08:19.231497 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [req-e14b2853-ff7b-4007-9e35-55e1dbf2b797 req-cbc7dcfa-854d-4b0a-be21-3f28d5786a3c service nova] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:08:19.244010 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: INFO nova.api.openstack.compute.server_external_events [req-e14b2853-ff7b-4007-9e35-55e1dbf2b797 req-cbc7dcfa-854d-4b0a-be21-3f28d5786a3c service nova] Creating event network-changed:fa86687e-cf6d-40ae-a41d-fc0072b18085 for instance dd7d8b54-2d8e-4a74-912f-4eab2ccf2125 on hv-cinder-85918 Sep 24 05:08:19.248735 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [req-e14b2853-ff7b-4007-9e35-55e1dbf2b797 req-cbc7dcfa-854d-4b0a-be21-3f28d5786a3c service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032689 Sep 24 05:08:19.249622 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 402/776] 10.222.0.50 () {64 vars in 1317 bytes} [Sat Sep 24 05:08:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 05:08:19.756688 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-26fd0251-a259-4ff4-b84b-341fb7a08105 tempest-TestVolumeBootPattern-1339481357 tempest-TestVolumeBootPattern-1339481357-project] Calling method '>' {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:08:19.757302 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.compute.api [None req-26fd0251-a259-4ff4-b84b-341fb7a08105 tempest-TestVolumeBootPattern-1339481357 tempest-TestVolumeBootPattern-1339481357-project] [instance: dd7d8b54-2d8e-4a74-912f-4eab2ccf2125] Fetching instance by UUID {{(pid=120593) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:08:19.764301 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-26fd0251-a259-4ff4-b84b-341fb7a08105 tempest-TestVolumeBootPattern-1339481357 tempest-TestVolumeBootPattern-1339481357-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:08:19.764784 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-26fd0251-a259-4ff4-b84b-341fb7a08105 tempest-TestVolumeBootPattern-1339481357 tempest-TestVolumeBootPattern-1339481357-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:08:19.765216 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-26fd0251-a259-4ff4-b84b-341fb7a08105 tempest-TestVolumeBootPattern-1339481357 tempest-TestVolumeBootPattern-1339481357-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:08:19.765901 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-26fd0251-a259-4ff4-b84b-341fb7a08105 tempest-TestVolumeBootPattern-1339481357 tempest-TestVolumeBootPattern-1339481357-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:08:19.766381 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-26fd0251-a259-4ff4-b84b-341fb7a08105 tempest-TestVolumeBootPattern-1339481357 tempest-TestVolumeBootPattern-1339481357-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:08:19.766805 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-26fd0251-a259-4ff4-b84b-341fb7a08105 tempest-TestVolumeBootPattern-1339481357 tempest-TestVolumeBootPattern-1339481357-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:08:19.894809 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-26fd0251-a259-4ff4-b84b-341fb7a08105 tempest-TestVolumeBootPattern-1339481357 tempest-TestVolumeBootPattern-1339481357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60edcebcccaa4da99ffddadd3e27c1c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fef19544ec414094953daea6d545a361', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:08:19.902443 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-26fd0251-a259-4ff4-b84b-341fb7a08105 tempest-TestVolumeBootPattern-1339481357 tempest-TestVolumeBootPattern-1339481357-project] 10.222.0.50 "GET /compute/v2.1/servers/dd7d8b54-2d8e-4a74-912f-4eab2ccf2125" status: 200 len: 1265 microversion: 2.1 time: 0.149644 Sep 24 05:08:19.902993 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 375/777] 10.222.0.50 () {58 vars in 1236 bytes} [Sat Sep 24 05:08:19 2022] GET /compute/v2.1/servers/dd7d8b54-2d8e-4a74-912f-4eab2ccf2125 => generated 1265 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 05:08:20.926453 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-f6669c8d-2c9e-4019-b655-07e1280369a6 tempest-TestVolumeBootPattern-1339481357 tempest-TestVolumeBootPattern-1339481357-project] Calling method '>' {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:08:20.927095 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.compute.api [None req-f6669c8d-2c9e-4019-b655-07e1280369a6 tempest-TestVolumeBootPattern-1339481357 tempest-TestVolumeBootPattern-1339481357-project] [instance: dd7d8b54-2d8e-4a74-912f-4eab2ccf2125] Fetching instance by UUID {{(pid=120594) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:08:20.933154 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-f6669c8d-2c9e-4019-b655-07e1280369a6 tempest-TestVolumeBootPattern-1339481357 tempest-TestVolumeBootPattern-1339481357-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:08:20.933632 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-f6669c8d-2c9e-4019-b655-07e1280369a6 tempest-TestVolumeBootPattern-1339481357 tempest-TestVolumeBootPattern-1339481357-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:08:20.934095 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-f6669c8d-2c9e-4019-b655-07e1280369a6 tempest-TestVolumeBootPattern-1339481357 tempest-TestVolumeBootPattern-1339481357-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:08:20.934821 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-f6669c8d-2c9e-4019-b655-07e1280369a6 tempest-TestVolumeBootPattern-1339481357 tempest-TestVolumeBootPattern-1339481357-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:08:20.935276 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-f6669c8d-2c9e-4019-b655-07e1280369a6 tempest-TestVolumeBootPattern-1339481357 tempest-TestVolumeBootPattern-1339481357-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:08:20.935700 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-f6669c8d-2c9e-4019-b655-07e1280369a6 tempest-TestVolumeBootPattern-1339481357 tempest-TestVolumeBootPattern-1339481357-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:08:21.073607 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.policy [None req-f6669c8d-2c9e-4019-b655-07e1280369a6 tempest-TestVolumeBootPattern-1339481357 tempest-TestVolumeBootPattern-1339481357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60edcebcccaa4da99ffddadd3e27c1c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fef19544ec414094953daea6d545a361', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:08:21.082538 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [None req-f6669c8d-2c9e-4019-b655-07e1280369a6 tempest-TestVolumeBootPattern-1339481357 tempest-TestVolumeBootPattern-1339481357-project] 10.222.0.50 "GET /compute/v2.1/servers/dd7d8b54-2d8e-4a74-912f-4eab2ccf2125" status: 200 len: 1265 microversion: 2.1 time: 0.160534 Sep 24 05:08:21.083112 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 403/778] 10.222.0.50 () {58 vars in 1236 bytes} [Sat Sep 24 05:08:20 2022] GET /compute/v2.1/servers/dd7d8b54-2d8e-4a74-912f-4eab2ccf2125 => generated 1265 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 05:08:22.106384 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-ac5f5556-0630-499d-a796-a6c93f3d1351 tempest-TestVolumeBootPattern-1339481357 tempest-TestVolumeBootPattern-1339481357-project] Calling method '>' {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:08:22.106986 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.compute.api [None req-ac5f5556-0630-499d-a796-a6c93f3d1351 tempest-TestVolumeBootPattern-1339481357 tempest-TestVolumeBootPattern-1339481357-project] [instance: dd7d8b54-2d8e-4a74-912f-4eab2ccf2125] Fetching instance by UUID {{(pid=120593) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:08:22.113201 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-ac5f5556-0630-499d-a796-a6c93f3d1351 tempest-TestVolumeBootPattern-1339481357 tempest-TestVolumeBootPattern-1339481357-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:08:22.113669 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-ac5f5556-0630-499d-a796-a6c93f3d1351 tempest-TestVolumeBootPattern-1339481357 tempest-TestVolumeBootPattern-1339481357-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:08:22.114139 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-ac5f5556-0630-499d-a796-a6c93f3d1351 tempest-TestVolumeBootPattern-1339481357 tempest-TestVolumeBootPattern-1339481357-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:08:22.114845 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-ac5f5556-0630-499d-a796-a6c93f3d1351 tempest-TestVolumeBootPattern-1339481357 tempest-TestVolumeBootPattern-1339481357-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:08:22.115287 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-ac5f5556-0630-499d-a796-a6c93f3d1351 tempest-TestVolumeBootPattern-1339481357 tempest-TestVolumeBootPattern-1339481357-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:08:22.115703 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-ac5f5556-0630-499d-a796-a6c93f3d1351 tempest-TestVolumeBootPattern-1339481357 tempest-TestVolumeBootPattern-1339481357-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:08:22.242519 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-ac5f5556-0630-499d-a796-a6c93f3d1351 tempest-TestVolumeBootPattern-1339481357 tempest-TestVolumeBootPattern-1339481357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60edcebcccaa4da99ffddadd3e27c1c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fef19544ec414094953daea6d545a361', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:08:22.250048 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-ac5f5556-0630-499d-a796-a6c93f3d1351 tempest-TestVolumeBootPattern-1339481357 tempest-TestVolumeBootPattern-1339481357-project] 10.222.0.50 "GET /compute/v2.1/servers/dd7d8b54-2d8e-4a74-912f-4eab2ccf2125" status: 200 len: 1265 microversion: 2.1 time: 0.147514 Sep 24 05:08:22.250609 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 376/779] 10.222.0.50 () {58 vars in 1236 bytes} [Sat Sep 24 05:08:22 2022] GET /compute/v2.1/servers/dd7d8b54-2d8e-4a74-912f-4eab2ccf2125 => generated 1265 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 05:08:23.278255 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-fe9aba96-341a-40e7-a116-79aceb368d2f tempest-TestVolumeBootPattern-1339481357 tempest-TestVolumeBootPattern-1339481357-project] Calling method '>' {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:08:23.278860 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.compute.api [None req-fe9aba96-341a-40e7-a116-79aceb368d2f tempest-TestVolumeBootPattern-1339481357 tempest-TestVolumeBootPattern-1339481357-project] [instance: dd7d8b54-2d8e-4a74-912f-4eab2ccf2125] Fetching instance by UUID {{(pid=120594) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:08:23.285363 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-fe9aba96-341a-40e7-a116-79aceb368d2f tempest-TestVolumeBootPattern-1339481357 tempest-TestVolumeBootPattern-1339481357-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:08:23.285835 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-fe9aba96-341a-40e7-a116-79aceb368d2f tempest-TestVolumeBootPattern-1339481357 tempest-TestVolumeBootPattern-1339481357-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:08:23.286295 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-fe9aba96-341a-40e7-a116-79aceb368d2f tempest-TestVolumeBootPattern-1339481357 tempest-TestVolumeBootPattern-1339481357-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:08:23.286972 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-fe9aba96-341a-40e7-a116-79aceb368d2f tempest-TestVolumeBootPattern-1339481357 tempest-TestVolumeBootPattern-1339481357-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:08:23.287416 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-fe9aba96-341a-40e7-a116-79aceb368d2f tempest-TestVolumeBootPattern-1339481357 tempest-TestVolumeBootPattern-1339481357-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:08:23.287835 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-fe9aba96-341a-40e7-a116-79aceb368d2f tempest-TestVolumeBootPattern-1339481357 tempest-TestVolumeBootPattern-1339481357-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:08:23.418880 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.policy [None req-fe9aba96-341a-40e7-a116-79aceb368d2f tempest-TestVolumeBootPattern-1339481357 tempest-TestVolumeBootPattern-1339481357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60edcebcccaa4da99ffddadd3e27c1c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fef19544ec414094953daea6d545a361', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:08:23.426959 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [None req-fe9aba96-341a-40e7-a116-79aceb368d2f tempest-TestVolumeBootPattern-1339481357 tempest-TestVolumeBootPattern-1339481357-project] 10.222.0.50 "GET /compute/v2.1/servers/dd7d8b54-2d8e-4a74-912f-4eab2ccf2125" status: 200 len: 1265 microversion: 2.1 time: 0.152532 Sep 24 05:08:23.427518 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 404/780] 10.222.0.50 () {58 vars in 1236 bytes} [Sat Sep 24 05:08:23 2022] GET /compute/v2.1/servers/dd7d8b54-2d8e-4a74-912f-4eab2ccf2125 => generated 1265 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 05:08:24.451252 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-bd60a664-add4-4860-a13e-fab2d3093cf9 tempest-TestVolumeBootPattern-1339481357 tempest-TestVolumeBootPattern-1339481357-project] Calling method '>' {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:08:24.451854 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.compute.api [None req-bd60a664-add4-4860-a13e-fab2d3093cf9 tempest-TestVolumeBootPattern-1339481357 tempest-TestVolumeBootPattern-1339481357-project] [instance: dd7d8b54-2d8e-4a74-912f-4eab2ccf2125] Fetching instance by UUID {{(pid=120593) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:08:24.458183 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-bd60a664-add4-4860-a13e-fab2d3093cf9 tempest-TestVolumeBootPattern-1339481357 tempest-TestVolumeBootPattern-1339481357-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:08:24.458653 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-bd60a664-add4-4860-a13e-fab2d3093cf9 tempest-TestVolumeBootPattern-1339481357 tempest-TestVolumeBootPattern-1339481357-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:08:24.459079 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-bd60a664-add4-4860-a13e-fab2d3093cf9 tempest-TestVolumeBootPattern-1339481357 tempest-TestVolumeBootPattern-1339481357-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:08:24.459753 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-bd60a664-add4-4860-a13e-fab2d3093cf9 tempest-TestVolumeBootPattern-1339481357 tempest-TestVolumeBootPattern-1339481357-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:08:24.460195 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-bd60a664-add4-4860-a13e-fab2d3093cf9 tempest-TestVolumeBootPattern-1339481357 tempest-TestVolumeBootPattern-1339481357-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:08:24.460608 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-bd60a664-add4-4860-a13e-fab2d3093cf9 tempest-TestVolumeBootPattern-1339481357 tempest-TestVolumeBootPattern-1339481357-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:08:24.591604 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-bd60a664-add4-4860-a13e-fab2d3093cf9 tempest-TestVolumeBootPattern-1339481357 tempest-TestVolumeBootPattern-1339481357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60edcebcccaa4da99ffddadd3e27c1c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fef19544ec414094953daea6d545a361', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:08:24.599124 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-bd60a664-add4-4860-a13e-fab2d3093cf9 tempest-TestVolumeBootPattern-1339481357 tempest-TestVolumeBootPattern-1339481357-project] 10.222.0.50 "GET /compute/v2.1/servers/dd7d8b54-2d8e-4a74-912f-4eab2ccf2125" status: 200 len: 1265 microversion: 2.1 time: 0.152358 Sep 24 05:08:24.599678 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 377/781] 10.222.0.50 () {58 vars in 1236 bytes} [Sat Sep 24 05:08:24 2022] GET /compute/v2.1/servers/dd7d8b54-2d8e-4a74-912f-4eab2ccf2125 => generated 1265 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 05:08:25.621012 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-86bb817f-27f9-4e78-8e48-04b206857003 tempest-TestVolumeBootPattern-1339481357 tempest-TestVolumeBootPattern-1339481357-project] Calling method '>' {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:08:25.621761 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.compute.api [None req-86bb817f-27f9-4e78-8e48-04b206857003 tempest-TestVolumeBootPattern-1339481357 tempest-TestVolumeBootPattern-1339481357-project] [instance: dd7d8b54-2d8e-4a74-912f-4eab2ccf2125] Fetching instance by UUID {{(pid=120594) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:08:25.628155 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-86bb817f-27f9-4e78-8e48-04b206857003 tempest-TestVolumeBootPattern-1339481357 tempest-TestVolumeBootPattern-1339481357-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:08:25.628623 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-86bb817f-27f9-4e78-8e48-04b206857003 tempest-TestVolumeBootPattern-1339481357 tempest-TestVolumeBootPattern-1339481357-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:08:25.629049 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-86bb817f-27f9-4e78-8e48-04b206857003 tempest-TestVolumeBootPattern-1339481357 tempest-TestVolumeBootPattern-1339481357-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:08:25.629722 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-86bb817f-27f9-4e78-8e48-04b206857003 tempest-TestVolumeBootPattern-1339481357 tempest-TestVolumeBootPattern-1339481357-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:08:25.630189 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-86bb817f-27f9-4e78-8e48-04b206857003 tempest-TestVolumeBootPattern-1339481357 tempest-TestVolumeBootPattern-1339481357-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:08:25.630603 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-86bb817f-27f9-4e78-8e48-04b206857003 tempest-TestVolumeBootPattern-1339481357 tempest-TestVolumeBootPattern-1339481357-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:08:25.759366 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.policy [None req-86bb817f-27f9-4e78-8e48-04b206857003 tempest-TestVolumeBootPattern-1339481357 tempest-TestVolumeBootPattern-1339481357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60edcebcccaa4da99ffddadd3e27c1c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fef19544ec414094953daea6d545a361', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:08:25.767500 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [None req-86bb817f-27f9-4e78-8e48-04b206857003 tempest-TestVolumeBootPattern-1339481357 tempest-TestVolumeBootPattern-1339481357-project] 10.222.0.50 "GET /compute/v2.1/servers/dd7d8b54-2d8e-4a74-912f-4eab2ccf2125" status: 200 len: 1265 microversion: 2.1 time: 0.150295 Sep 24 05:08:25.768062 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 405/782] 10.222.0.50 () {58 vars in 1236 bytes} [Sat Sep 24 05:08:25 2022] GET /compute/v2.1/servers/dd7d8b54-2d8e-4a74-912f-4eab2ccf2125 => generated 1265 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 05:08:26.608314 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-57315379-512b-43e5-9234-016a58a7b9c9 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Calling method '>' {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:08:26.608800 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.compute.api [None req-57315379-512b-43e5-9234-016a58a7b9c9 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] [instance: b2daebb8-dfea-4ab9-8253-008a21f906e1] Fetching instance by UUID {{(pid=120593) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:08:26.611117 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG dbcounter [-] [120593] Writing DB stats nova_cell0:SELECT=2 {{(pid=120593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 05:08:26.617161 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-57315379-512b-43e5-9234-016a58a7b9c9 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:08:26.617641 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-57315379-512b-43e5-9234-016a58a7b9c9 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:08:26.618097 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-57315379-512b-43e5-9234-016a58a7b9c9 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:08:26.618792 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-57315379-512b-43e5-9234-016a58a7b9c9 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:08:26.619239 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-57315379-512b-43e5-9234-016a58a7b9c9 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:08:26.619668 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-57315379-512b-43e5-9234-016a58a7b9c9 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:08:26.700776 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.objects.instance [None req-57315379-512b-43e5-9234-016a58a7b9c9 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Lazy-loading 'services' on Instance uuid b2daebb8-dfea-4ab9-8253-008a21f906e1 {{(pid=120593) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 24 05:08:26.773951 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-57315379-512b-43e5-9234-016a58a7b9c9 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] 10.222.0.50 "DELETE /compute/v2.1/servers/b2daebb8-dfea-4ab9-8253-008a21f906e1/os-volume_attachments/5eb09f77-d070-410b-a45a-4b4937e742b7" status: 202 len: 0 microversion: 2.1 time: 0.169869 Sep 24 05:08:26.774568 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 378/783] 10.222.0.50 () {58 vars in 1416 bytes} [Sat Sep 24 05:08:26 2022] DELETE /compute/v2.1/servers/b2daebb8-dfea-4ab9-8253-008a21f906e1/os-volume_attachments/5eb09f77-d070-410b-a45a-4b4937e742b7 => generated 0 bytes in 171 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 24 05:08:26.791608 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-40c48db2-9e91-45f0-8499-f7dddab5529b tempest-TestVolumeBootPattern-1339481357 tempest-TestVolumeBootPattern-1339481357-project] Calling method '>' {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:08:26.792217 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.compute.api [None req-40c48db2-9e91-45f0-8499-f7dddab5529b tempest-TestVolumeBootPattern-1339481357 tempest-TestVolumeBootPattern-1339481357-project] [instance: dd7d8b54-2d8e-4a74-912f-4eab2ccf2125] Fetching instance by UUID {{(pid=120594) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:08:26.795783 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG dbcounter [-] [120594] Writing DB stats nova_cell0:SELECT=2 {{(pid=120594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 05:08:26.797089 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG dbcounter [-] [120594] Writing DB stats nova_cell0:SELECT=6 {{(pid=120594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 05:08:26.802979 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-40c48db2-9e91-45f0-8499-f7dddab5529b tempest-TestVolumeBootPattern-1339481357 tempest-TestVolumeBootPattern-1339481357-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:08:26.803465 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-40c48db2-9e91-45f0-8499-f7dddab5529b tempest-TestVolumeBootPattern-1339481357 tempest-TestVolumeBootPattern-1339481357-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:08:26.803932 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-40c48db2-9e91-45f0-8499-f7dddab5529b tempest-TestVolumeBootPattern-1339481357 tempest-TestVolumeBootPattern-1339481357-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:08:26.804633 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-40c48db2-9e91-45f0-8499-f7dddab5529b tempest-TestVolumeBootPattern-1339481357 tempest-TestVolumeBootPattern-1339481357-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:08:26.805081 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-40c48db2-9e91-45f0-8499-f7dddab5529b tempest-TestVolumeBootPattern-1339481357 tempest-TestVolumeBootPattern-1339481357-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:08:26.805504 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-40c48db2-9e91-45f0-8499-f7dddab5529b tempest-TestVolumeBootPattern-1339481357 tempest-TestVolumeBootPattern-1339481357-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:08:26.938846 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.policy [None req-40c48db2-9e91-45f0-8499-f7dddab5529b tempest-TestVolumeBootPattern-1339481357 tempest-TestVolumeBootPattern-1339481357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60edcebcccaa4da99ffddadd3e27c1c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fef19544ec414094953daea6d545a361', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:08:26.946896 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [None req-40c48db2-9e91-45f0-8499-f7dddab5529b tempest-TestVolumeBootPattern-1339481357 tempest-TestVolumeBootPattern-1339481357-project] 10.222.0.50 "GET /compute/v2.1/servers/dd7d8b54-2d8e-4a74-912f-4eab2ccf2125" status: 200 len: 1265 microversion: 2.1 time: 0.159087 Sep 24 05:08:26.947465 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 406/784] 10.222.0.50 () {58 vars in 1236 bytes} [Sat Sep 24 05:08:26 2022] GET /compute/v2.1/servers/dd7d8b54-2d8e-4a74-912f-4eab2ccf2125 => generated 1265 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 05:08:27.970497 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-d72df58c-a08e-45f2-b71e-94a9393e44d1 tempest-TestVolumeBootPattern-1339481357 tempest-TestVolumeBootPattern-1339481357-project] Calling method '>' {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:08:27.971191 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.compute.api [None req-d72df58c-a08e-45f2-b71e-94a9393e44d1 tempest-TestVolumeBootPattern-1339481357 tempest-TestVolumeBootPattern-1339481357-project] [instance: dd7d8b54-2d8e-4a74-912f-4eab2ccf2125] Fetching instance by UUID {{(pid=120593) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:08:27.977190 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-d72df58c-a08e-45f2-b71e-94a9393e44d1 tempest-TestVolumeBootPattern-1339481357 tempest-TestVolumeBootPattern-1339481357-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:08:27.977661 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-d72df58c-a08e-45f2-b71e-94a9393e44d1 tempest-TestVolumeBootPattern-1339481357 tempest-TestVolumeBootPattern-1339481357-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:08:27.978116 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-d72df58c-a08e-45f2-b71e-94a9393e44d1 tempest-TestVolumeBootPattern-1339481357 tempest-TestVolumeBootPattern-1339481357-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:08:27.978796 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-d72df58c-a08e-45f2-b71e-94a9393e44d1 tempest-TestVolumeBootPattern-1339481357 tempest-TestVolumeBootPattern-1339481357-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:08:27.979240 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-d72df58c-a08e-45f2-b71e-94a9393e44d1 tempest-TestVolumeBootPattern-1339481357 tempest-TestVolumeBootPattern-1339481357-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:08:27.979657 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-d72df58c-a08e-45f2-b71e-94a9393e44d1 tempest-TestVolumeBootPattern-1339481357 tempest-TestVolumeBootPattern-1339481357-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:08:28.109097 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-d72df58c-a08e-45f2-b71e-94a9393e44d1 tempest-TestVolumeBootPattern-1339481357 tempest-TestVolumeBootPattern-1339481357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60edcebcccaa4da99ffddadd3e27c1c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fef19544ec414094953daea6d545a361', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:08:28.116690 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-d72df58c-a08e-45f2-b71e-94a9393e44d1 tempest-TestVolumeBootPattern-1339481357 tempest-TestVolumeBootPattern-1339481357-project] 10.222.0.50 "GET /compute/v2.1/servers/dd7d8b54-2d8e-4a74-912f-4eab2ccf2125" status: 200 len: 1265 microversion: 2.1 time: 0.151026 Sep 24 05:08:28.117252 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 379/785] 10.222.0.50 () {58 vars in 1236 bytes} [Sat Sep 24 05:08:27 2022] GET /compute/v2.1/servers/dd7d8b54-2d8e-4a74-912f-4eab2ccf2125 => generated 1265 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 05:08:28.950476 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-18eef6da-3c81-4dd1-9945-2fa41ee574b5 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 05:08:28.957464 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-18eef6da-3c81-4dd1-9945-2fa41ee574b5 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:08:28.957931 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-18eef6da-3c81-4dd1-9945-2fa41ee574b5 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:08:28.958388 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-18eef6da-3c81-4dd1-9945-2fa41ee574b5 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:08:29.016310 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.compute.api [None req-18eef6da-3c81-4dd1-9945-2fa41ee574b5 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] [instance: b2daebb8-dfea-4ab9-8253-008a21f906e1] Going to try to stop instance {{(pid=120594) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Sep 24 05:08:29.058024 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [None req-18eef6da-3c81-4dd1-9945-2fa41ee574b5 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] 10.222.0.50 "POST /compute/v2.1/servers/b2daebb8-dfea-4ab9-8253-008a21f906e1/action" status: 202 len: 0 microversion: 2.1 time: 0.111283 Sep 24 05:08:29.060349 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 407/786] 10.222.0.50 () {60 vars in 1278 bytes} [Sat Sep 24 05:08:28 2022] POST /compute/v2.1/servers/b2daebb8-dfea-4ab9-8253-008a21f906e1/action => generated 0 bytes in 113 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 24 05:08:29.067874 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-e332640e-d500-4553-96e2-27e1218af548 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Calling method '>' {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:08:29.068489 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.compute.api [None req-e332640e-d500-4553-96e2-27e1218af548 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] [instance: b2daebb8-dfea-4ab9-8253-008a21f906e1] Fetching instance by UUID {{(pid=120593) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:08:29.075091 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-e332640e-d500-4553-96e2-27e1218af548 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:08:29.076280 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-e332640e-d500-4553-96e2-27e1218af548 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:08:29.076747 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-e332640e-d500-4553-96e2-27e1218af548 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:08:29.077466 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-e332640e-d500-4553-96e2-27e1218af548 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:08:29.077936 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-e332640e-d500-4553-96e2-27e1218af548 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:08:29.078421 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-e332640e-d500-4553-96e2-27e1218af548 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:08:29.141428 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-0e2ccd72-7d59-4390-a11e-2f6e4721c05e tempest-TestVolumeBootPattern-1339481357 tempest-TestVolumeBootPattern-1339481357-project] Calling method '>' {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:08:29.142157 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.compute.api [None req-0e2ccd72-7d59-4390-a11e-2f6e4721c05e tempest-TestVolumeBootPattern-1339481357 tempest-TestVolumeBootPattern-1339481357-project] [instance: dd7d8b54-2d8e-4a74-912f-4eab2ccf2125] Fetching instance by UUID {{(pid=120594) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:08:29.148596 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-0e2ccd72-7d59-4390-a11e-2f6e4721c05e tempest-TestVolumeBootPattern-1339481357 tempest-TestVolumeBootPattern-1339481357-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:08:29.149285 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-0e2ccd72-7d59-4390-a11e-2f6e4721c05e tempest-TestVolumeBootPattern-1339481357 tempest-TestVolumeBootPattern-1339481357-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:08:29.149990 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-0e2ccd72-7d59-4390-a11e-2f6e4721c05e tempest-TestVolumeBootPattern-1339481357 tempest-TestVolumeBootPattern-1339481357-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:08:29.150450 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-0e2ccd72-7d59-4390-a11e-2f6e4721c05e tempest-TestVolumeBootPattern-1339481357 tempest-TestVolumeBootPattern-1339481357-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:08:29.150903 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-0e2ccd72-7d59-4390-a11e-2f6e4721c05e tempest-TestVolumeBootPattern-1339481357 tempest-TestVolumeBootPattern-1339481357-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:08:29.151324 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-0e2ccd72-7d59-4390-a11e-2f6e4721c05e tempest-TestVolumeBootPattern-1339481357 tempest-TestVolumeBootPattern-1339481357-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:08:29.245782 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-e332640e-d500-4553-96e2-27e1218af548 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b1b0448e7f54e3aaae49e411699269e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66ec8bde739145dda504995dbea0914a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:08:29.259106 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-e332640e-d500-4553-96e2-27e1218af548 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] 10.222.0.50 "GET /compute/v2.1/servers/b2daebb8-dfea-4ab9-8253-008a21f906e1" status: 200 len: 1678 microversion: 2.1 time: 0.195338 Sep 24 05:08:29.260248 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 380/787] 10.222.0.50 () {58 vars in 1236 bytes} [Sat Sep 24 05:08:29 2022] GET /compute/v2.1/servers/b2daebb8-dfea-4ab9-8253-008a21f906e1 => generated 1678 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 05:08:29.319882 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.policy [None req-0e2ccd72-7d59-4390-a11e-2f6e4721c05e tempest-TestVolumeBootPattern-1339481357 tempest-TestVolumeBootPattern-1339481357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60edcebcccaa4da99ffddadd3e27c1c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fef19544ec414094953daea6d545a361', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:08:29.328066 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [None req-0e2ccd72-7d59-4390-a11e-2f6e4721c05e tempest-TestVolumeBootPattern-1339481357 tempest-TestVolumeBootPattern-1339481357-project] 10.222.0.50 "GET /compute/v2.1/servers/dd7d8b54-2d8e-4a74-912f-4eab2ccf2125" status: 200 len: 1265 microversion: 2.1 time: 0.192657 Sep 24 05:08:29.328646 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 408/788] 10.222.0.50 () {58 vars in 1236 bytes} [Sat Sep 24 05:08:29 2022] GET /compute/v2.1/servers/dd7d8b54-2d8e-4a74-912f-4eab2ccf2125 => generated 1265 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 24 05:08:30.288030 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-1fb2f64e-85e5-4f75-98b0-936f29160871 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Calling method '>' {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:08:30.288627 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.compute.api [None req-1fb2f64e-85e5-4f75-98b0-936f29160871 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] [instance: b2daebb8-dfea-4ab9-8253-008a21f906e1] Fetching instance by UUID {{(pid=120593) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:08:30.295179 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-1fb2f64e-85e5-4f75-98b0-936f29160871 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:08:30.295660 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-1fb2f64e-85e5-4f75-98b0-936f29160871 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:08:30.296097 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-1fb2f64e-85e5-4f75-98b0-936f29160871 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:08:30.296780 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-1fb2f64e-85e5-4f75-98b0-936f29160871 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:08:30.297231 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-1fb2f64e-85e5-4f75-98b0-936f29160871 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:08:30.297654 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-1fb2f64e-85e5-4f75-98b0-936f29160871 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:08:30.350991 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-079a7fff-88bc-46e5-b529-95fcf7e465bd tempest-TestVolumeBootPattern-1339481357 tempest-TestVolumeBootPattern-1339481357-project] Calling method '>' {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:08:30.351592 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.compute.api [None req-079a7fff-88bc-46e5-b529-95fcf7e465bd tempest-TestVolumeBootPattern-1339481357 tempest-TestVolumeBootPattern-1339481357-project] [instance: dd7d8b54-2d8e-4a74-912f-4eab2ccf2125] Fetching instance by UUID {{(pid=120594) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:08:30.358085 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-079a7fff-88bc-46e5-b529-95fcf7e465bd tempest-TestVolumeBootPattern-1339481357 tempest-TestVolumeBootPattern-1339481357-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:08:30.358539 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-079a7fff-88bc-46e5-b529-95fcf7e465bd tempest-TestVolumeBootPattern-1339481357 tempest-TestVolumeBootPattern-1339481357-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:08:30.358969 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-079a7fff-88bc-46e5-b529-95fcf7e465bd tempest-TestVolumeBootPattern-1339481357 tempest-TestVolumeBootPattern-1339481357-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:08:30.359657 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-079a7fff-88bc-46e5-b529-95fcf7e465bd tempest-TestVolumeBootPattern-1339481357 tempest-TestVolumeBootPattern-1339481357-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:08:30.360101 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-079a7fff-88bc-46e5-b529-95fcf7e465bd tempest-TestVolumeBootPattern-1339481357 tempest-TestVolumeBootPattern-1339481357-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:08:30.360518 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-079a7fff-88bc-46e5-b529-95fcf7e465bd tempest-TestVolumeBootPattern-1339481357 tempest-TestVolumeBootPattern-1339481357-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:08:30.469942 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-1fb2f64e-85e5-4f75-98b0-936f29160871 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b1b0448e7f54e3aaae49e411699269e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66ec8bde739145dda504995dbea0914a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:08:30.477853 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-1fb2f64e-85e5-4f75-98b0-936f29160871 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] 10.222.0.50 "GET /compute/v2.1/servers/b2daebb8-dfea-4ab9-8253-008a21f906e1" status: 200 len: 1678 microversion: 2.1 time: 0.193648 Sep 24 05:08:30.478468 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 381/789] 10.222.0.50 () {58 vars in 1236 bytes} [Sat Sep 24 05:08:30 2022] GET /compute/v2.1/servers/b2daebb8-dfea-4ab9-8253-008a21f906e1 => generated 1678 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 05:08:30.515663 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.policy [None req-079a7fff-88bc-46e5-b529-95fcf7e465bd tempest-TestVolumeBootPattern-1339481357 tempest-TestVolumeBootPattern-1339481357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60edcebcccaa4da99ffddadd3e27c1c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fef19544ec414094953daea6d545a361', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:08:30.523272 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [None req-079a7fff-88bc-46e5-b529-95fcf7e465bd tempest-TestVolumeBootPattern-1339481357 tempest-TestVolumeBootPattern-1339481357-project] 10.222.0.50 "GET /compute/v2.1/servers/dd7d8b54-2d8e-4a74-912f-4eab2ccf2125" status: 200 len: 1265 microversion: 2.1 time: 0.176103 Sep 24 05:08:30.523834 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 409/790] 10.222.0.50 () {58 vars in 1236 bytes} [Sat Sep 24 05:08:30 2022] GET /compute/v2.1/servers/dd7d8b54-2d8e-4a74-912f-4eab2ccf2125 => generated 1265 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 05:08:30.738012 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [req-6835dcfb-cedb-4062-b400-ab61caaa2e29 req-ac4075d7-92ba-4b6a-8e13-1d326b10ad6d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dd7d8b54-2d8e-4a74-912f-4eab2ccf2125", "name": "network-vif-plugged", "status": "completed", "tag": "fa86687e-cf6d-40ae-a41d-fc0072b18085"}]} {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 05:08:30.748094 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [req-6835dcfb-cedb-4062-b400-ab61caaa2e29 req-ac4075d7-92ba-4b6a-8e13-1d326b10ad6d service nova] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:08:30.748672 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [req-6835dcfb-cedb-4062-b400-ab61caaa2e29 req-ac4075d7-92ba-4b6a-8e13-1d326b10ad6d service nova] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:08:30.749105 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [req-6835dcfb-cedb-4062-b400-ab61caaa2e29 req-ac4075d7-92ba-4b6a-8e13-1d326b10ad6d service nova] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:08:30.760056 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.compute.server_external_events [req-6835dcfb-cedb-4062-b400-ab61caaa2e29 req-ac4075d7-92ba-4b6a-8e13-1d326b10ad6d service nova] Creating event network-vif-plugged:fa86687e-cf6d-40ae-a41d-fc0072b18085 for instance dd7d8b54-2d8e-4a74-912f-4eab2ccf2125 on hv-cinder-85918 Sep 24 05:08:30.764995 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [req-6835dcfb-cedb-4062-b400-ab61caaa2e29 req-ac4075d7-92ba-4b6a-8e13-1d326b10ad6d service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030698 Sep 24 05:08:30.765659 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 382/791] 10.222.0.50 () {64 vars in 1317 bytes} [Sat Sep 24 05:08:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 05:08:31.500354 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-b19d7c70-e804-4447-b313-d78f0916d2b6 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Calling method '>' {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:08:31.500956 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.compute.api [None req-b19d7c70-e804-4447-b313-d78f0916d2b6 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] [instance: b2daebb8-dfea-4ab9-8253-008a21f906e1] Fetching instance by UUID {{(pid=120594) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:08:31.507265 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-b19d7c70-e804-4447-b313-d78f0916d2b6 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:08:31.507735 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-b19d7c70-e804-4447-b313-d78f0916d2b6 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:08:31.508162 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-b19d7c70-e804-4447-b313-d78f0916d2b6 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:08:31.508837 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-b19d7c70-e804-4447-b313-d78f0916d2b6 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:08:31.509277 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-b19d7c70-e804-4447-b313-d78f0916d2b6 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:08:31.509692 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-b19d7c70-e804-4447-b313-d78f0916d2b6 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:08:31.546757 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-0baffe1e-ea4b-4c40-9b51-73694142a53f tempest-TestVolumeBootPattern-1339481357 tempest-TestVolumeBootPattern-1339481357-project] Calling method '>' {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:08:31.547453 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.compute.api [None req-0baffe1e-ea4b-4c40-9b51-73694142a53f tempest-TestVolumeBootPattern-1339481357 tempest-TestVolumeBootPattern-1339481357-project] [instance: dd7d8b54-2d8e-4a74-912f-4eab2ccf2125] Fetching instance by UUID {{(pid=120593) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:08:31.553585 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-0baffe1e-ea4b-4c40-9b51-73694142a53f tempest-TestVolumeBootPattern-1339481357 tempest-TestVolumeBootPattern-1339481357-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:08:31.554104 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-0baffe1e-ea4b-4c40-9b51-73694142a53f tempest-TestVolumeBootPattern-1339481357 tempest-TestVolumeBootPattern-1339481357-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:08:31.554544 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-0baffe1e-ea4b-4c40-9b51-73694142a53f tempest-TestVolumeBootPattern-1339481357 tempest-TestVolumeBootPattern-1339481357-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:08:31.555233 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-0baffe1e-ea4b-4c40-9b51-73694142a53f tempest-TestVolumeBootPattern-1339481357 tempest-TestVolumeBootPattern-1339481357-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:08:31.555689 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-0baffe1e-ea4b-4c40-9b51-73694142a53f tempest-TestVolumeBootPattern-1339481357 tempest-TestVolumeBootPattern-1339481357-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:08:31.556108 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-0baffe1e-ea4b-4c40-9b51-73694142a53f tempest-TestVolumeBootPattern-1339481357 tempest-TestVolumeBootPattern-1339481357-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:08:31.690489 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.policy [None req-b19d7c70-e804-4447-b313-d78f0916d2b6 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b1b0448e7f54e3aaae49e411699269e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66ec8bde739145dda504995dbea0914a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:08:31.698124 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [None req-b19d7c70-e804-4447-b313-d78f0916d2b6 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] 10.222.0.50 "GET /compute/v2.1/servers/b2daebb8-dfea-4ab9-8253-008a21f906e1" status: 200 len: 1678 microversion: 2.1 time: 0.202150 Sep 24 05:08:31.698688 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 410/792] 10.222.0.50 () {58 vars in 1236 bytes} [Sat Sep 24 05:08:31 2022] GET /compute/v2.1/servers/b2daebb8-dfea-4ab9-8253-008a21f906e1 => generated 1678 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 05:08:31.703228 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-0d5fed77-8a64-42c5-b5b7-a7bfdc6ef04a tempest-TestShelveInstance-1085488420 tempest-TestShelveInstance-1085488420-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 05:08:31.703745 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.compute.api [None req-0d5fed77-8a64-42c5-b5b7-a7bfdc6ef04a tempest-TestShelveInstance-1085488420 tempest-TestShelveInstance-1085488420-project] [instance: 60d69c7d-69e4-4b2a-b41c-692867a6e28d] Fetching instance by UUID {{(pid=120594) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:08:31.709411 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-0d5fed77-8a64-42c5-b5b7-a7bfdc6ef04a tempest-TestShelveInstance-1085488420 tempest-TestShelveInstance-1085488420-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:08:31.709891 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-0d5fed77-8a64-42c5-b5b7-a7bfdc6ef04a tempest-TestShelveInstance-1085488420 tempest-TestShelveInstance-1085488420-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:08:31.710360 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-0d5fed77-8a64-42c5-b5b7-a7bfdc6ef04a tempest-TestShelveInstance-1085488420 tempest-TestShelveInstance-1085488420-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:08:31.711046 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-0d5fed77-8a64-42c5-b5b7-a7bfdc6ef04a tempest-TestShelveInstance-1085488420 tempest-TestShelveInstance-1085488420-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:08:31.711490 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-0d5fed77-8a64-42c5-b5b7-a7bfdc6ef04a tempest-TestShelveInstance-1085488420 tempest-TestShelveInstance-1085488420-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:08:31.711905 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-0d5fed77-8a64-42c5-b5b7-a7bfdc6ef04a tempest-TestShelveInstance-1085488420 tempest-TestShelveInstance-1085488420-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:08:31.722657 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-0baffe1e-ea4b-4c40-9b51-73694142a53f tempest-TestVolumeBootPattern-1339481357 tempest-TestVolumeBootPattern-1339481357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60edcebcccaa4da99ffddadd3e27c1c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fef19544ec414094953daea6d545a361', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:08:31.730110 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-0baffe1e-ea4b-4c40-9b51-73694142a53f tempest-TestVolumeBootPattern-1339481357 tempest-TestVolumeBootPattern-1339481357-project] 10.222.0.50 "GET /compute/v2.1/servers/dd7d8b54-2d8e-4a74-912f-4eab2ccf2125" status: 200 len: 1265 microversion: 2.1 time: 0.188619 Sep 24 05:08:31.730669 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 383/793] 10.222.0.50 () {58 vars in 1236 bytes} [Sat Sep 24 05:08:31 2022] GET /compute/v2.1/servers/dd7d8b54-2d8e-4a74-912f-4eab2ccf2125 => generated 1265 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 24 05:08:31.735477 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.objects.instance [None req-0d5fed77-8a64-42c5-b5b7-a7bfdc6ef04a tempest-TestShelveInstance-1085488420 tempest-TestShelveInstance-1085488420-project] Lazy-loading 'flavor' on Instance uuid 60d69c7d-69e4-4b2a-b41c-692867a6e28d {{(pid=120594) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 24 05:08:31.812597 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [None req-0d5fed77-8a64-42c5-b5b7-a7bfdc6ef04a tempest-TestShelveInstance-1085488420 tempest-TestShelveInstance-1085488420-project] 10.222.0.50 "POST /compute/v2.1/servers/60d69c7d-69e4-4b2a-b41c-692867a6e28d/action" status: 202 len: 0 microversion: 2.1 time: 0.112638 Sep 24 05:08:31.813095 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 411/794] 10.222.0.50 () {60 vars in 1278 bytes} [Sat Sep 24 05:08:31 2022] POST /compute/v2.1/servers/60d69c7d-69e4-4b2a-b41c-692867a6e28d/action => generated 0 bytes in 114 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 24 05:08:31.821461 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-5b9d0175-89fc-4e51-a7ee-c8c74d04433e tempest-TestShelveInstance-1085488420 tempest-TestShelveInstance-1085488420-project] Calling method '>' {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:08:31.822113 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.compute.api [None req-5b9d0175-89fc-4e51-a7ee-c8c74d04433e tempest-TestShelveInstance-1085488420 tempest-TestShelveInstance-1085488420-project] [instance: 60d69c7d-69e4-4b2a-b41c-692867a6e28d] Fetching instance by UUID {{(pid=120593) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:08:31.827992 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-5b9d0175-89fc-4e51-a7ee-c8c74d04433e tempest-TestShelveInstance-1085488420 tempest-TestShelveInstance-1085488420-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:08:31.828476 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-5b9d0175-89fc-4e51-a7ee-c8c74d04433e tempest-TestShelveInstance-1085488420 tempest-TestShelveInstance-1085488420-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:08:31.828911 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-5b9d0175-89fc-4e51-a7ee-c8c74d04433e tempest-TestShelveInstance-1085488420 tempest-TestShelveInstance-1085488420-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:08:31.829631 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-5b9d0175-89fc-4e51-a7ee-c8c74d04433e tempest-TestShelveInstance-1085488420 tempest-TestShelveInstance-1085488420-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:08:31.830128 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-5b9d0175-89fc-4e51-a7ee-c8c74d04433e tempest-TestShelveInstance-1085488420 tempest-TestShelveInstance-1085488420-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:08:31.830557 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-5b9d0175-89fc-4e51-a7ee-c8c74d04433e tempest-TestShelveInstance-1085488420 tempest-TestShelveInstance-1085488420-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:08:31.957565 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-5b9d0175-89fc-4e51-a7ee-c8c74d04433e tempest-TestShelveInstance-1085488420 tempest-TestShelveInstance-1085488420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8fe3c5c28964b768b2c0023fc62f163', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd3d02b11bdf45fe99687fda3d1078cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:08:31.965305 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-5b9d0175-89fc-4e51-a7ee-c8c74d04433e tempest-TestShelveInstance-1085488420 tempest-TestShelveInstance-1085488420-project] 10.222.0.50 "GET /compute/v2.1/servers/60d69c7d-69e4-4b2a-b41c-692867a6e28d" status: 200 len: 1561 microversion: 2.1 time: 0.147855 Sep 24 05:08:31.965873 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 384/795] 10.222.0.50 () {58 vars in 1236 bytes} [Sat Sep 24 05:08:31 2022] GET /compute/v2.1/servers/60d69c7d-69e4-4b2a-b41c-692867a6e28d => generated 1561 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 05:08:32.723931 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-dc5decde-3b06-4af5-a6e4-f315263645ad tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Calling method '>' {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:08:32.724621 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.compute.api [None req-dc5decde-3b06-4af5-a6e4-f315263645ad tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] [instance: b2daebb8-dfea-4ab9-8253-008a21f906e1] Fetching instance by UUID {{(pid=120594) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:08:32.730697 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-dc5decde-3b06-4af5-a6e4-f315263645ad tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:08:32.731176 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-dc5decde-3b06-4af5-a6e4-f315263645ad tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:08:32.731608 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-dc5decde-3b06-4af5-a6e4-f315263645ad tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:08:32.732290 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-dc5decde-3b06-4af5-a6e4-f315263645ad tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:08:32.732737 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-dc5decde-3b06-4af5-a6e4-f315263645ad tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:08:32.733156 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-dc5decde-3b06-4af5-a6e4-f315263645ad tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:08:32.752955 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-ff9722f1-5a3a-416f-a9bd-4e6f02d85a23 tempest-TestVolumeBootPattern-1339481357 tempest-TestVolumeBootPattern-1339481357-project] Calling method '>' {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:08:32.753564 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.compute.api [None req-ff9722f1-5a3a-416f-a9bd-4e6f02d85a23 tempest-TestVolumeBootPattern-1339481357 tempest-TestVolumeBootPattern-1339481357-project] [instance: dd7d8b54-2d8e-4a74-912f-4eab2ccf2125] Fetching instance by UUID {{(pid=120593) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:08:32.759846 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-ff9722f1-5a3a-416f-a9bd-4e6f02d85a23 tempest-TestVolumeBootPattern-1339481357 tempest-TestVolumeBootPattern-1339481357-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:08:32.760327 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-ff9722f1-5a3a-416f-a9bd-4e6f02d85a23 tempest-TestVolumeBootPattern-1339481357 tempest-TestVolumeBootPattern-1339481357-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:08:32.760762 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-ff9722f1-5a3a-416f-a9bd-4e6f02d85a23 tempest-TestVolumeBootPattern-1339481357 tempest-TestVolumeBootPattern-1339481357-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:08:32.761457 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-ff9722f1-5a3a-416f-a9bd-4e6f02d85a23 tempest-TestVolumeBootPattern-1339481357 tempest-TestVolumeBootPattern-1339481357-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:08:32.761909 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-ff9722f1-5a3a-416f-a9bd-4e6f02d85a23 tempest-TestVolumeBootPattern-1339481357 tempest-TestVolumeBootPattern-1339481357-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:08:32.762362 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-ff9722f1-5a3a-416f-a9bd-4e6f02d85a23 tempest-TestVolumeBootPattern-1339481357 tempest-TestVolumeBootPattern-1339481357-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:08:32.920463 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.policy [None req-dc5decde-3b06-4af5-a6e4-f315263645ad tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b1b0448e7f54e3aaae49e411699269e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66ec8bde739145dda504995dbea0914a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:08:32.928205 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [None req-dc5decde-3b06-4af5-a6e4-f315263645ad tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] 10.222.0.50 "GET /compute/v2.1/servers/b2daebb8-dfea-4ab9-8253-008a21f906e1" status: 200 len: 1678 microversion: 2.1 time: 0.208883 Sep 24 05:08:32.928858 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 412/796] 10.222.0.50 () {58 vars in 1236 bytes} [Sat Sep 24 05:08:32 2022] GET /compute/v2.1/servers/b2daebb8-dfea-4ab9-8253-008a21f906e1 => generated 1678 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 24 05:08:32.945646 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-ff9722f1-5a3a-416f-a9bd-4e6f02d85a23 tempest-TestVolumeBootPattern-1339481357 tempest-TestVolumeBootPattern-1339481357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60edcebcccaa4da99ffddadd3e27c1c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fef19544ec414094953daea6d545a361', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:08:32.954570 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-ff9722f1-5a3a-416f-a9bd-4e6f02d85a23 tempest-TestVolumeBootPattern-1339481357 tempest-TestVolumeBootPattern-1339481357-project] 10.222.0.50 "GET /compute/v2.1/servers/dd7d8b54-2d8e-4a74-912f-4eab2ccf2125" status: 200 len: 1265 microversion: 2.1 time: 0.205356 Sep 24 05:08:32.955126 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 385/797] 10.222.0.50 () {58 vars in 1236 bytes} [Sat Sep 24 05:08:32 2022] GET /compute/v2.1/servers/dd7d8b54-2d8e-4a74-912f-4eab2ccf2125 => generated 1265 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 24 05:08:32.988548 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-048d9df6-1655-4fdb-98d0-753d2ee9df50 tempest-TestShelveInstance-1085488420 tempest-TestShelveInstance-1085488420-project] Calling method '>' {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:08:32.989158 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.compute.api [None req-048d9df6-1655-4fdb-98d0-753d2ee9df50 tempest-TestShelveInstance-1085488420 tempest-TestShelveInstance-1085488420-project] [instance: 60d69c7d-69e4-4b2a-b41c-692867a6e28d] Fetching instance by UUID {{(pid=120594) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:08:32.994985 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-048d9df6-1655-4fdb-98d0-753d2ee9df50 tempest-TestShelveInstance-1085488420 tempest-TestShelveInstance-1085488420-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:08:32.995463 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-048d9df6-1655-4fdb-98d0-753d2ee9df50 tempest-TestShelveInstance-1085488420 tempest-TestShelveInstance-1085488420-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:08:32.995892 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-048d9df6-1655-4fdb-98d0-753d2ee9df50 tempest-TestShelveInstance-1085488420 tempest-TestShelveInstance-1085488420-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:08:32.996576 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-048d9df6-1655-4fdb-98d0-753d2ee9df50 tempest-TestShelveInstance-1085488420 tempest-TestShelveInstance-1085488420-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:08:32.997033 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-048d9df6-1655-4fdb-98d0-753d2ee9df50 tempest-TestShelveInstance-1085488420 tempest-TestShelveInstance-1085488420-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:08:32.998160 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-048d9df6-1655-4fdb-98d0-753d2ee9df50 tempest-TestShelveInstance-1085488420 tempest-TestShelveInstance-1085488420-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:08:33.125514 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.policy [None req-048d9df6-1655-4fdb-98d0-753d2ee9df50 tempest-TestShelveInstance-1085488420 tempest-TestShelveInstance-1085488420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8fe3c5c28964b768b2c0023fc62f163', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd3d02b11bdf45fe99687fda3d1078cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:08:33.133487 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [None req-048d9df6-1655-4fdb-98d0-753d2ee9df50 tempest-TestShelveInstance-1085488420 tempest-TestShelveInstance-1085488420-project] 10.222.0.50 "GET /compute/v2.1/servers/60d69c7d-69e4-4b2a-b41c-692867a6e28d" status: 200 len: 1561 microversion: 2.1 time: 0.148665 Sep 24 05:08:33.134073 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 413/798] 10.222.0.50 () {58 vars in 1236 bytes} [Sat Sep 24 05:08:32 2022] GET /compute/v2.1/servers/60d69c7d-69e4-4b2a-b41c-692867a6e28d => generated 1561 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 05:08:33.952377 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-c2ad6fb6-19d3-442b-88c8-6a9958b48ae6 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Calling method '>' {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:08:33.952933 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.compute.api [None req-c2ad6fb6-19d3-442b-88c8-6a9958b48ae6 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] [instance: b2daebb8-dfea-4ab9-8253-008a21f906e1] Fetching instance by UUID {{(pid=120593) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:08:33.959234 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-c2ad6fb6-19d3-442b-88c8-6a9958b48ae6 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:08:33.959705 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-c2ad6fb6-19d3-442b-88c8-6a9958b48ae6 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:08:33.960132 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-c2ad6fb6-19d3-442b-88c8-6a9958b48ae6 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:08:33.960812 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-c2ad6fb6-19d3-442b-88c8-6a9958b48ae6 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:08:33.961257 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-c2ad6fb6-19d3-442b-88c8-6a9958b48ae6 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:08:33.961704 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-c2ad6fb6-19d3-442b-88c8-6a9958b48ae6 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:08:33.976817 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-1cbe9719-8aa5-482d-a045-b6a94e108133 tempest-TestVolumeBootPattern-1339481357 tempest-TestVolumeBootPattern-1339481357-project] Calling method '>' {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:08:33.977424 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.compute.api [None req-1cbe9719-8aa5-482d-a045-b6a94e108133 tempest-TestVolumeBootPattern-1339481357 tempest-TestVolumeBootPattern-1339481357-project] [instance: dd7d8b54-2d8e-4a74-912f-4eab2ccf2125] Fetching instance by UUID {{(pid=120594) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:08:33.983834 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-1cbe9719-8aa5-482d-a045-b6a94e108133 tempest-TestVolumeBootPattern-1339481357 tempest-TestVolumeBootPattern-1339481357-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:08:33.984310 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-1cbe9719-8aa5-482d-a045-b6a94e108133 tempest-TestVolumeBootPattern-1339481357 tempest-TestVolumeBootPattern-1339481357-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:08:33.984742 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-1cbe9719-8aa5-482d-a045-b6a94e108133 tempest-TestVolumeBootPattern-1339481357 tempest-TestVolumeBootPattern-1339481357-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:08:33.985430 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-1cbe9719-8aa5-482d-a045-b6a94e108133 tempest-TestVolumeBootPattern-1339481357 tempest-TestVolumeBootPattern-1339481357-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:08:33.985876 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-1cbe9719-8aa5-482d-a045-b6a94e108133 tempest-TestVolumeBootPattern-1339481357 tempest-TestVolumeBootPattern-1339481357-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:08:33.986325 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-1cbe9719-8aa5-482d-a045-b6a94e108133 tempest-TestVolumeBootPattern-1339481357 tempest-TestVolumeBootPattern-1339481357-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:08:34.155886 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-c2ad6fb6-19d3-442b-88c8-6a9958b48ae6 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b1b0448e7f54e3aaae49e411699269e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66ec8bde739145dda504995dbea0914a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:08:34.163580 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-c2ad6fb6-19d3-442b-88c8-6a9958b48ae6 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] 10.222.0.50 "GET /compute/v2.1/servers/b2daebb8-dfea-4ab9-8253-008a21f906e1" status: 200 len: 1678 microversion: 2.1 time: 0.215626 Sep 24 05:08:34.164151 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 386/799] 10.222.0.50 () {58 vars in 1236 bytes} [Sat Sep 24 05:08:33 2022] GET /compute/v2.1/servers/b2daebb8-dfea-4ab9-8253-008a21f906e1 => generated 1678 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 05:08:34.165052 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.policy [None req-1cbe9719-8aa5-482d-a045-b6a94e108133 tempest-TestVolumeBootPattern-1339481357 tempest-TestVolumeBootPattern-1339481357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60edcebcccaa4da99ffddadd3e27c1c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fef19544ec414094953daea6d545a361', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:08:34.168691 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG dbcounter [-] [120594] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=120594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 05:08:34.168928 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-7e2a9572-0872-41e4-a729-a9fb9d223888 tempest-TestShelveInstance-1085488420 tempest-TestShelveInstance-1085488420-project] Calling method '>' {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:08:34.169537 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.compute.api [None req-7e2a9572-0872-41e4-a729-a9fb9d223888 tempest-TestShelveInstance-1085488420 tempest-TestShelveInstance-1085488420-project] [instance: 60d69c7d-69e4-4b2a-b41c-692867a6e28d] Fetching instance by UUID {{(pid=120593) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:08:34.173663 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [None req-1cbe9719-8aa5-482d-a045-b6a94e108133 tempest-TestVolumeBootPattern-1339481357 tempest-TestVolumeBootPattern-1339481357-project] 10.222.0.50 "GET /compute/v2.1/servers/dd7d8b54-2d8e-4a74-912f-4eab2ccf2125" status: 200 len: 1265 microversion: 2.1 time: 0.200706 Sep 24 05:08:34.186170 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 414/800] 10.222.0.50 () {58 vars in 1236 bytes} [Sat Sep 24 05:08:33 2022] GET /compute/v2.1/servers/dd7d8b54-2d8e-4a74-912f-4eab2ccf2125 => generated 1265 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 24 05:08:34.186348 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-7e2a9572-0872-41e4-a729-a9fb9d223888 tempest-TestShelveInstance-1085488420 tempest-TestShelveInstance-1085488420-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:08:34.186348 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-7e2a9572-0872-41e4-a729-a9fb9d223888 tempest-TestShelveInstance-1085488420 tempest-TestShelveInstance-1085488420-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:08:34.186348 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-7e2a9572-0872-41e4-a729-a9fb9d223888 tempest-TestShelveInstance-1085488420 tempest-TestShelveInstance-1085488420-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:08:34.186348 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-7e2a9572-0872-41e4-a729-a9fb9d223888 tempest-TestShelveInstance-1085488420 tempest-TestShelveInstance-1085488420-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:08:34.186723 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-7e2a9572-0872-41e4-a729-a9fb9d223888 tempest-TestShelveInstance-1085488420 tempest-TestShelveInstance-1085488420-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:08:34.186723 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-7e2a9572-0872-41e4-a729-a9fb9d223888 tempest-TestShelveInstance-1085488420 tempest-TestShelveInstance-1085488420-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:08:34.312556 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-7e2a9572-0872-41e4-a729-a9fb9d223888 tempest-TestShelveInstance-1085488420 tempest-TestShelveInstance-1085488420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8fe3c5c28964b768b2c0023fc62f163', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd3d02b11bdf45fe99687fda3d1078cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:08:34.320234 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-7e2a9572-0872-41e4-a729-a9fb9d223888 tempest-TestShelveInstance-1085488420 tempest-TestShelveInstance-1085488420-project] 10.222.0.50 "GET /compute/v2.1/servers/60d69c7d-69e4-4b2a-b41c-692867a6e28d" status: 200 len: 1561 microversion: 2.1 time: 0.155148 Sep 24 05:08:34.320794 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 387/801] 10.222.0.50 () {58 vars in 1236 bytes} [Sat Sep 24 05:08:34 2022] GET /compute/v2.1/servers/60d69c7d-69e4-4b2a-b41c-692867a6e28d => generated 1561 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 05:08:35.187687 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-b99eee2b-0bac-4ec1-b244-b16f4bb11606 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Calling method '>' {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:08:35.188509 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.compute.api [None req-b99eee2b-0bac-4ec1-b244-b16f4bb11606 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] [instance: b2daebb8-dfea-4ab9-8253-008a21f906e1] Fetching instance by UUID {{(pid=120594) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:08:35.196124 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-b99eee2b-0bac-4ec1-b244-b16f4bb11606 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:08:35.196609 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-b99eee2b-0bac-4ec1-b244-b16f4bb11606 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:08:35.197043 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-b99eee2b-0bac-4ec1-b244-b16f4bb11606 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:08:35.197737 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-b99eee2b-0bac-4ec1-b244-b16f4bb11606 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:08:35.198219 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-b99eee2b-0bac-4ec1-b244-b16f4bb11606 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:08:35.198585 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-ac7ea274-f996-4662-96da-15652159b3c8 tempest-TestVolumeBootPattern-1339481357 tempest-TestVolumeBootPattern-1339481357-project] Calling method '>' {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:08:35.199013 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-b99eee2b-0bac-4ec1-b244-b16f4bb11606 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:08:35.199200 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.compute.api [None req-ac7ea274-f996-4662-96da-15652159b3c8 tempest-TestVolumeBootPattern-1339481357 tempest-TestVolumeBootPattern-1339481357-project] [instance: dd7d8b54-2d8e-4a74-912f-4eab2ccf2125] Fetching instance by UUID {{(pid=120593) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:08:35.206610 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-ac7ea274-f996-4662-96da-15652159b3c8 tempest-TestVolumeBootPattern-1339481357 tempest-TestVolumeBootPattern-1339481357-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:08:35.207094 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-ac7ea274-f996-4662-96da-15652159b3c8 tempest-TestVolumeBootPattern-1339481357 tempest-TestVolumeBootPattern-1339481357-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:08:35.207535 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-ac7ea274-f996-4662-96da-15652159b3c8 tempest-TestVolumeBootPattern-1339481357 tempest-TestVolumeBootPattern-1339481357-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:08:35.208261 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-ac7ea274-f996-4662-96da-15652159b3c8 tempest-TestVolumeBootPattern-1339481357 tempest-TestVolumeBootPattern-1339481357-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:08:35.208721 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-ac7ea274-f996-4662-96da-15652159b3c8 tempest-TestVolumeBootPattern-1339481357 tempest-TestVolumeBootPattern-1339481357-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:08:35.209146 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-ac7ea274-f996-4662-96da-15652159b3c8 tempest-TestVolumeBootPattern-1339481357 tempest-TestVolumeBootPattern-1339481357-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:08:35.394596 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.policy [None req-b99eee2b-0bac-4ec1-b244-b16f4bb11606 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b1b0448e7f54e3aaae49e411699269e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66ec8bde739145dda504995dbea0914a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:08:35.399275 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-ac7ea274-f996-4662-96da-15652159b3c8 tempest-TestVolumeBootPattern-1339481357 tempest-TestVolumeBootPattern-1339481357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60edcebcccaa4da99ffddadd3e27c1c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fef19544ec414094953daea6d545a361', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:08:35.402366 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [None req-b99eee2b-0bac-4ec1-b244-b16f4bb11606 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] 10.222.0.50 "GET /compute/v2.1/servers/b2daebb8-dfea-4ab9-8253-008a21f906e1" status: 200 len: 1678 microversion: 2.1 time: 0.218979 Sep 24 05:08:35.402936 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 415/802] 10.222.0.50 () {58 vars in 1236 bytes} [Sat Sep 24 05:08:35 2022] GET /compute/v2.1/servers/b2daebb8-dfea-4ab9-8253-008a21f906e1 => generated 1678 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 05:08:35.408041 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-ac7ea274-f996-4662-96da-15652159b3c8 tempest-TestVolumeBootPattern-1339481357 tempest-TestVolumeBootPattern-1339481357-project] 10.222.0.50 "GET /compute/v2.1/servers/dd7d8b54-2d8e-4a74-912f-4eab2ccf2125" status: 200 len: 1451 microversion: 2.1 time: 0.213819 Sep 24 05:08:35.408831 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 388/803] 10.222.0.50 () {58 vars in 1236 bytes} [Sat Sep 24 05:08:35 2022] GET /compute/v2.1/servers/dd7d8b54-2d8e-4a74-912f-4eab2ccf2125 => generated 1451 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 05:08:35.412714 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-8d2a51cd-da1c-4039-b278-75f321500775 tempest-TestShelveInstance-1085488420 tempest-TestShelveInstance-1085488420-project] Calling method '>' {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:08:35.413511 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.compute.api [None req-8d2a51cd-da1c-4039-b278-75f321500775 tempest-TestShelveInstance-1085488420 tempest-TestShelveInstance-1085488420-project] [instance: 60d69c7d-69e4-4b2a-b41c-692867a6e28d] Fetching instance by UUID {{(pid=120594) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:08:35.419819 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-8d2a51cd-da1c-4039-b278-75f321500775 tempest-TestShelveInstance-1085488420 tempest-TestShelveInstance-1085488420-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:08:35.420303 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-8d2a51cd-da1c-4039-b278-75f321500775 tempest-TestShelveInstance-1085488420 tempest-TestShelveInstance-1085488420-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:08:35.420768 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-8d2a51cd-da1c-4039-b278-75f321500775 tempest-TestShelveInstance-1085488420 tempest-TestShelveInstance-1085488420-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:08:35.421465 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-8d2a51cd-da1c-4039-b278-75f321500775 tempest-TestShelveInstance-1085488420 tempest-TestShelveInstance-1085488420-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:08:35.421918 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-8d2a51cd-da1c-4039-b278-75f321500775 tempest-TestShelveInstance-1085488420 tempest-TestShelveInstance-1085488420-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:08:35.422374 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-8d2a51cd-da1c-4039-b278-75f321500775 tempest-TestShelveInstance-1085488420 tempest-TestShelveInstance-1085488420-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:08:35.430635 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-cab7b6f1-851d-427c-b868-1be5c776e146 tempest-TestVolumeBootPattern-1339481357 tempest-TestVolumeBootPattern-1339481357-project] Calling method '>' {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:08:35.431319 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.compute.api [None req-cab7b6f1-851d-427c-b868-1be5c776e146 tempest-TestVolumeBootPattern-1339481357 tempest-TestVolumeBootPattern-1339481357-project] [instance: dd7d8b54-2d8e-4a74-912f-4eab2ccf2125] Fetching instance by UUID {{(pid=120593) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:08:35.437718 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-cab7b6f1-851d-427c-b868-1be5c776e146 tempest-TestVolumeBootPattern-1339481357 tempest-TestVolumeBootPattern-1339481357-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:08:35.438299 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-cab7b6f1-851d-427c-b868-1be5c776e146 tempest-TestVolumeBootPattern-1339481357 tempest-TestVolumeBootPattern-1339481357-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:08:35.438765 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-cab7b6f1-851d-427c-b868-1be5c776e146 tempest-TestVolumeBootPattern-1339481357 tempest-TestVolumeBootPattern-1339481357-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:08:35.440342 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-cab7b6f1-851d-427c-b868-1be5c776e146 tempest-TestVolumeBootPattern-1339481357 tempest-TestVolumeBootPattern-1339481357-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:08:35.440822 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-cab7b6f1-851d-427c-b868-1be5c776e146 tempest-TestVolumeBootPattern-1339481357 tempest-TestVolumeBootPattern-1339481357-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:08:35.441322 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-cab7b6f1-851d-427c-b868-1be5c776e146 tempest-TestVolumeBootPattern-1339481357 tempest-TestVolumeBootPattern-1339481357-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:08:35.613744 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.policy [None req-8d2a51cd-da1c-4039-b278-75f321500775 tempest-TestShelveInstance-1085488420 tempest-TestShelveInstance-1085488420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8fe3c5c28964b768b2c0023fc62f163', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd3d02b11bdf45fe99687fda3d1078cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:08:35.621500 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [None req-8d2a51cd-da1c-4039-b278-75f321500775 tempest-TestShelveInstance-1085488420 tempest-TestShelveInstance-1085488420-project] 10.222.0.50 "GET /compute/v2.1/servers/60d69c7d-69e4-4b2a-b41c-692867a6e28d" status: 200 len: 1561 microversion: 2.1 time: 0.214419 Sep 24 05:08:35.622100 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 416/804] 10.222.0.50 () {58 vars in 1236 bytes} [Sat Sep 24 05:08:35 2022] GET /compute/v2.1/servers/60d69c7d-69e4-4b2a-b41c-692867a6e28d => generated 1561 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 05:08:35.627087 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-cab7b6f1-851d-427c-b868-1be5c776e146 tempest-TestVolumeBootPattern-1339481357 tempest-TestVolumeBootPattern-1339481357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60edcebcccaa4da99ffddadd3e27c1c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fef19544ec414094953daea6d545a361', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:08:35.634730 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-cab7b6f1-851d-427c-b868-1be5c776e146 tempest-TestVolumeBootPattern-1339481357 tempest-TestVolumeBootPattern-1339481357-project] 10.222.0.50 "GET /compute/v2.1/servers/dd7d8b54-2d8e-4a74-912f-4eab2ccf2125" status: 200 len: 1451 microversion: 2.1 time: 0.207823 Sep 24 05:08:35.635441 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 389/805] 10.222.0.50 () {58 vars in 1236 bytes} [Sat Sep 24 05:08:35 2022] GET /compute/v2.1/servers/dd7d8b54-2d8e-4a74-912f-4eab2ccf2125 => generated 1451 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 24 05:08:36.426514 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-1a3e3dd9-4ea5-425c-a0e8-634ce8b1ca55 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Calling method '>' {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:08:36.427280 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.compute.api [None req-1a3e3dd9-4ea5-425c-a0e8-634ce8b1ca55 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] [instance: b2daebb8-dfea-4ab9-8253-008a21f906e1] Fetching instance by UUID {{(pid=120594) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:08:36.433579 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-1a3e3dd9-4ea5-425c-a0e8-634ce8b1ca55 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:08:36.434082 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-1a3e3dd9-4ea5-425c-a0e8-634ce8b1ca55 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:08:36.434537 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-1a3e3dd9-4ea5-425c-a0e8-634ce8b1ca55 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:08:36.435248 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-1a3e3dd9-4ea5-425c-a0e8-634ce8b1ca55 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:08:36.435690 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-1a3e3dd9-4ea5-425c-a0e8-634ce8b1ca55 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:08:36.436107 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-1a3e3dd9-4ea5-425c-a0e8-634ce8b1ca55 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:08:36.644482 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-08ca1711-657f-4dd7-a567-34b54a3ad56b tempest-TestShelveInstance-1085488420 tempest-TestShelveInstance-1085488420-project] Calling method '>' {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:08:36.645338 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.policy [None req-1a3e3dd9-4ea5-425c-a0e8-634ce8b1ca55 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b1b0448e7f54e3aaae49e411699269e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66ec8bde739145dda504995dbea0914a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:08:36.645661 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.compute.api [None req-08ca1711-657f-4dd7-a567-34b54a3ad56b tempest-TestShelveInstance-1085488420 tempest-TestShelveInstance-1085488420-project] [instance: 60d69c7d-69e4-4b2a-b41c-692867a6e28d] Fetching instance by UUID {{(pid=120593) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:08:36.653097 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-08ca1711-657f-4dd7-a567-34b54a3ad56b tempest-TestShelveInstance-1085488420 tempest-TestShelveInstance-1085488420-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:08:36.654098 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-08ca1711-657f-4dd7-a567-34b54a3ad56b tempest-TestShelveInstance-1085488420 tempest-TestShelveInstance-1085488420-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:08:36.655009 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-08ca1711-657f-4dd7-a567-34b54a3ad56b tempest-TestShelveInstance-1085488420 tempest-TestShelveInstance-1085488420-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:08:36.655714 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-08ca1711-657f-4dd7-a567-34b54a3ad56b tempest-TestShelveInstance-1085488420 tempest-TestShelveInstance-1085488420-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:08:36.656189 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-08ca1711-657f-4dd7-a567-34b54a3ad56b tempest-TestShelveInstance-1085488420 tempest-TestShelveInstance-1085488420-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:08:36.656812 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-08ca1711-657f-4dd7-a567-34b54a3ad56b tempest-TestShelveInstance-1085488420 tempest-TestShelveInstance-1085488420-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:08:36.659910 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [None req-1a3e3dd9-4ea5-425c-a0e8-634ce8b1ca55 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] 10.222.0.50 "GET /compute/v2.1/servers/b2daebb8-dfea-4ab9-8253-008a21f906e1" status: 200 len: 1678 microversion: 2.1 time: 0.237082 Sep 24 05:08:36.660925 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 417/806] 10.222.0.50 () {58 vars in 1236 bytes} [Sat Sep 24 05:08:36 2022] GET /compute/v2.1/servers/b2daebb8-dfea-4ab9-8253-008a21f906e1 => generated 1678 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 05:08:36.691218 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG dbcounter [-] [120593] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=120593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 05:08:36.883114 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-08ca1711-657f-4dd7-a567-34b54a3ad56b tempest-TestShelveInstance-1085488420 tempest-TestShelveInstance-1085488420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8fe3c5c28964b768b2c0023fc62f163', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd3d02b11bdf45fe99687fda3d1078cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:08:36.891235 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-08ca1711-657f-4dd7-a567-34b54a3ad56b tempest-TestShelveInstance-1085488420 tempest-TestShelveInstance-1085488420-project] 10.222.0.50 "GET /compute/v2.1/servers/60d69c7d-69e4-4b2a-b41c-692867a6e28d" status: 200 len: 1561 microversion: 2.1 time: 0.250623 Sep 24 05:08:36.891792 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 390/807] 10.222.0.50 () {58 vars in 1236 bytes} [Sat Sep 24 05:08:36 2022] GET /compute/v2.1/servers/60d69c7d-69e4-4b2a-b41c-692867a6e28d => generated 1561 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 24 05:08:37.650278 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [req-5f074443-c982-43df-b5d6-542b9c2257ad req-71841f0e-59fd-4b01-8707-78ecedfa4466 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dd7d8b54-2d8e-4a74-912f-4eab2ccf2125", "tag": "fa86687e-cf6d-40ae-a41d-fc0072b18085"}]} {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 05:08:37.658241 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [req-5f074443-c982-43df-b5d6-542b9c2257ad req-71841f0e-59fd-4b01-8707-78ecedfa4466 service nova] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:08:37.658735 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [req-5f074443-c982-43df-b5d6-542b9c2257ad req-71841f0e-59fd-4b01-8707-78ecedfa4466 service nova] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:08:37.659168 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [req-5f074443-c982-43df-b5d6-542b9c2257ad req-71841f0e-59fd-4b01-8707-78ecedfa4466 service nova] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:08:37.674954 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: INFO nova.api.openstack.compute.server_external_events [req-5f074443-c982-43df-b5d6-542b9c2257ad req-71841f0e-59fd-4b01-8707-78ecedfa4466 service nova] Creating event network-changed:fa86687e-cf6d-40ae-a41d-fc0072b18085 for instance dd7d8b54-2d8e-4a74-912f-4eab2ccf2125 on hv-cinder-85918 Sep 24 05:08:37.680569 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [req-5f074443-c982-43df-b5d6-542b9c2257ad req-71841f0e-59fd-4b01-8707-78ecedfa4466 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036474 Sep 24 05:08:37.681335 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 418/808] 10.222.0.50 () {64 vars in 1317 bytes} [Sat Sep 24 05:08:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 05:08:37.684621 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-2cf529e4-555a-4e5c-a9d3-3e333dae70f0 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Calling method '>' {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:08:37.686734 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.compute.api [None req-2cf529e4-555a-4e5c-a9d3-3e333dae70f0 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] [instance: b2daebb8-dfea-4ab9-8253-008a21f906e1] Fetching instance by UUID {{(pid=120593) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:08:37.693501 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-2cf529e4-555a-4e5c-a9d3-3e333dae70f0 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:08:37.694094 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-2cf529e4-555a-4e5c-a9d3-3e333dae70f0 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:08:37.694605 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-2cf529e4-555a-4e5c-a9d3-3e333dae70f0 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:08:37.695386 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-2cf529e4-555a-4e5c-a9d3-3e333dae70f0 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:08:37.695913 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-2cf529e4-555a-4e5c-a9d3-3e333dae70f0 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:08:37.696591 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-2cf529e4-555a-4e5c-a9d3-3e333dae70f0 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:08:37.851939 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-2cf529e4-555a-4e5c-a9d3-3e333dae70f0 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b1b0448e7f54e3aaae49e411699269e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66ec8bde739145dda504995dbea0914a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:08:37.860337 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-2cf529e4-555a-4e5c-a9d3-3e333dae70f0 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] 10.222.0.50 "GET /compute/v2.1/servers/b2daebb8-dfea-4ab9-8253-008a21f906e1" status: 200 len: 1678 microversion: 2.1 time: 0.180237 Sep 24 05:08:37.861095 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 391/809] 10.222.0.50 () {58 vars in 1236 bytes} [Sat Sep 24 05:08:37 2022] GET /compute/v2.1/servers/b2daebb8-dfea-4ab9-8253-008a21f906e1 => generated 1678 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 05:08:37.915382 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-7e2cbfaa-5563-4df4-ae51-88313a9d446c tempest-TestShelveInstance-1085488420 tempest-TestShelveInstance-1085488420-project] Calling method '>' {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:08:37.916077 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.compute.api [None req-7e2cbfaa-5563-4df4-ae51-88313a9d446c tempest-TestShelveInstance-1085488420 tempest-TestShelveInstance-1085488420-project] [instance: 60d69c7d-69e4-4b2a-b41c-692867a6e28d] Fetching instance by UUID {{(pid=120594) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:08:37.922996 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-7e2cbfaa-5563-4df4-ae51-88313a9d446c tempest-TestShelveInstance-1085488420 tempest-TestShelveInstance-1085488420-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:08:37.923546 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-7e2cbfaa-5563-4df4-ae51-88313a9d446c tempest-TestShelveInstance-1085488420 tempest-TestShelveInstance-1085488420-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:08:37.923985 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-7e2cbfaa-5563-4df4-ae51-88313a9d446c tempest-TestShelveInstance-1085488420 tempest-TestShelveInstance-1085488420-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:08:37.924676 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-7e2cbfaa-5563-4df4-ae51-88313a9d446c tempest-TestShelveInstance-1085488420 tempest-TestShelveInstance-1085488420-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:08:37.925123 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-7e2cbfaa-5563-4df4-ae51-88313a9d446c tempest-TestShelveInstance-1085488420 tempest-TestShelveInstance-1085488420-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:08:37.925547 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-7e2cbfaa-5563-4df4-ae51-88313a9d446c tempest-TestShelveInstance-1085488420 tempest-TestShelveInstance-1085488420-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:08:38.072628 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.policy [None req-7e2cbfaa-5563-4df4-ae51-88313a9d446c tempest-TestShelveInstance-1085488420 tempest-TestShelveInstance-1085488420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8fe3c5c28964b768b2c0023fc62f163', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd3d02b11bdf45fe99687fda3d1078cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:08:38.080511 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [None req-7e2cbfaa-5563-4df4-ae51-88313a9d446c tempest-TestShelveInstance-1085488420 tempest-TestShelveInstance-1085488420-project] 10.222.0.50 "GET /compute/v2.1/servers/60d69c7d-69e4-4b2a-b41c-692867a6e28d" status: 200 len: 1561 microversion: 2.1 time: 0.169287 Sep 24 05:08:38.095508 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 419/810] 10.222.0.50 () {58 vars in 1236 bytes} [Sat Sep 24 05:08:37 2022] GET /compute/v2.1/servers/60d69c7d-69e4-4b2a-b41c-692867a6e28d => generated 1561 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 05:08:38.883464 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-d98aed33-977a-4d21-aa9d-b971404eed4c tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Calling method '>' {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:08:38.884078 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.compute.api [None req-d98aed33-977a-4d21-aa9d-b971404eed4c tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] [instance: b2daebb8-dfea-4ab9-8253-008a21f906e1] Fetching instance by UUID {{(pid=120593) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:08:38.891088 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-d98aed33-977a-4d21-aa9d-b971404eed4c tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:08:38.891577 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-d98aed33-977a-4d21-aa9d-b971404eed4c tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:08:38.892016 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-d98aed33-977a-4d21-aa9d-b971404eed4c tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:08:38.892719 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-d98aed33-977a-4d21-aa9d-b971404eed4c tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:08:38.893170 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-d98aed33-977a-4d21-aa9d-b971404eed4c tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:08:38.893599 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-d98aed33-977a-4d21-aa9d-b971404eed4c tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:08:39.021989 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-d98aed33-977a-4d21-aa9d-b971404eed4c tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b1b0448e7f54e3aaae49e411699269e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66ec8bde739145dda504995dbea0914a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:08:39.029848 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-d98aed33-977a-4d21-aa9d-b971404eed4c tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] 10.222.0.50 "GET /compute/v2.1/servers/b2daebb8-dfea-4ab9-8253-008a21f906e1" status: 200 len: 1678 microversion: 2.1 time: 0.150018 Sep 24 05:08:39.030461 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 392/811] 10.222.0.50 () {58 vars in 1236 bytes} [Sat Sep 24 05:08:38 2022] GET /compute/v2.1/servers/b2daebb8-dfea-4ab9-8253-008a21f906e1 => generated 1678 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 05:08:39.105500 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-60376cf8-c0af-4f58-9f79-740fea671db6 tempest-TestShelveInstance-1085488420 tempest-TestShelveInstance-1085488420-project] Calling method '>' {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:08:39.106142 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.compute.api [None req-60376cf8-c0af-4f58-9f79-740fea671db6 tempest-TestShelveInstance-1085488420 tempest-TestShelveInstance-1085488420-project] [instance: 60d69c7d-69e4-4b2a-b41c-692867a6e28d] Fetching instance by UUID {{(pid=120594) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:08:39.112679 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-60376cf8-c0af-4f58-9f79-740fea671db6 tempest-TestShelveInstance-1085488420 tempest-TestShelveInstance-1085488420-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:08:39.113170 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-60376cf8-c0af-4f58-9f79-740fea671db6 tempest-TestShelveInstance-1085488420 tempest-TestShelveInstance-1085488420-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:08:39.113608 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-60376cf8-c0af-4f58-9f79-740fea671db6 tempest-TestShelveInstance-1085488420 tempest-TestShelveInstance-1085488420-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:08:39.114323 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-60376cf8-c0af-4f58-9f79-740fea671db6 tempest-TestShelveInstance-1085488420 tempest-TestShelveInstance-1085488420-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:08:39.114784 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-60376cf8-c0af-4f58-9f79-740fea671db6 tempest-TestShelveInstance-1085488420 tempest-TestShelveInstance-1085488420-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:08:39.115205 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-60376cf8-c0af-4f58-9f79-740fea671db6 tempest-TestShelveInstance-1085488420 tempest-TestShelveInstance-1085488420-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:08:39.241974 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.policy [None req-60376cf8-c0af-4f58-9f79-740fea671db6 tempest-TestShelveInstance-1085488420 tempest-TestShelveInstance-1085488420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8fe3c5c28964b768b2c0023fc62f163', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd3d02b11bdf45fe99687fda3d1078cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:08:39.250181 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [None req-60376cf8-c0af-4f58-9f79-740fea671db6 tempest-TestShelveInstance-1085488420 tempest-TestShelveInstance-1085488420-project] 10.222.0.50 "GET /compute/v2.1/servers/60d69c7d-69e4-4b2a-b41c-692867a6e28d" status: 200 len: 1561 microversion: 2.1 time: 0.148445 Sep 24 05:08:39.250755 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 420/812] 10.222.0.50 () {58 vars in 1236 bytes} [Sat Sep 24 05:08:39 2022] GET /compute/v2.1/servers/60d69c7d-69e4-4b2a-b41c-692867a6e28d => generated 1561 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 05:08:40.053269 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-f88a0a1f-317c-4c11-a7f2-2070a3a53646 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Calling method '>' {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:08:40.053878 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.compute.api [None req-f88a0a1f-317c-4c11-a7f2-2070a3a53646 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] [instance: b2daebb8-dfea-4ab9-8253-008a21f906e1] Fetching instance by UUID {{(pid=120593) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:08:40.060324 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-f88a0a1f-317c-4c11-a7f2-2070a3a53646 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:08:40.060799 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-f88a0a1f-317c-4c11-a7f2-2070a3a53646 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:08:40.061232 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-f88a0a1f-317c-4c11-a7f2-2070a3a53646 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:08:40.062471 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-f88a0a1f-317c-4c11-a7f2-2070a3a53646 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:08:40.062920 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-f88a0a1f-317c-4c11-a7f2-2070a3a53646 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:08:40.063341 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-f88a0a1f-317c-4c11-a7f2-2070a3a53646 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:08:40.189068 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-f88a0a1f-317c-4c11-a7f2-2070a3a53646 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b1b0448e7f54e3aaae49e411699269e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66ec8bde739145dda504995dbea0914a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:08:40.196655 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-f88a0a1f-317c-4c11-a7f2-2070a3a53646 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] 10.222.0.50 "GET /compute/v2.1/servers/b2daebb8-dfea-4ab9-8253-008a21f906e1" status: 200 len: 1678 microversion: 2.1 time: 0.147227 Sep 24 05:08:40.197228 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 393/813] 10.222.0.50 () {58 vars in 1236 bytes} [Sat Sep 24 05:08:40 2022] GET /compute/v2.1/servers/b2daebb8-dfea-4ab9-8253-008a21f906e1 => generated 1678 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 05:08:40.272470 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-75d90188-2c32-4958-8e7a-8415656abeff tempest-TestShelveInstance-1085488420 tempest-TestShelveInstance-1085488420-project] Calling method '>' {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:08:40.273092 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.compute.api [None req-75d90188-2c32-4958-8e7a-8415656abeff tempest-TestShelveInstance-1085488420 tempest-TestShelveInstance-1085488420-project] [instance: 60d69c7d-69e4-4b2a-b41c-692867a6e28d] Fetching instance by UUID {{(pid=120594) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:08:40.279465 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-75d90188-2c32-4958-8e7a-8415656abeff tempest-TestShelveInstance-1085488420 tempest-TestShelveInstance-1085488420-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:08:40.280207 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-75d90188-2c32-4958-8e7a-8415656abeff tempest-TestShelveInstance-1085488420 tempest-TestShelveInstance-1085488420-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:08:40.280726 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-75d90188-2c32-4958-8e7a-8415656abeff tempest-TestShelveInstance-1085488420 tempest-TestShelveInstance-1085488420-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:08:40.281502 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-75d90188-2c32-4958-8e7a-8415656abeff tempest-TestShelveInstance-1085488420 tempest-TestShelveInstance-1085488420-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:08:40.281959 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-75d90188-2c32-4958-8e7a-8415656abeff tempest-TestShelveInstance-1085488420 tempest-TestShelveInstance-1085488420-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:08:40.282414 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-75d90188-2c32-4958-8e7a-8415656abeff tempest-TestShelveInstance-1085488420 tempest-TestShelveInstance-1085488420-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:08:40.424223 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.policy [None req-75d90188-2c32-4958-8e7a-8415656abeff tempest-TestShelveInstance-1085488420 tempest-TestShelveInstance-1085488420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8fe3c5c28964b768b2c0023fc62f163', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd3d02b11bdf45fe99687fda3d1078cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:08:40.431831 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [None req-75d90188-2c32-4958-8e7a-8415656abeff tempest-TestShelveInstance-1085488420 tempest-TestShelveInstance-1085488420-project] 10.222.0.50 "GET /compute/v2.1/servers/60d69c7d-69e4-4b2a-b41c-692867a6e28d" status: 200 len: 1561 microversion: 2.1 time: 0.163143 Sep 24 05:08:40.432390 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 421/814] 10.222.0.50 () {58 vars in 1236 bytes} [Sat Sep 24 05:08:40 2022] GET /compute/v2.1/servers/60d69c7d-69e4-4b2a-b41c-692867a6e28d => generated 1561 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 05:08:41.220224 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-2e4fdf3f-acd2-4eb5-b6bc-3e805c41423e tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Calling method '>' {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:08:41.220831 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.compute.api [None req-2e4fdf3f-acd2-4eb5-b6bc-3e805c41423e tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] [instance: b2daebb8-dfea-4ab9-8253-008a21f906e1] Fetching instance by UUID {{(pid=120593) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:08:41.227100 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-2e4fdf3f-acd2-4eb5-b6bc-3e805c41423e tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:08:41.227578 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-2e4fdf3f-acd2-4eb5-b6bc-3e805c41423e tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:08:41.228008 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-2e4fdf3f-acd2-4eb5-b6bc-3e805c41423e tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:08:41.228687 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-2e4fdf3f-acd2-4eb5-b6bc-3e805c41423e tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:08:41.229132 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-2e4fdf3f-acd2-4eb5-b6bc-3e805c41423e tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:08:41.229550 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-2e4fdf3f-acd2-4eb5-b6bc-3e805c41423e tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:08:41.355467 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-2e4fdf3f-acd2-4eb5-b6bc-3e805c41423e tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b1b0448e7f54e3aaae49e411699269e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66ec8bde739145dda504995dbea0914a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:08:41.363761 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-2e4fdf3f-acd2-4eb5-b6bc-3e805c41423e tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] 10.222.0.50 "GET /compute/v2.1/servers/b2daebb8-dfea-4ab9-8253-008a21f906e1" status: 200 len: 1678 microversion: 2.1 time: 0.147463 Sep 24 05:08:41.364330 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 394/815] 10.222.0.50 () {58 vars in 1236 bytes} [Sat Sep 24 05:08:41 2022] GET /compute/v2.1/servers/b2daebb8-dfea-4ab9-8253-008a21f906e1 => generated 1678 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 05:08:41.455150 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-c4d6484b-938e-4e59-bdf5-99dc539ce7de tempest-TestShelveInstance-1085488420 tempest-TestShelveInstance-1085488420-project] Calling method '>' {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:08:41.455682 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.compute.api [None req-c4d6484b-938e-4e59-bdf5-99dc539ce7de tempest-TestShelveInstance-1085488420 tempest-TestShelveInstance-1085488420-project] [instance: 60d69c7d-69e4-4b2a-b41c-692867a6e28d] Fetching instance by UUID {{(pid=120594) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:08:41.461904 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-c4d6484b-938e-4e59-bdf5-99dc539ce7de tempest-TestShelveInstance-1085488420 tempest-TestShelveInstance-1085488420-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:08:41.462411 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-c4d6484b-938e-4e59-bdf5-99dc539ce7de tempest-TestShelveInstance-1085488420 tempest-TestShelveInstance-1085488420-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:08:41.462837 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-c4d6484b-938e-4e59-bdf5-99dc539ce7de tempest-TestShelveInstance-1085488420 tempest-TestShelveInstance-1085488420-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:08:41.463508 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-c4d6484b-938e-4e59-bdf5-99dc539ce7de tempest-TestShelveInstance-1085488420 tempest-TestShelveInstance-1085488420-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:08:41.463949 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-c4d6484b-938e-4e59-bdf5-99dc539ce7de tempest-TestShelveInstance-1085488420 tempest-TestShelveInstance-1085488420-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:08:41.464362 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-c4d6484b-938e-4e59-bdf5-99dc539ce7de tempest-TestShelveInstance-1085488420 tempest-TestShelveInstance-1085488420-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:08:41.594703 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.policy [None req-c4d6484b-938e-4e59-bdf5-99dc539ce7de tempest-TestShelveInstance-1085488420 tempest-TestShelveInstance-1085488420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8fe3c5c28964b768b2c0023fc62f163', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd3d02b11bdf45fe99687fda3d1078cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:08:41.602272 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [None req-c4d6484b-938e-4e59-bdf5-99dc539ce7de tempest-TestShelveInstance-1085488420 tempest-TestShelveInstance-1085488420-project] 10.222.0.50 "GET /compute/v2.1/servers/60d69c7d-69e4-4b2a-b41c-692867a6e28d" status: 200 len: 1561 microversion: 2.1 time: 0.150927 Sep 24 05:08:41.602830 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 422/816] 10.222.0.50 () {58 vars in 1236 bytes} [Sat Sep 24 05:08:41 2022] GET /compute/v2.1/servers/60d69c7d-69e4-4b2a-b41c-692867a6e28d => generated 1561 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 05:08:42.387603 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-de18cdb5-d0d6-49b0-9627-bef04428399a tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Calling method '>' {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:08:42.388226 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.compute.api [None req-de18cdb5-d0d6-49b0-9627-bef04428399a tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] [instance: b2daebb8-dfea-4ab9-8253-008a21f906e1] Fetching instance by UUID {{(pid=120593) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:08:42.394699 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-de18cdb5-d0d6-49b0-9627-bef04428399a tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:08:42.395181 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-de18cdb5-d0d6-49b0-9627-bef04428399a tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:08:42.395619 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-de18cdb5-d0d6-49b0-9627-bef04428399a tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:08:42.396306 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-de18cdb5-d0d6-49b0-9627-bef04428399a tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:08:42.396760 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-de18cdb5-d0d6-49b0-9627-bef04428399a tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:08:42.397183 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-de18cdb5-d0d6-49b0-9627-bef04428399a tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:08:42.525254 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-de18cdb5-d0d6-49b0-9627-bef04428399a tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b1b0448e7f54e3aaae49e411699269e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66ec8bde739145dda504995dbea0914a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:08:42.533653 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-de18cdb5-d0d6-49b0-9627-bef04428399a tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] 10.222.0.50 "GET /compute/v2.1/servers/b2daebb8-dfea-4ab9-8253-008a21f906e1" status: 200 len: 1678 microversion: 2.1 time: 0.149935 Sep 24 05:08:42.534251 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 395/817] 10.222.0.50 () {58 vars in 1236 bytes} [Sat Sep 24 05:08:42 2022] GET /compute/v2.1/servers/b2daebb8-dfea-4ab9-8253-008a21f906e1 => generated 1678 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 05:08:42.625896 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-46110e8a-c246-4410-9db2-2b8fff7595d9 tempest-TestShelveInstance-1085488420 tempest-TestShelveInstance-1085488420-project] Calling method '>' {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:08:42.626575 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.compute.api [None req-46110e8a-c246-4410-9db2-2b8fff7595d9 tempest-TestShelveInstance-1085488420 tempest-TestShelveInstance-1085488420-project] [instance: 60d69c7d-69e4-4b2a-b41c-692867a6e28d] Fetching instance by UUID {{(pid=120594) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:08:42.632949 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-46110e8a-c246-4410-9db2-2b8fff7595d9 tempest-TestShelveInstance-1085488420 tempest-TestShelveInstance-1085488420-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:08:42.633432 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-46110e8a-c246-4410-9db2-2b8fff7595d9 tempest-TestShelveInstance-1085488420 tempest-TestShelveInstance-1085488420-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:08:42.633873 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-46110e8a-c246-4410-9db2-2b8fff7595d9 tempest-TestShelveInstance-1085488420 tempest-TestShelveInstance-1085488420-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:08:42.634610 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-46110e8a-c246-4410-9db2-2b8fff7595d9 tempest-TestShelveInstance-1085488420 tempest-TestShelveInstance-1085488420-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:08:42.635061 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-46110e8a-c246-4410-9db2-2b8fff7595d9 tempest-TestShelveInstance-1085488420 tempest-TestShelveInstance-1085488420-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:08:42.635479 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-46110e8a-c246-4410-9db2-2b8fff7595d9 tempest-TestShelveInstance-1085488420 tempest-TestShelveInstance-1085488420-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:08:42.770793 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.policy [None req-46110e8a-c246-4410-9db2-2b8fff7595d9 tempest-TestShelveInstance-1085488420 tempest-TestShelveInstance-1085488420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8fe3c5c28964b768b2c0023fc62f163', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd3d02b11bdf45fe99687fda3d1078cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:08:42.778686 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [None req-46110e8a-c246-4410-9db2-2b8fff7595d9 tempest-TestShelveInstance-1085488420 tempest-TestShelveInstance-1085488420-project] 10.222.0.50 "GET /compute/v2.1/servers/60d69c7d-69e4-4b2a-b41c-692867a6e28d" status: 200 len: 1561 microversion: 2.1 time: 0.156431 Sep 24 05:08:42.786231 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 423/818] 10.222.0.50 () {58 vars in 1236 bytes} [Sat Sep 24 05:08:42 2022] GET /compute/v2.1/servers/60d69c7d-69e4-4b2a-b41c-692867a6e28d => generated 1561 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 05:08:43.558301 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-5f112cfa-fd7e-40e0-b86a-703ba30c9737 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Calling method '>' {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:08:43.558931 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.compute.api [None req-5f112cfa-fd7e-40e0-b86a-703ba30c9737 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] [instance: b2daebb8-dfea-4ab9-8253-008a21f906e1] Fetching instance by UUID {{(pid=120593) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:08:43.565311 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-5f112cfa-fd7e-40e0-b86a-703ba30c9737 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:08:43.565791 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-5f112cfa-fd7e-40e0-b86a-703ba30c9737 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:08:43.566260 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-5f112cfa-fd7e-40e0-b86a-703ba30c9737 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:08:43.566946 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-5f112cfa-fd7e-40e0-b86a-703ba30c9737 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:08:43.567399 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-5f112cfa-fd7e-40e0-b86a-703ba30c9737 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:08:43.567823 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-5f112cfa-fd7e-40e0-b86a-703ba30c9737 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:08:43.713676 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-5f112cfa-fd7e-40e0-b86a-703ba30c9737 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b1b0448e7f54e3aaae49e411699269e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66ec8bde739145dda504995dbea0914a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:08:43.721854 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-5f112cfa-fd7e-40e0-b86a-703ba30c9737 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] 10.222.0.50 "GET /compute/v2.1/servers/b2daebb8-dfea-4ab9-8253-008a21f906e1" status: 200 len: 1678 microversion: 2.1 time: 0.167487 Sep 24 05:08:43.722452 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 396/819] 10.222.0.50 () {58 vars in 1236 bytes} [Sat Sep 24 05:08:43 2022] GET /compute/v2.1/servers/b2daebb8-dfea-4ab9-8253-008a21f906e1 => generated 1678 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 24 05:08:43.802563 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-190eaa2f-7401-4a5c-b550-8d0aa370bcd9 tempest-TestShelveInstance-1085488420 tempest-TestShelveInstance-1085488420-project] Calling method '>' {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:08:43.803173 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.compute.api [None req-190eaa2f-7401-4a5c-b550-8d0aa370bcd9 tempest-TestShelveInstance-1085488420 tempest-TestShelveInstance-1085488420-project] [instance: 60d69c7d-69e4-4b2a-b41c-692867a6e28d] Fetching instance by UUID {{(pid=120594) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:08:43.809586 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-190eaa2f-7401-4a5c-b550-8d0aa370bcd9 tempest-TestShelveInstance-1085488420 tempest-TestShelveInstance-1085488420-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:08:43.810031 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-190eaa2f-7401-4a5c-b550-8d0aa370bcd9 tempest-TestShelveInstance-1085488420 tempest-TestShelveInstance-1085488420-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:08:43.810527 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-190eaa2f-7401-4a5c-b550-8d0aa370bcd9 tempest-TestShelveInstance-1085488420 tempest-TestShelveInstance-1085488420-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:08:43.812600 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-190eaa2f-7401-4a5c-b550-8d0aa370bcd9 tempest-TestShelveInstance-1085488420 tempest-TestShelveInstance-1085488420-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:08:43.812600 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-190eaa2f-7401-4a5c-b550-8d0aa370bcd9 tempest-TestShelveInstance-1085488420 tempest-TestShelveInstance-1085488420-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:08:43.812791 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-190eaa2f-7401-4a5c-b550-8d0aa370bcd9 tempest-TestShelveInstance-1085488420 tempest-TestShelveInstance-1085488420-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:08:43.940285 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.policy [None req-190eaa2f-7401-4a5c-b550-8d0aa370bcd9 tempest-TestShelveInstance-1085488420 tempest-TestShelveInstance-1085488420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8fe3c5c28964b768b2c0023fc62f163', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd3d02b11bdf45fe99687fda3d1078cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:08:43.947864 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [None req-190eaa2f-7401-4a5c-b550-8d0aa370bcd9 tempest-TestShelveInstance-1085488420 tempest-TestShelveInstance-1085488420-project] 10.222.0.50 "GET /compute/v2.1/servers/60d69c7d-69e4-4b2a-b41c-692867a6e28d" status: 200 len: 1561 microversion: 2.1 time: 0.149171 Sep 24 05:08:43.948426 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 424/820] 10.222.0.50 () {58 vars in 1236 bytes} [Sat Sep 24 05:08:43 2022] GET /compute/v2.1/servers/60d69c7d-69e4-4b2a-b41c-692867a6e28d => generated 1561 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 05:08:44.744651 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-54be84cc-c301-46df-8844-5e100864d341 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Calling method '>' {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:08:44.745259 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.compute.api [None req-54be84cc-c301-46df-8844-5e100864d341 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] [instance: b2daebb8-dfea-4ab9-8253-008a21f906e1] Fetching instance by UUID {{(pid=120593) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:08:44.751725 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-54be84cc-c301-46df-8844-5e100864d341 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:08:44.752205 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-54be84cc-c301-46df-8844-5e100864d341 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:08:44.752637 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-54be84cc-c301-46df-8844-5e100864d341 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:08:44.753321 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-54be84cc-c301-46df-8844-5e100864d341 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:08:44.753772 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-54be84cc-c301-46df-8844-5e100864d341 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:08:44.754230 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-54be84cc-c301-46df-8844-5e100864d341 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:08:44.883534 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-54be84cc-c301-46df-8844-5e100864d341 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b1b0448e7f54e3aaae49e411699269e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66ec8bde739145dda504995dbea0914a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:08:44.891405 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-54be84cc-c301-46df-8844-5e100864d341 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] 10.222.0.50 "GET /compute/v2.1/servers/b2daebb8-dfea-4ab9-8253-008a21f906e1" status: 200 len: 1678 microversion: 2.1 time: 0.150626 Sep 24 05:08:44.891966 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 397/821] 10.222.0.50 () {58 vars in 1236 bytes} [Sat Sep 24 05:08:44 2022] GET /compute/v2.1/servers/b2daebb8-dfea-4ab9-8253-008a21f906e1 => generated 1678 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 05:08:44.971892 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-8e8433b1-5cb0-448a-bb47-420435921ef1 tempest-TestShelveInstance-1085488420 tempest-TestShelveInstance-1085488420-project] Calling method '>' {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:08:44.972507 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.compute.api [None req-8e8433b1-5cb0-448a-bb47-420435921ef1 tempest-TestShelveInstance-1085488420 tempest-TestShelveInstance-1085488420-project] [instance: 60d69c7d-69e4-4b2a-b41c-692867a6e28d] Fetching instance by UUID {{(pid=120594) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:08:44.978738 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-8e8433b1-5cb0-448a-bb47-420435921ef1 tempest-TestShelveInstance-1085488420 tempest-TestShelveInstance-1085488420-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:08:44.979211 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-8e8433b1-5cb0-448a-bb47-420435921ef1 tempest-TestShelveInstance-1085488420 tempest-TestShelveInstance-1085488420-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:08:44.979639 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-8e8433b1-5cb0-448a-bb47-420435921ef1 tempest-TestShelveInstance-1085488420 tempest-TestShelveInstance-1085488420-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:08:44.980312 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-8e8433b1-5cb0-448a-bb47-420435921ef1 tempest-TestShelveInstance-1085488420 tempest-TestShelveInstance-1085488420-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:08:44.980763 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-8e8433b1-5cb0-448a-bb47-420435921ef1 tempest-TestShelveInstance-1085488420 tempest-TestShelveInstance-1085488420-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:08:44.981183 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-8e8433b1-5cb0-448a-bb47-420435921ef1 tempest-TestShelveInstance-1085488420 tempest-TestShelveInstance-1085488420-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:08:45.116941 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.policy [None req-8e8433b1-5cb0-448a-bb47-420435921ef1 tempest-TestShelveInstance-1085488420 tempest-TestShelveInstance-1085488420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8fe3c5c28964b768b2c0023fc62f163', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd3d02b11bdf45fe99687fda3d1078cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:08:45.125956 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [None req-8e8433b1-5cb0-448a-bb47-420435921ef1 tempest-TestShelveInstance-1085488420 tempest-TestShelveInstance-1085488420-project] 10.222.0.50 "GET /compute/v2.1/servers/60d69c7d-69e4-4b2a-b41c-692867a6e28d" status: 200 len: 1561 microversion: 2.1 time: 0.158415 Sep 24 05:08:45.126556 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 425/822] 10.222.0.50 () {58 vars in 1236 bytes} [Sat Sep 24 05:08:44 2022] GET /compute/v2.1/servers/60d69c7d-69e4-4b2a-b41c-692867a6e28d => generated 1561 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 05:08:45.914961 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-53510a5f-12bb-4ced-a8cd-ea443a045da8 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Calling method '>' {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:08:45.915539 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.compute.api [None req-53510a5f-12bb-4ced-a8cd-ea443a045da8 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] [instance: b2daebb8-dfea-4ab9-8253-008a21f906e1] Fetching instance by UUID {{(pid=120593) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:08:45.922400 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-53510a5f-12bb-4ced-a8cd-ea443a045da8 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:08:45.922877 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-53510a5f-12bb-4ced-a8cd-ea443a045da8 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:08:45.923305 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-53510a5f-12bb-4ced-a8cd-ea443a045da8 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:08:45.923992 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-53510a5f-12bb-4ced-a8cd-ea443a045da8 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:08:45.924445 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-53510a5f-12bb-4ced-a8cd-ea443a045da8 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:08:45.924924 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-53510a5f-12bb-4ced-a8cd-ea443a045da8 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:08:46.058161 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-53510a5f-12bb-4ced-a8cd-ea443a045da8 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b1b0448e7f54e3aaae49e411699269e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66ec8bde739145dda504995dbea0914a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:08:46.066392 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-53510a5f-12bb-4ced-a8cd-ea443a045da8 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] 10.222.0.50 "GET /compute/v2.1/servers/b2daebb8-dfea-4ab9-8253-008a21f906e1" status: 200 len: 1655 microversion: 2.1 time: 0.155468 Sep 24 05:08:46.066962 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 398/823] 10.222.0.50 () {58 vars in 1236 bytes} [Sat Sep 24 05:08:45 2022] GET /compute/v2.1/servers/b2daebb8-dfea-4ab9-8253-008a21f906e1 => generated 1655 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 05:08:46.089845 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-cb4f35c4-541e-482c-86a0-8f8e22d3c2e9 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 05:08:46.092359 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG dbcounter [-] [120594] Writing DB stats nova_api:SELECT=66,nova_api:INSERT=3 {{(pid=120594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 05:08:46.099366 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-cb4f35c4-541e-482c-86a0-8f8e22d3c2e9 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:08:46.100246 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-cb4f35c4-541e-482c-86a0-8f8e22d3c2e9 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:08:46.101057 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-cb4f35c4-541e-482c-86a0-8f8e22d3c2e9 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:08:46.131128 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.compute.api [None req-cb4f35c4-541e-482c-86a0-8f8e22d3c2e9 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] [instance: b2daebb8-dfea-4ab9-8253-008a21f906e1] Going to try to start instance {{(pid=120594) start /opt/stack/nova/nova/compute/api.py:2785}} Sep 24 05:08:46.150025 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-5de8c080-e982-4a42-b9e2-b26015d6a096 tempest-TestShelveInstance-1085488420 tempest-TestShelveInstance-1085488420-project] Calling method '>' {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:08:46.150642 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.compute.api [None req-5de8c080-e982-4a42-b9e2-b26015d6a096 tempest-TestShelveInstance-1085488420 tempest-TestShelveInstance-1085488420-project] [instance: 60d69c7d-69e4-4b2a-b41c-692867a6e28d] Fetching instance by UUID {{(pid=120593) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:08:46.157270 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-5de8c080-e982-4a42-b9e2-b26015d6a096 tempest-TestShelveInstance-1085488420 tempest-TestShelveInstance-1085488420-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:08:46.157749 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-5de8c080-e982-4a42-b9e2-b26015d6a096 tempest-TestShelveInstance-1085488420 tempest-TestShelveInstance-1085488420-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:08:46.158299 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-5de8c080-e982-4a42-b9e2-b26015d6a096 tempest-TestShelveInstance-1085488420 tempest-TestShelveInstance-1085488420-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:08:46.159110 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-5de8c080-e982-4a42-b9e2-b26015d6a096 tempest-TestShelveInstance-1085488420 tempest-TestShelveInstance-1085488420-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:08:46.159623 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-5de8c080-e982-4a42-b9e2-b26015d6a096 tempest-TestShelveInstance-1085488420 tempest-TestShelveInstance-1085488420-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:08:46.160196 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-5de8c080-e982-4a42-b9e2-b26015d6a096 tempest-TestShelveInstance-1085488420 tempest-TestShelveInstance-1085488420-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:08:46.180001 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [None req-cb4f35c4-541e-482c-86a0-8f8e22d3c2e9 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] 10.222.0.50 "POST /compute/v2.1/servers/b2daebb8-dfea-4ab9-8253-008a21f906e1/action" status: 202 len: 0 microversion: 2.1 time: 0.093318 Sep 24 05:08:46.184920 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 426/824] 10.222.0.50 () {60 vars in 1278 bytes} [Sat Sep 24 05:08:46 2022] POST /compute/v2.1/servers/b2daebb8-dfea-4ab9-8253-008a21f906e1/action => generated 0 bytes in 96 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 24 05:08:46.191018 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-56d213c0-d4f5-4982-b803-e8f679350505 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Calling method '>' {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:08:46.191906 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.compute.api [None req-56d213c0-d4f5-4982-b803-e8f679350505 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] [instance: b2daebb8-dfea-4ab9-8253-008a21f906e1] Fetching instance by UUID {{(pid=120594) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:08:46.199429 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-56d213c0-d4f5-4982-b803-e8f679350505 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:08:46.200129 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-56d213c0-d4f5-4982-b803-e8f679350505 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:08:46.200675 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-56d213c0-d4f5-4982-b803-e8f679350505 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:08:46.201431 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-56d213c0-d4f5-4982-b803-e8f679350505 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:08:46.201966 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-56d213c0-d4f5-4982-b803-e8f679350505 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:08:46.202622 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-56d213c0-d4f5-4982-b803-e8f679350505 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:08:46.364050 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-5de8c080-e982-4a42-b9e2-b26015d6a096 tempest-TestShelveInstance-1085488420 tempest-TestShelveInstance-1085488420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8fe3c5c28964b768b2c0023fc62f163', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd3d02b11bdf45fe99687fda3d1078cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:08:46.372279 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-5de8c080-e982-4a42-b9e2-b26015d6a096 tempest-TestShelveInstance-1085488420 tempest-TestShelveInstance-1085488420-project] 10.222.0.50 "GET /compute/v2.1/servers/60d69c7d-69e4-4b2a-b41c-692867a6e28d" status: 200 len: 1502 microversion: 2.1 time: 0.226017 Sep 24 05:08:46.372865 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 399/825] 10.222.0.50 () {58 vars in 1236 bytes} [Sat Sep 24 05:08:46 2022] GET /compute/v2.1/servers/60d69c7d-69e4-4b2a-b41c-692867a6e28d => generated 1502 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 24 05:08:46.394362 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.policy [None req-56d213c0-d4f5-4982-b803-e8f679350505 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b1b0448e7f54e3aaae49e411699269e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66ec8bde739145dda504995dbea0914a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:08:46.394811 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-9a4d45bf-4a1b-434c-8746-55605b50a676 tempest-TestShelveInstance-1085488420 tempest-TestShelveInstance-1085488420-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 05:08:46.395583 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.compute.api [None req-9a4d45bf-4a1b-434c-8746-55605b50a676 tempest-TestShelveInstance-1085488420 tempest-TestShelveInstance-1085488420-project] [instance: 60d69c7d-69e4-4b2a-b41c-692867a6e28d] Fetching instance by UUID {{(pid=120593) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:08:46.398742 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG dbcounter [-] [120593] Writing DB stats nova_api:SELECT=57 {{(pid=120593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 05:08:46.402416 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-9a4d45bf-4a1b-434c-8746-55605b50a676 tempest-TestShelveInstance-1085488420 tempest-TestShelveInstance-1085488420-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:08:46.403083 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-9a4d45bf-4a1b-434c-8746-55605b50a676 tempest-TestShelveInstance-1085488420 tempest-TestShelveInstance-1085488420-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:08:46.403519 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [None req-56d213c0-d4f5-4982-b803-e8f679350505 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] 10.222.0.50 "GET /compute/v2.1/servers/b2daebb8-dfea-4ab9-8253-008a21f906e1" status: 200 len: 1664 microversion: 2.1 time: 0.217047 Sep 24 05:08:46.403887 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-9a4d45bf-4a1b-434c-8746-55605b50a676 tempest-TestShelveInstance-1085488420 tempest-TestShelveInstance-1085488420-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:08:46.404324 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 427/826] 10.222.0.50 () {58 vars in 1236 bytes} [Sat Sep 24 05:08:46 2022] GET /compute/v2.1/servers/b2daebb8-dfea-4ab9-8253-008a21f906e1 => generated 1664 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 24 05:08:46.405165 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-9a4d45bf-4a1b-434c-8746-55605b50a676 tempest-TestShelveInstance-1085488420 tempest-TestShelveInstance-1085488420-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:08:46.406323 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-9a4d45bf-4a1b-434c-8746-55605b50a676 tempest-TestShelveInstance-1085488420 tempest-TestShelveInstance-1085488420-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:08:46.406928 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-9a4d45bf-4a1b-434c-8746-55605b50a676 tempest-TestShelveInstance-1085488420 tempest-TestShelveInstance-1085488420-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:08:46.451692 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.compute.api [None req-9a4d45bf-4a1b-434c-8746-55605b50a676 tempest-TestShelveInstance-1085488420 tempest-TestShelveInstance-1085488420-project] [instance: 60d69c7d-69e4-4b2a-b41c-692867a6e28d] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=120593) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Sep 24 05:08:46.535145 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-9a4d45bf-4a1b-434c-8746-55605b50a676 tempest-TestShelveInstance-1085488420 tempest-TestShelveInstance-1085488420-project] 10.222.0.50 "POST /compute/v2.1/servers/60d69c7d-69e4-4b2a-b41c-692867a6e28d/action" status: 202 len: 0 microversion: 2.1 time: 0.144159 Sep 24 05:08:46.536050 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 400/827] 10.222.0.50 () {60 vars in 1278 bytes} [Sat Sep 24 05:08:46 2022] POST /compute/v2.1/servers/60d69c7d-69e4-4b2a-b41c-692867a6e28d/action => generated 0 bytes in 146 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 24 05:08:46.544191 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-0f2c7f83-77ca-4e3f-920d-176b3de3d1d4 tempest-TestShelveInstance-1085488420 tempest-TestShelveInstance-1085488420-project] Calling method '>' {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:08:46.545015 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.compute.api [None req-0f2c7f83-77ca-4e3f-920d-176b3de3d1d4 tempest-TestShelveInstance-1085488420 tempest-TestShelveInstance-1085488420-project] [instance: 60d69c7d-69e4-4b2a-b41c-692867a6e28d] Fetching instance by UUID {{(pid=120594) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:08:46.552890 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-0f2c7f83-77ca-4e3f-920d-176b3de3d1d4 tempest-TestShelveInstance-1085488420 tempest-TestShelveInstance-1085488420-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:08:46.553385 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-0f2c7f83-77ca-4e3f-920d-176b3de3d1d4 tempest-TestShelveInstance-1085488420 tempest-TestShelveInstance-1085488420-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:08:46.553844 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-0f2c7f83-77ca-4e3f-920d-176b3de3d1d4 tempest-TestShelveInstance-1085488420 tempest-TestShelveInstance-1085488420-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:08:46.554707 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-0f2c7f83-77ca-4e3f-920d-176b3de3d1d4 tempest-TestShelveInstance-1085488420 tempest-TestShelveInstance-1085488420-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:08:46.555334 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-0f2c7f83-77ca-4e3f-920d-176b3de3d1d4 tempest-TestShelveInstance-1085488420 tempest-TestShelveInstance-1085488420-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:08:46.555764 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-0f2c7f83-77ca-4e3f-920d-176b3de3d1d4 tempest-TestShelveInstance-1085488420 tempest-TestShelveInstance-1085488420-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:08:46.722967 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.policy [None req-0f2c7f83-77ca-4e3f-920d-176b3de3d1d4 tempest-TestShelveInstance-1085488420 tempest-TestShelveInstance-1085488420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8fe3c5c28964b768b2c0023fc62f163', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd3d02b11bdf45fe99687fda3d1078cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:08:46.731266 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [None req-0f2c7f83-77ca-4e3f-920d-176b3de3d1d4 tempest-TestShelveInstance-1085488420 tempest-TestShelveInstance-1085488420-project] 10.222.0.50 "GET /compute/v2.1/servers/60d69c7d-69e4-4b2a-b41c-692867a6e28d" status: 200 len: 1510 microversion: 2.1 time: 0.190966 Sep 24 05:08:46.731829 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 428/828] 10.222.0.50 () {58 vars in 1236 bytes} [Sat Sep 24 05:08:46 2022] GET /compute/v2.1/servers/60d69c7d-69e4-4b2a-b41c-692867a6e28d => generated 1510 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 24 05:08:47.428417 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-67487a60-01be-408a-87c2-2c7ddf82d602 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Calling method '>' {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:08:47.429041 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.compute.api [None req-67487a60-01be-408a-87c2-2c7ddf82d602 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] [instance: b2daebb8-dfea-4ab9-8253-008a21f906e1] Fetching instance by UUID {{(pid=120593) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:08:47.435251 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-67487a60-01be-408a-87c2-2c7ddf82d602 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:08:47.435743 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-67487a60-01be-408a-87c2-2c7ddf82d602 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:08:47.436187 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-67487a60-01be-408a-87c2-2c7ddf82d602 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:08:47.436896 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-67487a60-01be-408a-87c2-2c7ddf82d602 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:08:47.437357 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-67487a60-01be-408a-87c2-2c7ddf82d602 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:08:47.437785 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-67487a60-01be-408a-87c2-2c7ddf82d602 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:08:47.570708 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-67487a60-01be-408a-87c2-2c7ddf82d602 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b1b0448e7f54e3aaae49e411699269e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66ec8bde739145dda504995dbea0914a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:08:47.579154 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-67487a60-01be-408a-87c2-2c7ddf82d602 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] 10.222.0.50 "GET /compute/v2.1/servers/b2daebb8-dfea-4ab9-8253-008a21f906e1" status: 200 len: 1664 microversion: 2.1 time: 0.155439 Sep 24 05:08:47.579734 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 401/829] 10.222.0.50 () {58 vars in 1236 bytes} [Sat Sep 24 05:08:47 2022] GET /compute/v2.1/servers/b2daebb8-dfea-4ab9-8253-008a21f906e1 => generated 1664 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 05:08:47.767532 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-ca27a686-37a9-45b4-822c-bccb99c4b1f4 tempest-TestShelveInstance-1085488420 tempest-TestShelveInstance-1085488420-project] Calling method '>' {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:08:47.768143 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.compute.api [None req-ca27a686-37a9-45b4-822c-bccb99c4b1f4 tempest-TestShelveInstance-1085488420 tempest-TestShelveInstance-1085488420-project] [instance: 60d69c7d-69e4-4b2a-b41c-692867a6e28d] Fetching instance by UUID {{(pid=120594) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:08:47.774655 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-ca27a686-37a9-45b4-822c-bccb99c4b1f4 tempest-TestShelveInstance-1085488420 tempest-TestShelveInstance-1085488420-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:08:47.775133 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-ca27a686-37a9-45b4-822c-bccb99c4b1f4 tempest-TestShelveInstance-1085488420 tempest-TestShelveInstance-1085488420-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:08:47.775564 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-ca27a686-37a9-45b4-822c-bccb99c4b1f4 tempest-TestShelveInstance-1085488420 tempest-TestShelveInstance-1085488420-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:08:47.776244 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-ca27a686-37a9-45b4-822c-bccb99c4b1f4 tempest-TestShelveInstance-1085488420 tempest-TestShelveInstance-1085488420-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:08:47.776691 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-ca27a686-37a9-45b4-822c-bccb99c4b1f4 tempest-TestShelveInstance-1085488420 tempest-TestShelveInstance-1085488420-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:08:47.777112 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-ca27a686-37a9-45b4-822c-bccb99c4b1f4 tempest-TestShelveInstance-1085488420 tempest-TestShelveInstance-1085488420-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:08:47.915882 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.policy [None req-ca27a686-37a9-45b4-822c-bccb99c4b1f4 tempest-TestShelveInstance-1085488420 tempest-TestShelveInstance-1085488420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8fe3c5c28964b768b2c0023fc62f163', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd3d02b11bdf45fe99687fda3d1078cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:08:47.932561 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [None req-ca27a686-37a9-45b4-822c-bccb99c4b1f4 tempest-TestShelveInstance-1085488420 tempest-TestShelveInstance-1085488420-project] 10.222.0.50 "GET /compute/v2.1/servers/60d69c7d-69e4-4b2a-b41c-692867a6e28d" status: 200 len: 1510 microversion: 2.1 time: 0.169452 Sep 24 05:08:47.933283 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 429/830] 10.222.0.50 () {58 vars in 1236 bytes} [Sat Sep 24 05:08:47 2022] GET /compute/v2.1/servers/60d69c7d-69e4-4b2a-b41c-692867a6e28d => generated 1510 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 05:08:48.602084 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-da9eb47a-d06f-4c75-ba08-5dbf59a8544a tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Calling method '>' {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:08:48.602696 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.compute.api [None req-da9eb47a-d06f-4c75-ba08-5dbf59a8544a tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] [instance: b2daebb8-dfea-4ab9-8253-008a21f906e1] Fetching instance by UUID {{(pid=120593) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:08:48.609625 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-da9eb47a-d06f-4c75-ba08-5dbf59a8544a tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:08:48.610141 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-da9eb47a-d06f-4c75-ba08-5dbf59a8544a tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:08:48.610578 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-da9eb47a-d06f-4c75-ba08-5dbf59a8544a tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:08:48.611268 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-da9eb47a-d06f-4c75-ba08-5dbf59a8544a tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:08:48.611751 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-da9eb47a-d06f-4c75-ba08-5dbf59a8544a tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:08:48.612280 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-da9eb47a-d06f-4c75-ba08-5dbf59a8544a tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:08:48.740113 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-da9eb47a-d06f-4c75-ba08-5dbf59a8544a tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b1b0448e7f54e3aaae49e411699269e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66ec8bde739145dda504995dbea0914a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:08:48.748134 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-da9eb47a-d06f-4c75-ba08-5dbf59a8544a tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] 10.222.0.50 "GET /compute/v2.1/servers/b2daebb8-dfea-4ab9-8253-008a21f906e1" status: 200 len: 1668 microversion: 2.1 time: 0.149991 Sep 24 05:08:48.748702 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 402/831] 10.222.0.50 () {58 vars in 1236 bytes} [Sat Sep 24 05:08:48 2022] GET /compute/v2.1/servers/b2daebb8-dfea-4ab9-8253-008a21f906e1 => generated 1668 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 05:08:48.755537 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [req-c6b22973-03d8-4c00-a46b-bdfe0f50ec25 req-2eff050b-a020-44ad-b315-2555007e7094 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "60d69c7d-69e4-4b2a-b41c-692867a6e28d", "name": "network-vif-unplugged", "status": "completed", "tag": "fab1bdaa-696a-4cf2-b4c6-ca1ee5692022"}]} {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 05:08:48.767367 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [req-c6b22973-03d8-4c00-a46b-bdfe0f50ec25 req-2eff050b-a020-44ad-b315-2555007e7094 service nova] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:08:48.767929 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [req-c6b22973-03d8-4c00-a46b-bdfe0f50ec25 req-2eff050b-a020-44ad-b315-2555007e7094 service nova] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:08:48.768521 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [req-c6b22973-03d8-4c00-a46b-bdfe0f50ec25 req-2eff050b-a020-44ad-b315-2555007e7094 service nova] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:08:48.779589 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.compute.server_external_events [req-c6b22973-03d8-4c00-a46b-bdfe0f50ec25 req-2eff050b-a020-44ad-b315-2555007e7094 service nova] Unable to find a host for instance 60d69c7d-69e4-4b2a-b41c-692867a6e28d. Dropping event network-vif-unplugged {{(pid=120594) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:144}} Sep 24 05:08:48.781347 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [req-c6b22973-03d8-4c00-a46b-bdfe0f50ec25 req-2eff050b-a020-44ad-b315-2555007e7094 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.030102 Sep 24 05:08:48.782030 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 430/832] 10.222.0.50 () {64 vars in 1317 bytes} [Sat Sep 24 05:08:48 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 31 msecs (HTTP/1.1 207) 9 headers in 367 bytes (2 switches on core 0) Sep 24 05:08:48.955883 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-e20fec2d-7f3b-4ef6-91e4-1d933d1c137c tempest-TestShelveInstance-1085488420 tempest-TestShelveInstance-1085488420-project] Calling method '>' {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:08:48.956505 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.compute.api [None req-e20fec2d-7f3b-4ef6-91e4-1d933d1c137c tempest-TestShelveInstance-1085488420 tempest-TestShelveInstance-1085488420-project] [instance: 60d69c7d-69e4-4b2a-b41c-692867a6e28d] Fetching instance by UUID {{(pid=120593) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:08:48.962347 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-e20fec2d-7f3b-4ef6-91e4-1d933d1c137c tempest-TestShelveInstance-1085488420 tempest-TestShelveInstance-1085488420-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:08:48.962822 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-e20fec2d-7f3b-4ef6-91e4-1d933d1c137c tempest-TestShelveInstance-1085488420 tempest-TestShelveInstance-1085488420-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:08:48.963253 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-e20fec2d-7f3b-4ef6-91e4-1d933d1c137c tempest-TestShelveInstance-1085488420 tempest-TestShelveInstance-1085488420-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:08:48.963929 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-e20fec2d-7f3b-4ef6-91e4-1d933d1c137c tempest-TestShelveInstance-1085488420 tempest-TestShelveInstance-1085488420-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:08:48.964378 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-e20fec2d-7f3b-4ef6-91e4-1d933d1c137c tempest-TestShelveInstance-1085488420 tempest-TestShelveInstance-1085488420-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:08:48.964795 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-e20fec2d-7f3b-4ef6-91e4-1d933d1c137c tempest-TestShelveInstance-1085488420 tempest-TestShelveInstance-1085488420-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:08:49.097137 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-e20fec2d-7f3b-4ef6-91e4-1d933d1c137c tempest-TestShelveInstance-1085488420 tempest-TestShelveInstance-1085488420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8fe3c5c28964b768b2c0023fc62f163', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd3d02b11bdf45fe99687fda3d1078cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:08:49.104792 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-e20fec2d-7f3b-4ef6-91e4-1d933d1c137c tempest-TestShelveInstance-1085488420 tempest-TestShelveInstance-1085488420-project] 10.222.0.50 "GET /compute/v2.1/servers/60d69c7d-69e4-4b2a-b41c-692867a6e28d" status: 200 len: 1510 microversion: 2.1 time: 0.153316 Sep 24 05:08:49.105354 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 403/833] 10.222.0.50 () {58 vars in 1236 bytes} [Sat Sep 24 05:08:48 2022] GET /compute/v2.1/servers/60d69c7d-69e4-4b2a-b41c-692867a6e28d => generated 1510 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 05:08:50.128632 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-80d04f36-87f6-4560-b678-9c8f52d96a61 tempest-TestShelveInstance-1085488420 tempest-TestShelveInstance-1085488420-project] Calling method '>' {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:08:50.129268 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.compute.api [None req-80d04f36-87f6-4560-b678-9c8f52d96a61 tempest-TestShelveInstance-1085488420 tempest-TestShelveInstance-1085488420-project] [instance: 60d69c7d-69e4-4b2a-b41c-692867a6e28d] Fetching instance by UUID {{(pid=120594) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:08:50.135662 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-80d04f36-87f6-4560-b678-9c8f52d96a61 tempest-TestShelveInstance-1085488420 tempest-TestShelveInstance-1085488420-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:08:50.136131 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-80d04f36-87f6-4560-b678-9c8f52d96a61 tempest-TestShelveInstance-1085488420 tempest-TestShelveInstance-1085488420-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:08:50.136557 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-80d04f36-87f6-4560-b678-9c8f52d96a61 tempest-TestShelveInstance-1085488420 tempest-TestShelveInstance-1085488420-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:08:50.137231 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-80d04f36-87f6-4560-b678-9c8f52d96a61 tempest-TestShelveInstance-1085488420 tempest-TestShelveInstance-1085488420-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:08:50.137673 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-80d04f36-87f6-4560-b678-9c8f52d96a61 tempest-TestShelveInstance-1085488420 tempest-TestShelveInstance-1085488420-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:08:50.138112 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-80d04f36-87f6-4560-b678-9c8f52d96a61 tempest-TestShelveInstance-1085488420 tempest-TestShelveInstance-1085488420-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:08:50.265672 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.policy [None req-80d04f36-87f6-4560-b678-9c8f52d96a61 tempest-TestShelveInstance-1085488420 tempest-TestShelveInstance-1085488420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8fe3c5c28964b768b2c0023fc62f163', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd3d02b11bdf45fe99687fda3d1078cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:08:50.269382 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG dbcounter [-] [120594] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 05:08:50.274695 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [None req-80d04f36-87f6-4560-b678-9c8f52d96a61 tempest-TestShelveInstance-1085488420 tempest-TestShelveInstance-1085488420-project] 10.222.0.50 "GET /compute/v2.1/servers/60d69c7d-69e4-4b2a-b41c-692867a6e28d" status: 200 len: 1510 microversion: 2.1 time: 0.149687 Sep 24 05:08:50.275046 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 431/834] 10.222.0.50 () {58 vars in 1236 bytes} [Sat Sep 24 05:08:50 2022] GET /compute/v2.1/servers/60d69c7d-69e4-4b2a-b41c-692867a6e28d => generated 1510 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 05:08:50.385333 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-27af4928-91bb-490e-8201-edf14cd69e3f tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Calling method '>' {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:08:50.385825 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.compute.api [None req-27af4928-91bb-490e-8201-edf14cd69e3f tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] [instance: 08fb826b-e891-46c4-990d-ca03cf3f4222] Fetching instance by UUID {{(pid=120593) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:08:50.392603 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-27af4928-91bb-490e-8201-edf14cd69e3f tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:08:50.393085 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-27af4928-91bb-490e-8201-edf14cd69e3f tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:08:50.393522 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-27af4928-91bb-490e-8201-edf14cd69e3f tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:08:50.394251 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-27af4928-91bb-490e-8201-edf14cd69e3f tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:08:50.394705 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-27af4928-91bb-490e-8201-edf14cd69e3f tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:08:50.395129 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-27af4928-91bb-490e-8201-edf14cd69e3f tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:08:50.423859 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-27af4928-91bb-490e-8201-edf14cd69e3f tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] 10.222.0.50 "GET /compute/v2.1/servers/08fb826b-e891-46c4-990d-ca03cf3f4222/os-volume_attachments/555f48a9-a917-4eb8-95d4-2364fac6f0d9" status: 200 len: 194 microversion: 2.20 time: 0.042629 Sep 24 05:08:50.424431 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 404/835] 10.222.0.50 () {60 vars in 1454 bytes} [Sat Sep 24 05:08:50 2022] GET /compute/v2.1/servers/08fb826b-e891-46c4-990d-ca03cf3f4222/os-volume_attachments/555f48a9-a917-4eb8-95d4-2364fac6f0d9 => generated 194 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 24 05:08:50.492522 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-13cd5118-4ee4-4c24-a3e1-03923912e967 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Calling method '>' {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:08:50.493018 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.compute.api [None req-13cd5118-4ee4-4c24-a3e1-03923912e967 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] [instance: 08fb826b-e891-46c4-990d-ca03cf3f4222] Fetching instance by UUID {{(pid=120594) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:08:50.499807 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-13cd5118-4ee4-4c24-a3e1-03923912e967 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:08:50.500318 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-13cd5118-4ee4-4c24-a3e1-03923912e967 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:08:50.500754 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-13cd5118-4ee4-4c24-a3e1-03923912e967 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:08:50.501441 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-13cd5118-4ee4-4c24-a3e1-03923912e967 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:08:50.501892 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-13cd5118-4ee4-4c24-a3e1-03923912e967 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:08:50.502351 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-13cd5118-4ee4-4c24-a3e1-03923912e967 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:08:50.582476 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.objects.instance [None req-13cd5118-4ee4-4c24-a3e1-03923912e967 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Lazy-loading 'services' on Instance uuid 08fb826b-e891-46c4-990d-ca03cf3f4222 {{(pid=120594) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 24 05:08:50.656961 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [None req-13cd5118-4ee4-4c24-a3e1-03923912e967 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] 10.222.0.50 "DELETE /compute/v2.1/servers/08fb826b-e891-46c4-990d-ca03cf3f4222/os-volume_attachments/555f48a9-a917-4eb8-95d4-2364fac6f0d9" status: 202 len: 0 microversion: 2.20 time: 0.168160 Sep 24 05:08:50.657664 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 432/836] 10.222.0.50 () {60 vars in 1457 bytes} [Sat Sep 24 05:08:50 2022] DELETE /compute/v2.1/servers/08fb826b-e891-46c4-990d-ca03cf3f4222/os-volume_attachments/555f48a9-a917-4eb8-95d4-2364fac6f0d9 => generated 0 bytes in 170 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Sep 24 05:08:50.665950 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-fd9517b5-f5b3-46f0-8275-2a3af8b5e2da tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Calling method '>' {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:08:50.668225 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.compute.api [None req-fd9517b5-f5b3-46f0-8275-2a3af8b5e2da tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] [instance: 08fb826b-e891-46c4-990d-ca03cf3f4222] Fetching instance by UUID {{(pid=120593) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:08:50.674318 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-fd9517b5-f5b3-46f0-8275-2a3af8b5e2da tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:08:50.674882 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-fd9517b5-f5b3-46f0-8275-2a3af8b5e2da tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:08:50.675333 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-fd9517b5-f5b3-46f0-8275-2a3af8b5e2da tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:08:50.676108 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-fd9517b5-f5b3-46f0-8275-2a3af8b5e2da tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:08:50.676563 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-fd9517b5-f5b3-46f0-8275-2a3af8b5e2da tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:08:50.676992 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-fd9517b5-f5b3-46f0-8275-2a3af8b5e2da tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:08:50.708510 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-fd9517b5-f5b3-46f0-8275-2a3af8b5e2da tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] 10.222.0.50 "GET /compute/v2.1/servers/08fb826b-e891-46c4-990d-ca03cf3f4222/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046476 Sep 24 05:08:50.709068 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 405/837] 10.222.0.50 () {60 vars in 1343 bytes} [Sat Sep 24 05:08:50 2022] GET /compute/v2.1/servers/08fb826b-e891-46c4-990d-ca03cf3f4222/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 24 05:08:51.300657 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-aba0f3d2-3eed-451e-8a84-53c1eda0e266 tempest-TestShelveInstance-1085488420 tempest-TestShelveInstance-1085488420-project] Calling method '>' {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:08:51.301375 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.compute.api [None req-aba0f3d2-3eed-451e-8a84-53c1eda0e266 tempest-TestShelveInstance-1085488420 tempest-TestShelveInstance-1085488420-project] [instance: 60d69c7d-69e4-4b2a-b41c-692867a6e28d] Fetching instance by UUID {{(pid=120594) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:08:51.307679 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-aba0f3d2-3eed-451e-8a84-53c1eda0e266 tempest-TestShelveInstance-1085488420 tempest-TestShelveInstance-1085488420-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:08:51.308161 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-aba0f3d2-3eed-451e-8a84-53c1eda0e266 tempest-TestShelveInstance-1085488420 tempest-TestShelveInstance-1085488420-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:08:51.308590 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-aba0f3d2-3eed-451e-8a84-53c1eda0e266 tempest-TestShelveInstance-1085488420 tempest-TestShelveInstance-1085488420-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:08:51.309274 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-aba0f3d2-3eed-451e-8a84-53c1eda0e266 tempest-TestShelveInstance-1085488420 tempest-TestShelveInstance-1085488420-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:08:51.309756 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-aba0f3d2-3eed-451e-8a84-53c1eda0e266 tempest-TestShelveInstance-1085488420 tempest-TestShelveInstance-1085488420-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:08:51.310312 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-aba0f3d2-3eed-451e-8a84-53c1eda0e266 tempest-TestShelveInstance-1085488420 tempest-TestShelveInstance-1085488420-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:08:51.453460 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.policy [None req-aba0f3d2-3eed-451e-8a84-53c1eda0e266 tempest-TestShelveInstance-1085488420 tempest-TestShelveInstance-1085488420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8fe3c5c28964b768b2c0023fc62f163', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd3d02b11bdf45fe99687fda3d1078cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:08:51.461967 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [None req-aba0f3d2-3eed-451e-8a84-53c1eda0e266 tempest-TestShelveInstance-1085488420 tempest-TestShelveInstance-1085488420-project] 10.222.0.50 "GET /compute/v2.1/servers/60d69c7d-69e4-4b2a-b41c-692867a6e28d" status: 200 len: 1510 microversion: 2.1 time: 0.166185 Sep 24 05:08:51.469507 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 433/838] 10.222.0.50 () {58 vars in 1236 bytes} [Sat Sep 24 05:08:51 2022] GET /compute/v2.1/servers/60d69c7d-69e4-4b2a-b41c-692867a6e28d => generated 1510 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 05:08:51.721801 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-32951d47-25e3-4604-a3f6-3356586966e2 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Calling method '>' {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:08:51.724055 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.compute.api [None req-32951d47-25e3-4604-a3f6-3356586966e2 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] [instance: 08fb826b-e891-46c4-990d-ca03cf3f4222] Fetching instance by UUID {{(pid=120593) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:08:51.730567 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-32951d47-25e3-4604-a3f6-3356586966e2 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:08:51.731058 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-32951d47-25e3-4604-a3f6-3356586966e2 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:08:51.731494 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-32951d47-25e3-4604-a3f6-3356586966e2 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:08:51.732190 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-32951d47-25e3-4604-a3f6-3356586966e2 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:08:51.732677 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-32951d47-25e3-4604-a3f6-3356586966e2 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:08:51.733171 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-32951d47-25e3-4604-a3f6-3356586966e2 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:08:51.738438 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG dbcounter [-] [120593] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 05:08:51.775346 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-32951d47-25e3-4604-a3f6-3356586966e2 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] 10.222.0.50 "GET /compute/v2.1/servers/08fb826b-e891-46c4-990d-ca03cf3f4222/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.057940 Sep 24 05:08:51.776014 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 406/839] 10.222.0.50 () {60 vars in 1343 bytes} [Sat Sep 24 05:08:51 2022] GET /compute/v2.1/servers/08fb826b-e891-46c4-990d-ca03cf3f4222/os-volume_attachments => generated 197 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 24 05:08:52.487139 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-32cb1860-2fb1-407f-b841-d01552999469 tempest-TestShelveInstance-1085488420 tempest-TestShelveInstance-1085488420-project] Calling method '>' {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:08:52.487748 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.compute.api [None req-32cb1860-2fb1-407f-b841-d01552999469 tempest-TestShelveInstance-1085488420 tempest-TestShelveInstance-1085488420-project] [instance: 60d69c7d-69e4-4b2a-b41c-692867a6e28d] Fetching instance by UUID {{(pid=120594) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:08:52.494087 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-32cb1860-2fb1-407f-b841-d01552999469 tempest-TestShelveInstance-1085488420 tempest-TestShelveInstance-1085488420-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:08:52.494568 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-32cb1860-2fb1-407f-b841-d01552999469 tempest-TestShelveInstance-1085488420 tempest-TestShelveInstance-1085488420-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:08:52.495001 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-32cb1860-2fb1-407f-b841-d01552999469 tempest-TestShelveInstance-1085488420 tempest-TestShelveInstance-1085488420-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:08:52.495683 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-32cb1860-2fb1-407f-b841-d01552999469 tempest-TestShelveInstance-1085488420 tempest-TestShelveInstance-1085488420-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:08:52.496129 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-32cb1860-2fb1-407f-b841-d01552999469 tempest-TestShelveInstance-1085488420 tempest-TestShelveInstance-1085488420-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:08:52.496559 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-32cb1860-2fb1-407f-b841-d01552999469 tempest-TestShelveInstance-1085488420 tempest-TestShelveInstance-1085488420-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:08:52.633477 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.policy [None req-32cb1860-2fb1-407f-b841-d01552999469 tempest-TestShelveInstance-1085488420 tempest-TestShelveInstance-1085488420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8fe3c5c28964b768b2c0023fc62f163', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd3d02b11bdf45fe99687fda3d1078cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:08:52.641229 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [None req-32cb1860-2fb1-407f-b841-d01552999469 tempest-TestShelveInstance-1085488420 tempest-TestShelveInstance-1085488420-project] 10.222.0.50 "GET /compute/v2.1/servers/60d69c7d-69e4-4b2a-b41c-692867a6e28d" status: 200 len: 1512 microversion: 2.1 time: 0.158372 Sep 24 05:08:52.641785 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 434/840] 10.222.0.50 () {58 vars in 1236 bytes} [Sat Sep 24 05:08:52 2022] GET /compute/v2.1/servers/60d69c7d-69e4-4b2a-b41c-692867a6e28d => generated 1512 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 05:08:52.788685 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-b4305a7c-576b-4dc9-b226-d64ef92bb7ee tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Calling method '>' {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:08:52.791512 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.compute.api [None req-b4305a7c-576b-4dc9-b226-d64ef92bb7ee tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] [instance: 08fb826b-e891-46c4-990d-ca03cf3f4222] Fetching instance by UUID {{(pid=120593) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:08:52.799068 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-b4305a7c-576b-4dc9-b226-d64ef92bb7ee tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:08:52.799546 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-b4305a7c-576b-4dc9-b226-d64ef92bb7ee tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:08:52.799977 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-b4305a7c-576b-4dc9-b226-d64ef92bb7ee tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:08:52.800660 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-b4305a7c-576b-4dc9-b226-d64ef92bb7ee tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:08:52.801108 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-b4305a7c-576b-4dc9-b226-d64ef92bb7ee tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:08:52.801556 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-b4305a7c-576b-4dc9-b226-d64ef92bb7ee tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:08:52.829855 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-b4305a7c-576b-4dc9-b226-d64ef92bb7ee tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] 10.222.0.50 "GET /compute/v2.1/servers/08fb826b-e891-46c4-990d-ca03cf3f4222/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.045203 Sep 24 05:08:52.830431 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 407/841] 10.222.0.50 () {60 vars in 1343 bytes} [Sat Sep 24 05:08:52 2022] GET /compute/v2.1/servers/08fb826b-e891-46c4-990d-ca03cf3f4222/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 05:08:52.893839 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-b5ec6628-b57d-4560-8030-69148653527f tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Calling method '>' {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:08:52.894356 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.compute.api [None req-b5ec6628-b57d-4560-8030-69148653527f tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] [instance: 08fb826b-e891-46c4-990d-ca03cf3f4222] Fetching instance by UUID {{(pid=120594) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:08:52.900236 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-b5ec6628-b57d-4560-8030-69148653527f tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:08:52.900706 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-b5ec6628-b57d-4560-8030-69148653527f tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:08:52.901166 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-b5ec6628-b57d-4560-8030-69148653527f tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:08:52.901847 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-b5ec6628-b57d-4560-8030-69148653527f tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:08:52.902314 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-b5ec6628-b57d-4560-8030-69148653527f tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:08:52.902736 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-b5ec6628-b57d-4560-8030-69148653527f tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:08:52.928037 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.compute.api [None req-b5ec6628-b57d-4560-8030-69148653527f tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] [instance: 08fb826b-e891-46c4-990d-ca03cf3f4222] Going to try to terminate instance {{(pid=120594) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 24 05:08:53.004044 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [None req-b5ec6628-b57d-4560-8030-69148653527f tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] 10.222.0.50 "DELETE /compute/v2.1/servers/08fb826b-e891-46c4-990d-ca03cf3f4222" status: 204 len: 0 microversion: 2.20 time: 0.113810 Sep 24 05:08:53.004981 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 435/842] 10.222.0.50 () {60 vars in 1280 bytes} [Sat Sep 24 05:08:52 2022] DELETE /compute/v2.1/servers/08fb826b-e891-46c4-990d-ca03cf3f4222 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 24 05:08:53.013980 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-f4523483-d1ad-40d5-85c7-d77776efe44c tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Calling method '>' {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:08:53.015474 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.compute.api [None req-f4523483-d1ad-40d5-85c7-d77776efe44c tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] [instance: 08fb826b-e891-46c4-990d-ca03cf3f4222] Fetching instance by UUID {{(pid=120593) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:08:53.023724 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-f4523483-d1ad-40d5-85c7-d77776efe44c tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:08:53.024220 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-f4523483-d1ad-40d5-85c7-d77776efe44c tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:08:53.024661 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-f4523483-d1ad-40d5-85c7-d77776efe44c tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:08:53.025371 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-f4523483-d1ad-40d5-85c7-d77776efe44c tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:08:53.025827 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-f4523483-d1ad-40d5-85c7-d77776efe44c tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:08:53.026286 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-f4523483-d1ad-40d5-85c7-d77776efe44c tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:08:53.158256 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-f4523483-d1ad-40d5-85c7-d77776efe44c tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0948754217fc4ff2ba0241fa35feaf90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1aaf20f480a423ea5feca81585aeeed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:08:53.166200 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-f4523483-d1ad-40d5-85c7-d77776efe44c tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0948754217fc4ff2ba0241fa35feaf90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1aaf20f480a423ea5feca81585aeeed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:08:53.167631 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-f4523483-d1ad-40d5-85c7-d77776efe44c tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0948754217fc4ff2ba0241fa35feaf90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1aaf20f480a423ea5feca81585aeeed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:08:53.168772 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-f4523483-d1ad-40d5-85c7-d77776efe44c tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] 10.222.0.50 "GET /compute/v2.1/servers/08fb826b-e891-46c4-990d-ca03cf3f4222" status: 200 len: 1720 microversion: 2.20 time: 0.159374 Sep 24 05:08:53.169325 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 408/843] 10.222.0.50 () {60 vars in 1277 bytes} [Sat Sep 24 05:08:53 2022] GET /compute/v2.1/servers/08fb826b-e891-46c4-990d-ca03cf3f4222 => generated 1720 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 05:08:53.665222 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-debff0de-7b6d-4136-ab3b-c73f453fb9cc tempest-TestShelveInstance-1085488420 tempest-TestShelveInstance-1085488420-project] Calling method '>' {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:08:53.665957 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.compute.api [None req-debff0de-7b6d-4136-ab3b-c73f453fb9cc tempest-TestShelveInstance-1085488420 tempest-TestShelveInstance-1085488420-project] [instance: 60d69c7d-69e4-4b2a-b41c-692867a6e28d] Fetching instance by UUID {{(pid=120594) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:08:53.672921 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-debff0de-7b6d-4136-ab3b-c73f453fb9cc tempest-TestShelveInstance-1085488420 tempest-TestShelveInstance-1085488420-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:08:53.673397 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-debff0de-7b6d-4136-ab3b-c73f453fb9cc tempest-TestShelveInstance-1085488420 tempest-TestShelveInstance-1085488420-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:08:53.673833 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-debff0de-7b6d-4136-ab3b-c73f453fb9cc tempest-TestShelveInstance-1085488420 tempest-TestShelveInstance-1085488420-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:08:53.674541 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-debff0de-7b6d-4136-ab3b-c73f453fb9cc tempest-TestShelveInstance-1085488420 tempest-TestShelveInstance-1085488420-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:08:53.674990 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-debff0de-7b6d-4136-ab3b-c73f453fb9cc tempest-TestShelveInstance-1085488420 tempest-TestShelveInstance-1085488420-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:08:53.675413 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-debff0de-7b6d-4136-ab3b-c73f453fb9cc tempest-TestShelveInstance-1085488420 tempest-TestShelveInstance-1085488420-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:08:53.806202 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.policy [None req-debff0de-7b6d-4136-ab3b-c73f453fb9cc tempest-TestShelveInstance-1085488420 tempest-TestShelveInstance-1085488420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8fe3c5c28964b768b2c0023fc62f163', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd3d02b11bdf45fe99687fda3d1078cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:08:53.815084 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [None req-debff0de-7b6d-4136-ab3b-c73f453fb9cc tempest-TestShelveInstance-1085488420 tempest-TestShelveInstance-1085488420-project] 10.222.0.50 "GET /compute/v2.1/servers/60d69c7d-69e4-4b2a-b41c-692867a6e28d" status: 200 len: 1568 microversion: 2.1 time: 0.153997 Sep 24 05:08:53.815658 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 436/844] 10.222.0.50 () {58 vars in 1236 bytes} [Sat Sep 24 05:08:53 2022] GET /compute/v2.1/servers/60d69c7d-69e4-4b2a-b41c-692867a6e28d => generated 1568 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 05:08:54.194295 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-2f3d2c2a-0172-4e94-8d54-194be53d263b tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Calling method '>' {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:08:54.194944 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.compute.api [None req-2f3d2c2a-0172-4e94-8d54-194be53d263b tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] [instance: 08fb826b-e891-46c4-990d-ca03cf3f4222] Fetching instance by UUID {{(pid=120593) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:08:54.201313 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-2f3d2c2a-0172-4e94-8d54-194be53d263b tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:08:54.201789 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-2f3d2c2a-0172-4e94-8d54-194be53d263b tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:08:54.202244 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-2f3d2c2a-0172-4e94-8d54-194be53d263b tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:08:54.202922 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-2f3d2c2a-0172-4e94-8d54-194be53d263b tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:08:54.203963 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-2f3d2c2a-0172-4e94-8d54-194be53d263b tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:08:54.204400 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-2f3d2c2a-0172-4e94-8d54-194be53d263b tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:08:54.333303 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-2f3d2c2a-0172-4e94-8d54-194be53d263b tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0948754217fc4ff2ba0241fa35feaf90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1aaf20f480a423ea5feca81585aeeed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:08:54.341364 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-2f3d2c2a-0172-4e94-8d54-194be53d263b tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0948754217fc4ff2ba0241fa35feaf90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1aaf20f480a423ea5feca81585aeeed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:08:54.342821 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-2f3d2c2a-0172-4e94-8d54-194be53d263b tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0948754217fc4ff2ba0241fa35feaf90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1aaf20f480a423ea5feca81585aeeed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:08:54.344527 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-2f3d2c2a-0172-4e94-8d54-194be53d263b tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] 10.222.0.50 "GET /compute/v2.1/servers/08fb826b-e891-46c4-990d-ca03cf3f4222" status: 200 len: 1720 microversion: 2.20 time: 0.153988 Sep 24 05:08:54.345077 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 409/845] 10.222.0.50 () {60 vars in 1277 bytes} [Sat Sep 24 05:08:54 2022] GET /compute/v2.1/servers/08fb826b-e891-46c4-990d-ca03cf3f4222 => generated 1720 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 05:08:54.838176 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-07d32c97-f619-4402-b3b3-d58646654131 tempest-TestShelveInstance-1085488420 tempest-TestShelveInstance-1085488420-project] Calling method '>' {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:08:54.838783 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.compute.api [None req-07d32c97-f619-4402-b3b3-d58646654131 tempest-TestShelveInstance-1085488420 tempest-TestShelveInstance-1085488420-project] [instance: 60d69c7d-69e4-4b2a-b41c-692867a6e28d] Fetching instance by UUID {{(pid=120594) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:08:54.845777 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-07d32c97-f619-4402-b3b3-d58646654131 tempest-TestShelveInstance-1085488420 tempest-TestShelveInstance-1085488420-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:08:54.846279 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-07d32c97-f619-4402-b3b3-d58646654131 tempest-TestShelveInstance-1085488420 tempest-TestShelveInstance-1085488420-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:08:54.846705 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-07d32c97-f619-4402-b3b3-d58646654131 tempest-TestShelveInstance-1085488420 tempest-TestShelveInstance-1085488420-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:08:54.847382 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-07d32c97-f619-4402-b3b3-d58646654131 tempest-TestShelveInstance-1085488420 tempest-TestShelveInstance-1085488420-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:08:54.848061 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-07d32c97-f619-4402-b3b3-d58646654131 tempest-TestShelveInstance-1085488420 tempest-TestShelveInstance-1085488420-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:08:54.848308 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-07d32c97-f619-4402-b3b3-d58646654131 tempest-TestShelveInstance-1085488420 tempest-TestShelveInstance-1085488420-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:08:54.979937 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.policy [None req-07d32c97-f619-4402-b3b3-d58646654131 tempest-TestShelveInstance-1085488420 tempest-TestShelveInstance-1085488420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8fe3c5c28964b768b2c0023fc62f163', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd3d02b11bdf45fe99687fda3d1078cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:08:54.988119 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [None req-07d32c97-f619-4402-b3b3-d58646654131 tempest-TestShelveInstance-1085488420 tempest-TestShelveInstance-1085488420-project] 10.222.0.50 "GET /compute/v2.1/servers/60d69c7d-69e4-4b2a-b41c-692867a6e28d" status: 200 len: 1568 microversion: 2.1 time: 0.153789 Sep 24 05:08:54.988675 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 437/846] 10.222.0.50 () {58 vars in 1236 bytes} [Sat Sep 24 05:08:54 2022] GET /compute/v2.1/servers/60d69c7d-69e4-4b2a-b41c-692867a6e28d => generated 1568 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 05:08:55.370018 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-d94472fd-bd07-45eb-810c-7c9ec205f029 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Calling method '>' {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:08:55.370611 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.compute.api [None req-d94472fd-bd07-45eb-810c-7c9ec205f029 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] [instance: 08fb826b-e891-46c4-990d-ca03cf3f4222] Fetching instance by UUID {{(pid=120593) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:08:55.376889 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-d94472fd-bd07-45eb-810c-7c9ec205f029 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:08:55.377357 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-d94472fd-bd07-45eb-810c-7c9ec205f029 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:08:55.377785 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-d94472fd-bd07-45eb-810c-7c9ec205f029 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:08:55.378498 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-d94472fd-bd07-45eb-810c-7c9ec205f029 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:08:55.378942 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-d94472fd-bd07-45eb-810c-7c9ec205f029 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:08:55.379362 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-d94472fd-bd07-45eb-810c-7c9ec205f029 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:08:55.514764 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-d94472fd-bd07-45eb-810c-7c9ec205f029 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0948754217fc4ff2ba0241fa35feaf90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1aaf20f480a423ea5feca81585aeeed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:08:55.523520 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-d94472fd-bd07-45eb-810c-7c9ec205f029 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0948754217fc4ff2ba0241fa35feaf90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1aaf20f480a423ea5feca81585aeeed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:08:55.524969 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-d94472fd-bd07-45eb-810c-7c9ec205f029 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0948754217fc4ff2ba0241fa35feaf90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1aaf20f480a423ea5feca81585aeeed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:08:55.526179 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-d94472fd-bd07-45eb-810c-7c9ec205f029 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] 10.222.0.50 "GET /compute/v2.1/servers/08fb826b-e891-46c4-990d-ca03cf3f4222" status: 200 len: 1720 microversion: 2.20 time: 0.160067 Sep 24 05:08:55.526742 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 410/847] 10.222.0.50 () {60 vars in 1277 bytes} [Sat Sep 24 05:08:55 2022] GET /compute/v2.1/servers/08fb826b-e891-46c4-990d-ca03cf3f4222 => generated 1720 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 05:08:56.011752 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-0fd77daf-4a8a-4771-820f-4354995477f8 tempest-TestShelveInstance-1085488420 tempest-TestShelveInstance-1085488420-project] Calling method '>' {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:08:56.012531 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.compute.api [None req-0fd77daf-4a8a-4771-820f-4354995477f8 tempest-TestShelveInstance-1085488420 tempest-TestShelveInstance-1085488420-project] [instance: 60d69c7d-69e4-4b2a-b41c-692867a6e28d] Fetching instance by UUID {{(pid=120594) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:08:56.019698 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-0fd77daf-4a8a-4771-820f-4354995477f8 tempest-TestShelveInstance-1085488420 tempest-TestShelveInstance-1085488420-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:08:56.020731 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-0fd77daf-4a8a-4771-820f-4354995477f8 tempest-TestShelveInstance-1085488420 tempest-TestShelveInstance-1085488420-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:08:56.021170 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-0fd77daf-4a8a-4771-820f-4354995477f8 tempest-TestShelveInstance-1085488420 tempest-TestShelveInstance-1085488420-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:08:56.021869 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-0fd77daf-4a8a-4771-820f-4354995477f8 tempest-TestShelveInstance-1085488420 tempest-TestShelveInstance-1085488420-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:08:56.022348 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-0fd77daf-4a8a-4771-820f-4354995477f8 tempest-TestShelveInstance-1085488420 tempest-TestShelveInstance-1085488420-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:08:56.022769 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-0fd77daf-4a8a-4771-820f-4354995477f8 tempest-TestShelveInstance-1085488420 tempest-TestShelveInstance-1085488420-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:08:56.156594 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.policy [None req-0fd77daf-4a8a-4771-820f-4354995477f8 tempest-TestShelveInstance-1085488420 tempest-TestShelveInstance-1085488420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8fe3c5c28964b768b2c0023fc62f163', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd3d02b11bdf45fe99687fda3d1078cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:08:56.164353 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [None req-0fd77daf-4a8a-4771-820f-4354995477f8 tempest-TestShelveInstance-1085488420 tempest-TestShelveInstance-1085488420-project] 10.222.0.50 "GET /compute/v2.1/servers/60d69c7d-69e4-4b2a-b41c-692867a6e28d" status: 200 len: 1568 microversion: 2.1 time: 0.156616 Sep 24 05:08:56.164931 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 438/848] 10.222.0.50 () {58 vars in 1236 bytes} [Sat Sep 24 05:08:56 2022] GET /compute/v2.1/servers/60d69c7d-69e4-4b2a-b41c-692867a6e28d => generated 1568 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 05:08:56.554071 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-92a4acea-81e2-413d-a750-cc80c56bd3b4 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Calling method '>' {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:08:56.554731 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.compute.api [None req-92a4acea-81e2-413d-a750-cc80c56bd3b4 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] [instance: 08fb826b-e891-46c4-990d-ca03cf3f4222] Fetching instance by UUID {{(pid=120593) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:08:56.562491 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-92a4acea-81e2-413d-a750-cc80c56bd3b4 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:08:56.563040 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-92a4acea-81e2-413d-a750-cc80c56bd3b4 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:08:56.563484 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-92a4acea-81e2-413d-a750-cc80c56bd3b4 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:08:56.564207 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-92a4acea-81e2-413d-a750-cc80c56bd3b4 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:08:56.564695 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-92a4acea-81e2-413d-a750-cc80c56bd3b4 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:08:56.565310 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-92a4acea-81e2-413d-a750-cc80c56bd3b4 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:08:56.794800 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-92a4acea-81e2-413d-a750-cc80c56bd3b4 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0948754217fc4ff2ba0241fa35feaf90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1aaf20f480a423ea5feca81585aeeed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:08:56.805905 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-92a4acea-81e2-413d-a750-cc80c56bd3b4 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0948754217fc4ff2ba0241fa35feaf90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1aaf20f480a423ea5feca81585aeeed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:08:56.807348 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-92a4acea-81e2-413d-a750-cc80c56bd3b4 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0948754217fc4ff2ba0241fa35feaf90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1aaf20f480a423ea5feca81585aeeed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:08:56.808496 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-92a4acea-81e2-413d-a750-cc80c56bd3b4 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] 10.222.0.50 "GET /compute/v2.1/servers/08fb826b-e891-46c4-990d-ca03cf3f4222" status: 200 len: 1654 microversion: 2.20 time: 0.259760 Sep 24 05:08:56.809241 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 411/849] 10.222.0.50 () {60 vars in 1277 bytes} [Sat Sep 24 05:08:56 2022] GET /compute/v2.1/servers/08fb826b-e891-46c4-990d-ca03cf3f4222 => generated 1654 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 05:08:56.951159 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [req-d21dce87-eac7-46b9-b1fb-ba65ae3785d3 req-68390b30-73cc-4d8b-99b9-44de480c31e3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "08fb826b-e891-46c4-990d-ca03cf3f4222", "name": "network-vif-deleted", "tag": "4de1eabe-932e-4cda-804d-49eeff37c34c"}]} {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 05:08:56.961437 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [req-d21dce87-eac7-46b9-b1fb-ba65ae3785d3 req-68390b30-73cc-4d8b-99b9-44de480c31e3 service nova] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:08:56.962186 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [req-d21dce87-eac7-46b9-b1fb-ba65ae3785d3 req-68390b30-73cc-4d8b-99b9-44de480c31e3 service nova] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:08:56.962653 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [req-d21dce87-eac7-46b9-b1fb-ba65ae3785d3 req-68390b30-73cc-4d8b-99b9-44de480c31e3 service nova] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:08:56.974534 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: INFO nova.api.openstack.compute.server_external_events [req-d21dce87-eac7-46b9-b1fb-ba65ae3785d3 req-68390b30-73cc-4d8b-99b9-44de480c31e3 service nova] Creating event network-vif-deleted:4de1eabe-932e-4cda-804d-49eeff37c34c for instance 08fb826b-e891-46c4-990d-ca03cf3f4222 on hv-cinder-85918 Sep 24 05:08:56.979729 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [req-d21dce87-eac7-46b9-b1fb-ba65ae3785d3 req-68390b30-73cc-4d8b-99b9-44de480c31e3 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032215 Sep 24 05:08:56.980344 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 439/850] 10.222.0.50 () {64 vars in 1317 bytes} [Sat Sep 24 05:08:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 05:08:57.188145 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-408364fd-fc4a-4c72-9d0e-f942b36b72bf tempest-TestShelveInstance-1085488420 tempest-TestShelveInstance-1085488420-project] Calling method '>' {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:08:57.188789 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.compute.api [None req-408364fd-fc4a-4c72-9d0e-f942b36b72bf tempest-TestShelveInstance-1085488420 tempest-TestShelveInstance-1085488420-project] [instance: 60d69c7d-69e4-4b2a-b41c-692867a6e28d] Fetching instance by UUID {{(pid=120593) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:08:57.194943 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-408364fd-fc4a-4c72-9d0e-f942b36b72bf tempest-TestShelveInstance-1085488420 tempest-TestShelveInstance-1085488420-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:08:57.195435 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-408364fd-fc4a-4c72-9d0e-f942b36b72bf tempest-TestShelveInstance-1085488420 tempest-TestShelveInstance-1085488420-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:08:57.195876 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-408364fd-fc4a-4c72-9d0e-f942b36b72bf tempest-TestShelveInstance-1085488420 tempest-TestShelveInstance-1085488420-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:08:57.196587 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-408364fd-fc4a-4c72-9d0e-f942b36b72bf tempest-TestShelveInstance-1085488420 tempest-TestShelveInstance-1085488420-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:08:57.197044 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-408364fd-fc4a-4c72-9d0e-f942b36b72bf tempest-TestShelveInstance-1085488420 tempest-TestShelveInstance-1085488420-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:08:57.197475 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-408364fd-fc4a-4c72-9d0e-f942b36b72bf tempest-TestShelveInstance-1085488420 tempest-TestShelveInstance-1085488420-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:08:57.332920 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-408364fd-fc4a-4c72-9d0e-f942b36b72bf tempest-TestShelveInstance-1085488420 tempest-TestShelveInstance-1085488420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8fe3c5c28964b768b2c0023fc62f163', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd3d02b11bdf45fe99687fda3d1078cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:08:57.342238 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-408364fd-fc4a-4c72-9d0e-f942b36b72bf tempest-TestShelveInstance-1085488420 tempest-TestShelveInstance-1085488420-project] 10.222.0.50 "GET /compute/v2.1/servers/60d69c7d-69e4-4b2a-b41c-692867a6e28d" status: 200 len: 1568 microversion: 2.1 time: 0.157962 Sep 24 05:08:57.343008 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 412/851] 10.222.0.50 () {58 vars in 1236 bytes} [Sat Sep 24 05:08:57 2022] GET /compute/v2.1/servers/60d69c7d-69e4-4b2a-b41c-692867a6e28d => generated 1568 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 05:08:57.835054 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-3a409cb6-10c1-4f05-bffb-6110d9fa3193 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Calling method '>' {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:08:57.836954 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.compute.api [None req-3a409cb6-10c1-4f05-bffb-6110d9fa3193 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] [instance: 08fb826b-e891-46c4-990d-ca03cf3f4222] Fetching instance by UUID {{(pid=120594) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:08:57.842609 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-3a409cb6-10c1-4f05-bffb-6110d9fa3193 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:08:57.842987 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-3a409cb6-10c1-4f05-bffb-6110d9fa3193 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:08:57.843615 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-3a409cb6-10c1-4f05-bffb-6110d9fa3193 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:08:57.844484 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-3a409cb6-10c1-4f05-bffb-6110d9fa3193 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:08:57.845269 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-3a409cb6-10c1-4f05-bffb-6110d9fa3193 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:08:57.845725 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-3a409cb6-10c1-4f05-bffb-6110d9fa3193 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:08:57.901602 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-3a409cb6-10c1-4f05-bffb-6110d9fa3193 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:08:57.902185 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-3a409cb6-10c1-4f05-bffb-6110d9fa3193 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:08:57.902715 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-3a409cb6-10c1-4f05-bffb-6110d9fa3193 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:08:57.903170 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.objects.instance [None req-3a409cb6-10c1-4f05-bffb-6110d9fa3193 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Lazy-loading 'fault' on Instance uuid 08fb826b-e891-46c4-990d-ca03cf3f4222 {{(pid=120594) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 24 05:08:57.950959 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.policy [None req-3a409cb6-10c1-4f05-bffb-6110d9fa3193 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0948754217fc4ff2ba0241fa35feaf90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1aaf20f480a423ea5feca81585aeeed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:08:57.960378 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.policy [None req-3a409cb6-10c1-4f05-bffb-6110d9fa3193 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0948754217fc4ff2ba0241fa35feaf90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1aaf20f480a423ea5feca81585aeeed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:08:57.961831 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.policy [None req-3a409cb6-10c1-4f05-bffb-6110d9fa3193 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0948754217fc4ff2ba0241fa35feaf90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1aaf20f480a423ea5feca81585aeeed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:08:57.963034 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [None req-3a409cb6-10c1-4f05-bffb-6110d9fa3193 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] 10.222.0.50 "GET /compute/v2.1/servers/08fb826b-e891-46c4-990d-ca03cf3f4222" status: 200 len: 1370 microversion: 2.20 time: 0.133998 Sep 24 05:08:57.969113 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 440/852] 10.222.0.50 () {60 vars in 1277 bytes} [Sat Sep 24 05:08:57 2022] GET /compute/v2.1/servers/08fb826b-e891-46c4-990d-ca03cf3f4222 => generated 1370 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 05:08:58.365078 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-06196342-14e9-4dc6-8154-4d77f801678a tempest-TestShelveInstance-1085488420 tempest-TestShelveInstance-1085488420-project] Calling method '>' {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:08:58.365817 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.compute.api [None req-06196342-14e9-4dc6-8154-4d77f801678a tempest-TestShelveInstance-1085488420 tempest-TestShelveInstance-1085488420-project] [instance: 60d69c7d-69e4-4b2a-b41c-692867a6e28d] Fetching instance by UUID {{(pid=120593) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:08:58.376464 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-06196342-14e9-4dc6-8154-4d77f801678a tempest-TestShelveInstance-1085488420 tempest-TestShelveInstance-1085488420-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:08:58.377922 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-06196342-14e9-4dc6-8154-4d77f801678a tempest-TestShelveInstance-1085488420 tempest-TestShelveInstance-1085488420-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:08:58.383400 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-06196342-14e9-4dc6-8154-4d77f801678a tempest-TestShelveInstance-1085488420 tempest-TestShelveInstance-1085488420-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:08:58.385615 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-06196342-14e9-4dc6-8154-4d77f801678a tempest-TestShelveInstance-1085488420 tempest-TestShelveInstance-1085488420-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:08:58.386968 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-06196342-14e9-4dc6-8154-4d77f801678a tempest-TestShelveInstance-1085488420 tempest-TestShelveInstance-1085488420-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:08:58.387754 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-06196342-14e9-4dc6-8154-4d77f801678a tempest-TestShelveInstance-1085488420 tempest-TestShelveInstance-1085488420-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:08:58.555788 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-06196342-14e9-4dc6-8154-4d77f801678a tempest-TestShelveInstance-1085488420 tempest-TestShelveInstance-1085488420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8fe3c5c28964b768b2c0023fc62f163', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd3d02b11bdf45fe99687fda3d1078cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:08:58.563847 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-06196342-14e9-4dc6-8154-4d77f801678a tempest-TestShelveInstance-1085488420 tempest-TestShelveInstance-1085488420-project] 10.222.0.50 "GET /compute/v2.1/servers/60d69c7d-69e4-4b2a-b41c-692867a6e28d" status: 200 len: 1568 microversion: 2.1 time: 0.203053 Sep 24 05:08:58.564775 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 413/853] 10.222.0.50 () {58 vars in 1236 bytes} [Sat Sep 24 05:08:58 2022] GET /compute/v2.1/servers/60d69c7d-69e4-4b2a-b41c-692867a6e28d => generated 1568 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 05:08:58.989726 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-25267d82-ba8a-4db1-a925-5549d2421205 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Calling method '>' {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:08:58.990351 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.compute.api [None req-25267d82-ba8a-4db1-a925-5549d2421205 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] [instance: 08fb826b-e891-46c4-990d-ca03cf3f4222] Fetching instance by UUID {{(pid=120594) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:08:58.996797 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-25267d82-ba8a-4db1-a925-5549d2421205 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:08:58.997271 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-25267d82-ba8a-4db1-a925-5549d2421205 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:08:58.997700 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-25267d82-ba8a-4db1-a925-5549d2421205 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:08:58.998432 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-25267d82-ba8a-4db1-a925-5549d2421205 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:08:58.998875 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-25267d82-ba8a-4db1-a925-5549d2421205 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:08:58.999288 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-25267d82-ba8a-4db1-a925-5549d2421205 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:08:59.012628 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: INFO nova.api.openstack.wsgi [None req-25267d82-ba8a-4db1-a925-5549d2421205 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] HTTP exception thrown: Instance 08fb826b-e891-46c4-990d-ca03cf3f4222 could not be found. Sep 24 05:08:59.014281 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-25267d82-ba8a-4db1-a925-5549d2421205 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Request method failure captured: Sep 24 05:08:59.014281 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: request: GET /compute/v2.1/servers/08fb826b-e891-46c4-990d-ca03cf3f4222 HTTP/1.1 Sep 24 05:08:59.014281 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: Accept: application/json Sep 24 05:08:59.014281 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: Accept-Encoding: identity Sep 24 05:08:59.014281 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: Connection: close Sep 24 05:08:59.014281 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: Content-Length: 0 Sep 24 05:08:59.014281 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: Content-Type: application/json Sep 24 05:08:59.014281 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: Host: 10.222.0.50 Sep 24 05:08:59.014281 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: Openstack-System-Scope: None Sep 24 05:08:59.014281 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: User-Agent: python-urllib3/1.26.12 Sep 24 05:08:59.014281 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: X-Auth-Token: gAAAAABjLo8CSqMBxyhNVmFfsk1NTNzkp3_H84-yvN05Ky7OFnK0t-nxnJBueA__huZ344wnh8Vgbhzz-9W-5uWxnI6OuOG1n5FI0v0-wZbKR5_XkTPKM_bg5qB-KOvDkCr7huR5h5agVEcNYY1eBri4A8emzuD-hDI9bCM3DOTdHzYEghA5EZ8 Sep 24 05:08:59.014281 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: X-Domain-Id: None Sep 24 05:08:59.014281 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: X-Domain-Name: None Sep 24 05:08:59.014281 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: X-Identity-Status: Confirmed Sep 24 05:08:59.014281 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: X-Is-Admin-Project: True Sep 24 05:08:59.014281 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: X-Openstack-Nova-Api-Version: 2.20 Sep 24 05:08:59.014281 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: X-Project-Domain-Id: default Sep 24 05:08:59.014281 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: X-Project-Domain-Name: Default Sep 24 05:08:59.014281 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: X-Project-Id: c1aaf20f480a423ea5feca81585aeeed Sep 24 05:08:59.014281 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1434580538 Sep 24 05:08:59.014281 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: X-Role: member,reader Sep 24 05:08:59.014281 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: X-Roles: member,reader Sep 24 05:08:59.016001 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/c1aaf20f480a423ea5feca81585aeeed"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/c1aaf20f480a423ea5feca81585aeeed"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/c1aaf20f480a423ea5feca81585aeeed"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.50:8080", "publicURL": "http://10.222.0.50:8080/v1/AUTH_c1aaf20f480a423ea5feca81585aeeed"}]}] Sep 24 05:08:59.016001 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1434580538 Sep 24 05:08:59.016001 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: X-Tenant-Id: c1aaf20f480a423ea5feca81585aeeed Sep 24 05:08:59.016001 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1434580538 Sep 24 05:08:59.016001 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: X-User: tempest-AttachVolumeShelveTestJSON-1434580538-project Sep 24 05:08:59.016001 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: X-User-Domain-Id: default Sep 24 05:08:59.016001 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: X-User-Domain-Name: Default Sep 24 05:08:59.016001 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: X-User-Id: 0948754217fc4ff2ba0241fa35feaf90 Sep 24 05:08:59.016001 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1434580538-project Sep 24 05:08:59.016001 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: method: > Sep 24 05:08:59.016001 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: exception: Instance 08fb826b-e891-46c4-990d-ca03cf3f4222 could not be found. Sep 24 05:08:59.016001 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: action_args: {'id': '08fb826b-e891-46c4-990d-ca03cf3f4222'} Sep 24 05:08:59.016952 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 24 05:08:59.016952 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 05:08:59.016952 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 24 05:08:59.016952 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 24 05:08:59.016952 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 24 05:08:59.016952 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 24 05:08:59.016952 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 24 05:08:59.016952 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 24 05:08:59.016952 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 24 05:08:59.016952 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 24 05:08:59.016952 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 08fb826b-e891-46c4-990d-ca03cf3f4222 could not be found. Sep 24 05:08:59.016952 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi Sep 24 05:08:59.016952 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 05:08:59.016952 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi Sep 24 05:08:59.016952 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 05:08:59.016952 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 05:08:59.016952 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 05:08:59.016952 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 24 05:08:59.016952 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 24 05:08:59.016952 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 24 05:08:59.018553 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 24 05:08:59.018553 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 24 05:08:59.018553 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 24 05:08:59.018553 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 24 05:08:59.018553 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 24 05:08:59.018553 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 24 05:08:59.018553 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 24 05:08:59.018553 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 08fb826b-e891-46c4-990d-ca03cf3f4222 could not be found. Sep 24 05:08:59.018553 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi Sep 24 05:08:59.018553 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 05:08:59.018553 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi Sep 24 05:08:59.018553 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 05:08:59.018553 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 05:08:59.018553 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 05:08:59.018553 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 24 05:08:59.018553 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 24 05:08:59.018553 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 08fb826b-e891-46c4-990d-ca03cf3f4222 could not be found. Sep 24 05:08:59.018553 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi Sep 24 05:08:59.019934 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-25267d82-ba8a-4db1-a925-5549d2421205 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Returning 404 to user: Instance 08fb826b-e891-46c4-990d-ca03cf3f4222 could not be found. {{(pid=120594) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 24 05:08:59.019934 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [None req-25267d82-ba8a-4db1-a925-5549d2421205 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] 10.222.0.50 "GET /compute/v2.1/servers/08fb826b-e891-46c4-990d-ca03cf3f4222" status: 404 len: 111 microversion: 2.20 time: 0.030586 Sep 24 05:08:59.019934 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 441/854] 10.222.0.50 () {60 vars in 1277 bytes} [Sat Sep 24 05:08:58 2022] GET /compute/v2.1/servers/08fb826b-e891-46c4-990d-ca03cf3f4222 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 24 05:08:59.024751 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-8ae26a3d-f811-48d9-ab8a-d0bf2c34f023 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Calling method '.version_select at 0x7f795055b280>' {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:08:59.045643 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-8ae26a3d-f811-48d9-ab8a-d0bf2c34f023 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] 10.222.0.50 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-367803558" status: 204 len: 0 microversion: 2.20 time: 0.024753 Sep 24 05:08:59.046238 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 414/855] 10.222.0.50 () {60 vars in 1259 bytes} [Sat Sep 24 05:08:59 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-367803558 => generated 0 bytes in 26 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Sep 24 05:08:59.587777 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-c6d9bab5-63fd-405d-be78-6c40f93775e4 tempest-TestShelveInstance-1085488420 tempest-TestShelveInstance-1085488420-project] Calling method '>' {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:08:59.588382 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.compute.api [None req-c6d9bab5-63fd-405d-be78-6c40f93775e4 tempest-TestShelveInstance-1085488420 tempest-TestShelveInstance-1085488420-project] [instance: 60d69c7d-69e4-4b2a-b41c-692867a6e28d] Fetching instance by UUID {{(pid=120594) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:08:59.595172 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-c6d9bab5-63fd-405d-be78-6c40f93775e4 tempest-TestShelveInstance-1085488420 tempest-TestShelveInstance-1085488420-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:08:59.595657 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-c6d9bab5-63fd-405d-be78-6c40f93775e4 tempest-TestShelveInstance-1085488420 tempest-TestShelveInstance-1085488420-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:08:59.596117 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-c6d9bab5-63fd-405d-be78-6c40f93775e4 tempest-TestShelveInstance-1085488420 tempest-TestShelveInstance-1085488420-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:08:59.596821 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-c6d9bab5-63fd-405d-be78-6c40f93775e4 tempest-TestShelveInstance-1085488420 tempest-TestShelveInstance-1085488420-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:08:59.597270 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-c6d9bab5-63fd-405d-be78-6c40f93775e4 tempest-TestShelveInstance-1085488420 tempest-TestShelveInstance-1085488420-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:08:59.597729 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-c6d9bab5-63fd-405d-be78-6c40f93775e4 tempest-TestShelveInstance-1085488420 tempest-TestShelveInstance-1085488420-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:08:59.690749 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-14fcadf1-dc2e-4c58-a6eb-fbbb86eb4015 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Action: 'create', calling method: .version_select at 0x7f79505d5430>, body: {"keypair": {"name": "tempest-keypair-627260924", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKjFDcza456HzKLVfs16uEPIUqAad4rkWeaGYaXukwW+hr1AF9WTqSowr895xpfu8tv1FBYbPN9JRJ7/kru6WVg6RgMCh1xawzzei7/2rY8fNn8mgRnZvgZVgcIe8d1rTg=="}} {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 05:08:59.706915 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.quota [None req-14fcadf1-dc2e-4c58-a6eb-fbbb86eb4015 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Getting quotas for project c1aaf20f480a423ea5feca81585aeeed. Resources: {'key_pairs'} {{(pid=120593) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 24 05:08:59.710822 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.quota [None req-14fcadf1-dc2e-4c58-a6eb-fbbb86eb4015 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Getting quotas for user 0948754217fc4ff2ba0241fa35feaf90 and project c1aaf20f480a423ea5feca81585aeeed. Resources: {'key_pairs'} {{(pid=120593) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 24 05:08:59.732273 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.policy [None req-c6d9bab5-63fd-405d-be78-6c40f93775e4 tempest-TestShelveInstance-1085488420 tempest-TestShelveInstance-1085488420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8fe3c5c28964b768b2c0023fc62f163', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd3d02b11bdf45fe99687fda3d1078cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:08:59.733118 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-14fcadf1-dc2e-4c58-a6eb-fbbb86eb4015 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] 10.222.0.50 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.20 time: 0.047204 Sep 24 05:08:59.733719 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 415/856] 10.222.0.50 () {62 vars in 1200 bytes} [Sat Sep 24 05:08:59 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 48 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Sep 24 05:08:59.740429 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [None req-c6d9bab5-63fd-405d-be78-6c40f93775e4 tempest-TestShelveInstance-1085488420 tempest-TestShelveInstance-1085488420-project] 10.222.0.50 "GET /compute/v2.1/servers/60d69c7d-69e4-4b2a-b41c-692867a6e28d" status: 200 len: 1568 microversion: 2.1 time: 0.156696 Sep 24 05:08:59.741071 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 442/857] 10.222.0.50 () {58 vars in 1236 bytes} [Sat Sep 24 05:08:59 2022] GET /compute/v2.1/servers/60d69c7d-69e4-4b2a-b41c-692867a6e28d => generated 1568 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 05:09:00.119496 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-cc7c5043-2e06-403f-971b-e5ffe32ff732 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Calling method '>' {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:09:00.119992 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.compute.api [None req-cc7c5043-2e06-403f-971b-e5ffe32ff732 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] [instance: 34b2ef46-4969-469b-adcd-22abf7c4d6df] Fetching instance by UUID {{(pid=120593) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:09:00.125783 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-cc7c5043-2e06-403f-971b-e5ffe32ff732 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:09:00.126301 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-cc7c5043-2e06-403f-971b-e5ffe32ff732 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:09:00.126740 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-cc7c5043-2e06-403f-971b-e5ffe32ff732 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:09:00.127991 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-cc7c5043-2e06-403f-971b-e5ffe32ff732 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:09:00.128445 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-cc7c5043-2e06-403f-971b-e5ffe32ff732 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:09:00.128871 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-cc7c5043-2e06-403f-971b-e5ffe32ff732 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:09:00.151934 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-cc7c5043-2e06-403f-971b-e5ffe32ff732 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] 10.222.0.50 "GET /compute/v2.1/servers/34b2ef46-4969-469b-adcd-22abf7c4d6df/ips" status: 200 len: 151 microversion: 2.1 time: 0.036374 Sep 24 05:09:00.152691 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 416/858] 10.222.0.50 () {58 vars in 1248 bytes} [Sat Sep 24 05:09:00 2022] GET /compute/v2.1/servers/34b2ef46-4969-469b-adcd-22abf7c4d6df/ips => generated 151 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 05:09:00.166286 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-82990d24-91b0-46a2-a59a-6e8d1c49d03d tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "22a35095-46cf-4ed9-9de3-4e3c7adf3ef6"}} {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 05:09:00.168892 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.compute.api [None req-82990d24-91b0-46a2-a59a-6e8d1c49d03d tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] [instance: 34b2ef46-4969-469b-adcd-22abf7c4d6df] Fetching instance by UUID {{(pid=120594) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:09:00.175738 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-82990d24-91b0-46a2-a59a-6e8d1c49d03d tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:09:00.176424 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-82990d24-91b0-46a2-a59a-6e8d1c49d03d tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:09:00.176865 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-82990d24-91b0-46a2-a59a-6e8d1c49d03d tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:09:00.177548 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-82990d24-91b0-46a2-a59a-6e8d1c49d03d tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:09:00.178025 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-82990d24-91b0-46a2-a59a-6e8d1c49d03d tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:09:00.178435 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-82990d24-91b0-46a2-a59a-6e8d1c49d03d tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:09:00.259035 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: INFO nova.api.openstack.wsgi [None req-82990d24-91b0-46a2-a59a-6e8d1c49d03d tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] HTTP exception thrown: Invalid volume: volume 22a35095-46cf-4ed9-9de3-4e3c7adf3ef6 is already attached to instances: 201433d5-db4e-4e57-a800-42fe5cfc95ca Sep 24 05:09:00.260630 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-82990d24-91b0-46a2-a59a-6e8d1c49d03d tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Request method failure captured: Sep 24 05:09:00.260630 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: request: POST /compute/v2.1/servers/34b2ef46-4969-469b-adcd-22abf7c4d6df/os-volume_attachments HTTP/1.1 Sep 24 05:09:00.260630 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: Accept: application/json Sep 24 05:09:00.260630 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: Accept-Encoding: identity Sep 24 05:09:00.260630 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: Connection: close Sep 24 05:09:00.260630 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: Content-Length: 74 Sep 24 05:09:00.260630 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: Content-Type: application/json Sep 24 05:09:00.260630 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: Host: 10.222.0.50 Sep 24 05:09:00.260630 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: Openstack-System-Scope: None Sep 24 05:09:00.260630 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: User-Agent: python-urllib3/1.26.12 Sep 24 05:09:00.260630 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: X-Auth-Token: gAAAAABjLo8KJCPvHtvWyKaOwXAaewqfKJp-c56tHrqhjOY7vtWfARY07rjbw-W3QgTA2kDEaQgMq3ex8QYwhqyDv3WoWsnpjVPsFiqcb7HeDBvc5PhwgKBF3RB3Cu-UrcKVmBtV6eiqI3YpZ_J_-BmGo2bP4YmrVUCEd9XZC45eF-x5INM7y8Q Sep 24 05:09:00.260630 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: X-Domain-Id: None Sep 24 05:09:00.260630 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: X-Domain-Name: None Sep 24 05:09:00.260630 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: X-Identity-Status: Confirmed Sep 24 05:09:00.260630 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: X-Is-Admin-Project: True Sep 24 05:09:00.260630 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: X-Project-Domain-Id: default Sep 24 05:09:00.260630 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: X-Project-Domain-Name: Default Sep 24 05:09:00.260630 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: X-Project-Id: 87d5229e39fe4817b5187068d8acecc7 Sep 24 05:09:00.260630 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: X-Project-Name: tempest-AttachVolumeNegativeTest-993993432 Sep 24 05:09:00.260630 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: X-Role: member,reader Sep 24 05:09:00.260630 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: X-Roles: member,reader Sep 24 05:09:00.262022 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/87d5229e39fe4817b5187068d8acecc7"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/87d5229e39fe4817b5187068d8acecc7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/87d5229e39fe4817b5187068d8acecc7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.50:8080", "publicURL": "http://10.222.0.50:8080/v1/AUTH_87d5229e39fe4817b5187068d8acecc7"}]}] Sep 24 05:09:00.262022 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: X-Tenant: tempest-AttachVolumeNegativeTest-993993432 Sep 24 05:09:00.262022 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: X-Tenant-Id: 87d5229e39fe4817b5187068d8acecc7 Sep 24 05:09:00.262022 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-993993432 Sep 24 05:09:00.262022 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: X-User: tempest-AttachVolumeNegativeTest-993993432-project Sep 24 05:09:00.262022 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: X-User-Domain-Id: default Sep 24 05:09:00.262022 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: X-User-Domain-Name: Default Sep 24 05:09:00.262022 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: X-User-Id: 74a8cc19ab204424ab23c62915ac2bab Sep 24 05:09:00.262022 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: X-User-Name: tempest-AttachVolumeNegativeTest-993993432-project Sep 24 05:09:00.262022 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: Sep 24 05:09:00.262022 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: {"volumeAttachment": {"volumeId": "22a35095-46cf-4ed9-9de3-4e3c7adf3ef6"}} Sep 24 05:09:00.262022 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: method: > Sep 24 05:09:00.262857 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: exception: Invalid volume: volume 22a35095-46cf-4ed9-9de3-4e3c7adf3ef6 is already attached to instances: 201433d5-db4e-4e57-a800-42fe5cfc95ca Sep 24 05:09:00.262857 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: action_args: {'server_id': '34b2ef46-4969-469b-adcd-22abf7c4d6df', 'body': {'volumeAttachment': {'volumeId': '22a35095-46cf-4ed9-9de3-4e3c7adf3ef6'}}} Sep 24 05:09:00.262857 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 24 05:09:00.262857 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 05:09:00.262857 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Sep 24 05:09:00.262857 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Sep 24 05:09:00.262857 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 24 05:09:00.262857 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 24 05:09:00.262857 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Sep 24 05:09:00.262857 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Sep 24 05:09:00.262857 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5130, in attach_volume Sep 24 05:09:00.262857 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Sep 24 05:09:00.262857 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4970, in _check_volume_already_attached Sep 24 05:09:00.262857 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Sep 24 05:09:00.262857 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 22a35095-46cf-4ed9-9de3-4e3c7adf3ef6 is already attached to instances: 201433d5-db4e-4e57-a800-42fe5cfc95ca Sep 24 05:09:00.262857 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi Sep 24 05:09:00.262857 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 05:09:00.262857 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi Sep 24 05:09:00.262857 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 05:09:00.264022 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 05:09:00.264022 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 05:09:00.264022 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 24 05:09:00.264022 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 24 05:09:00.264022 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 24 05:09:00.264022 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 24 05:09:00.264022 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 24 05:09:00.264022 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 24 05:09:00.264022 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 24 05:09:00.264022 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 24 05:09:00.264022 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 24 05:09:00.264022 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 24 05:09:00.264022 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Sep 24 05:09:00.264022 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Sep 24 05:09:00.264022 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 22a35095-46cf-4ed9-9de3-4e3c7adf3ef6 is already attached to instances: 201433d5-db4e-4e57-a800-42fe5cfc95ca Sep 24 05:09:00.264022 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi Sep 24 05:09:00.264022 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 05:09:00.264022 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi Sep 24 05:09:00.264022 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 05:09:00.264022 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 05:09:00.265210 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 05:09:00.265210 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 24 05:09:00.265210 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 24 05:09:00.265210 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 22a35095-46cf-4ed9-9de3-4e3c7adf3ef6 is already attached to instances: 201433d5-db4e-4e57-a800-42fe5cfc95ca Sep 24 05:09:00.265210 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi Sep 24 05:09:00.265210 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-82990d24-91b0-46a2-a59a-6e8d1c49d03d tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Returning 400 to user: Invalid volume: volume 22a35095-46cf-4ed9-9de3-4e3c7adf3ef6 is already attached to instances: 201433d5-db4e-4e57-a800-42fe5cfc95ca {{(pid=120594) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 24 05:09:00.265210 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [None req-82990d24-91b0-46a2-a59a-6e8d1c49d03d tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] 10.222.0.50 "POST /compute/v2.1/servers/34b2ef46-4969-469b-adcd-22abf7c4d6df/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.101706 Sep 24 05:09:00.267046 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 443/859] 10.222.0.50 () {60 vars in 1323 bytes} [Sat Sep 24 05:09:00 2022] POST /compute/v2.1/servers/34b2ef46-4969-469b-adcd-22abf7c4d6df/os-volume_attachments => generated 174 bytes in 106 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Sep 24 05:09:00.271212 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-7d81fc28-4f73-44dc-af6f-7f9fde4fbfb7 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Calling method '>' {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:09:00.271712 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.compute.api [None req-7d81fc28-4f73-44dc-af6f-7f9fde4fbfb7 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] [instance: 34b2ef46-4969-469b-adcd-22abf7c4d6df] Fetching instance by UUID {{(pid=120593) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:09:00.277547 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-7d81fc28-4f73-44dc-af6f-7f9fde4fbfb7 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:09:00.278065 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-7d81fc28-4f73-44dc-af6f-7f9fde4fbfb7 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:09:00.278525 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-7d81fc28-4f73-44dc-af6f-7f9fde4fbfb7 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:09:00.279222 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-7d81fc28-4f73-44dc-af6f-7f9fde4fbfb7 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:09:00.279675 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-7d81fc28-4f73-44dc-af6f-7f9fde4fbfb7 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:09:00.280102 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-7d81fc28-4f73-44dc-af6f-7f9fde4fbfb7 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:09:00.306474 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.compute.api [None req-7d81fc28-4f73-44dc-af6f-7f9fde4fbfb7 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] [instance: 34b2ef46-4969-469b-adcd-22abf7c4d6df] Going to try to terminate instance {{(pid=120593) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 24 05:09:00.380320 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-7d81fc28-4f73-44dc-af6f-7f9fde4fbfb7 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] 10.222.0.50 "DELETE /compute/v2.1/servers/34b2ef46-4969-469b-adcd-22abf7c4d6df" status: 204 len: 0 microversion: 2.1 time: 0.112618 Sep 24 05:09:00.385212 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 417/860] 10.222.0.50 () {58 vars in 1239 bytes} [Sat Sep 24 05:09:00 2022] DELETE /compute/v2.1/servers/34b2ef46-4969-469b-adcd-22abf7c4d6df => generated 0 bytes in 114 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Sep 24 05:09:00.389091 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-5bfe5ede-eee0-424e-9f0a-a0d91fba7f2b tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Calling method '>' {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:09:00.389620 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.compute.api [None req-5bfe5ede-eee0-424e-9f0a-a0d91fba7f2b tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] [instance: 34b2ef46-4969-469b-adcd-22abf7c4d6df] Fetching instance by UUID {{(pid=120594) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:09:00.396590 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-5bfe5ede-eee0-424e-9f0a-a0d91fba7f2b tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:09:00.397078 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-5bfe5ede-eee0-424e-9f0a-a0d91fba7f2b tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:09:00.397526 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-5bfe5ede-eee0-424e-9f0a-a0d91fba7f2b tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:09:00.398247 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-5bfe5ede-eee0-424e-9f0a-a0d91fba7f2b tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:09:00.398700 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-5bfe5ede-eee0-424e-9f0a-a0d91fba7f2b tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:09:00.399122 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-5bfe5ede-eee0-424e-9f0a-a0d91fba7f2b tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:09:00.535255 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.policy [None req-5bfe5ede-eee0-424e-9f0a-a0d91fba7f2b tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74a8cc19ab204424ab23c62915ac2bab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87d5229e39fe4817b5187068d8acecc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:09:00.543668 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [None req-5bfe5ede-eee0-424e-9f0a-a0d91fba7f2b tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] 10.222.0.50 "GET /compute/v2.1/servers/34b2ef46-4969-469b-adcd-22abf7c4d6df" status: 200 len: 1682 microversion: 2.1 time: 0.158468 Sep 24 05:09:00.544234 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 444/861] 10.222.0.50 () {58 vars in 1236 bytes} [Sat Sep 24 05:09:00 2022] GET /compute/v2.1/servers/34b2ef46-4969-469b-adcd-22abf7c4d6df => generated 1682 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 05:09:00.765443 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-4d1891ea-f6d8-4c38-b33b-bb626f27bf8f tempest-TestShelveInstance-1085488420 tempest-TestShelveInstance-1085488420-project] Calling method '>' {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:09:00.768834 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.compute.api [None req-4d1891ea-f6d8-4c38-b33b-bb626f27bf8f tempest-TestShelveInstance-1085488420 tempest-TestShelveInstance-1085488420-project] [instance: 60d69c7d-69e4-4b2a-b41c-692867a6e28d] Fetching instance by UUID {{(pid=120593) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:09:00.775288 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-4d1891ea-f6d8-4c38-b33b-bb626f27bf8f tempest-TestShelveInstance-1085488420 tempest-TestShelveInstance-1085488420-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:09:00.775768 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-4d1891ea-f6d8-4c38-b33b-bb626f27bf8f tempest-TestShelveInstance-1085488420 tempest-TestShelveInstance-1085488420-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:09:00.776195 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-4d1891ea-f6d8-4c38-b33b-bb626f27bf8f tempest-TestShelveInstance-1085488420 tempest-TestShelveInstance-1085488420-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:09:00.776919 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-4d1891ea-f6d8-4c38-b33b-bb626f27bf8f tempest-TestShelveInstance-1085488420 tempest-TestShelveInstance-1085488420-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:09:00.777365 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-4d1891ea-f6d8-4c38-b33b-bb626f27bf8f tempest-TestShelveInstance-1085488420 tempest-TestShelveInstance-1085488420-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:09:00.777782 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-4d1891ea-f6d8-4c38-b33b-bb626f27bf8f tempest-TestShelveInstance-1085488420 tempest-TestShelveInstance-1085488420-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:09:00.915684 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-4d1891ea-f6d8-4c38-b33b-bb626f27bf8f tempest-TestShelveInstance-1085488420 tempest-TestShelveInstance-1085488420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8fe3c5c28964b768b2c0023fc62f163', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd3d02b11bdf45fe99687fda3d1078cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:09:00.923620 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-4d1891ea-f6d8-4c38-b33b-bb626f27bf8f tempest-TestShelveInstance-1085488420 tempest-TestShelveInstance-1085488420-project] 10.222.0.50 "GET /compute/v2.1/servers/60d69c7d-69e4-4b2a-b41c-692867a6e28d" status: 200 len: 1568 microversion: 2.1 time: 0.163338 Sep 24 05:09:00.924717 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 418/862] 10.222.0.50 () {58 vars in 1236 bytes} [Sat Sep 24 05:09:00 2022] GET /compute/v2.1/servers/60d69c7d-69e4-4b2a-b41c-692867a6e28d => generated 1568 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 05:09:00.994207 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-d877f1be-fb7d-4005-87d4-e88cb75b69a0 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1859963762", "imageRef": "75ab730a-d8cc-4ea2-b58f-0f3eb476c976", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "c071aac1-7a40-472d-a3df-a9b342b44447"}], "security_groups": [{"name": "tempest-securitygroup--1046576636"}], "key_name": "tempest-keypair-627260924", "user_data": "}} {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 05:09:01.094034 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.network.neutron [None req-d877f1be-fb7d-4005-87d4-e88cb75b69a0 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] validate_networks() for [('c071aac1-7a40-472d-a3df-a9b342b44447', None, None, None, None, None)] {{(pid=120594) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 24 05:09:01.455428 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.virt.hardware [None req-d877f1be-fb7d-4005-87d4-e88cb75b69a0 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Flavor limits 0:0:0 {{(pid=120594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 24 05:09:01.456024 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.virt.hardware [None req-d877f1be-fb7d-4005-87d4-e88cb75b69a0 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Image limits 0:0:0 {{(pid=120594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 24 05:09:01.456293 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.virt.hardware [None req-d877f1be-fb7d-4005-87d4-e88cb75b69a0 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Flavor pref 0:0:0 {{(pid=120594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 24 05:09:01.456723 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.virt.hardware [None req-d877f1be-fb7d-4005-87d4-e88cb75b69a0 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Image pref 0:0:0 {{(pid=120594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 24 05:09:01.457123 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.virt.hardware [None req-d877f1be-fb7d-4005-87d4-e88cb75b69a0 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 24 05:09:01.465665 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-d877f1be-fb7d-4005-87d4-e88cb75b69a0 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:09:01.466165 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-d877f1be-fb7d-4005-87d4-e88cb75b69a0 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:09:01.466592 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-d877f1be-fb7d-4005-87d4-e88cb75b69a0 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:09:01.467304 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-d877f1be-fb7d-4005-87d4-e88cb75b69a0 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:09:01.467747 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-d877f1be-fb7d-4005-87d4-e88cb75b69a0 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:09:01.468162 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-d877f1be-fb7d-4005-87d4-e88cb75b69a0 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:09:01.484016 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.quota [None req-d877f1be-fb7d-4005-87d4-e88cb75b69a0 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Getting quotas for project c1aaf20f480a423ea5feca81585aeeed. Resources: {'instances', 'ram', 'cores'} {{(pid=120594) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 24 05:09:01.488424 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.quota [None req-d877f1be-fb7d-4005-87d4-e88cb75b69a0 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Getting quotas for user 0948754217fc4ff2ba0241fa35feaf90 and project c1aaf20f480a423ea5feca81585aeeed. Resources: {'instances', 'ram', 'cores'} {{(pid=120594) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 24 05:09:01.499008 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.compute.api [None req-d877f1be-fb7d-4005-87d4-e88cb75b69a0 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Going to run 1 instances... {{(pid=120594) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 24 05:09:01.501251 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.compute.api [None req-d877f1be-fb7d-4005-87d4-e88cb75b69a0 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] [instance: 36f8e098-a4b5-40a4-8f49-f341c5ad940c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='75ab730a-d8cc-4ea2-b58f-0f3eb476c976',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120594) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 24 05:09:01.547055 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [None req-d877f1be-fb7d-4005-87d4-e88cb75b69a0 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 0.556957 Sep 24 05:09:01.547957 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 445/863] 10.222.0.50 () {62 vars in 1188 bytes} [Sat Sep 24 05:09:00 2022] POST /compute/v2.1/servers => generated 402 bytes in 558 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Sep 24 05:09:01.559321 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-b4f52f58-eae5-4eef-aa33-a85f8cf44b2f tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Calling method '>' {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:09:01.559947 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.compute.api [None req-b4f52f58-eae5-4eef-aa33-a85f8cf44b2f tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] [instance: 36f8e098-a4b5-40a4-8f49-f341c5ad940c] Fetching instance by UUID {{(pid=120593) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:09:01.567106 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-f31cad4b-ddae-42f0-ad15-371f594e9921 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Calling method '>' {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:09:01.567920 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.compute.api [None req-f31cad4b-ddae-42f0-ad15-371f594e9921 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] [instance: 34b2ef46-4969-469b-adcd-22abf7c4d6df] Fetching instance by UUID {{(pid=120594) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:09:01.574999 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-f31cad4b-ddae-42f0-ad15-371f594e9921 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:09:01.575518 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-f31cad4b-ddae-42f0-ad15-371f594e9921 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:09:01.575952 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-f31cad4b-ddae-42f0-ad15-371f594e9921 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:09:01.576646 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-f31cad4b-ddae-42f0-ad15-371f594e9921 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:09:01.577093 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-f31cad4b-ddae-42f0-ad15-371f594e9921 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:09:01.577682 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-f31cad4b-ddae-42f0-ad15-371f594e9921 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:09:01.623724 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-b4f52f58-eae5-4eef-aa33-a85f8cf44b2f tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0948754217fc4ff2ba0241fa35feaf90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1aaf20f480a423ea5feca81585aeeed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:09:01.632735 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-b4f52f58-eae5-4eef-aa33-a85f8cf44b2f tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0948754217fc4ff2ba0241fa35feaf90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1aaf20f480a423ea5feca81585aeeed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:09:01.634255 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-b4f52f58-eae5-4eef-aa33-a85f8cf44b2f tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0948754217fc4ff2ba0241fa35feaf90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1aaf20f480a423ea5feca81585aeeed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:09:01.635353 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-b4f52f58-eae5-4eef-aa33-a85f8cf44b2f tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] 10.222.0.50 "GET /compute/v2.1/servers/36f8e098-a4b5-40a4-8f49-f341c5ad940c" status: 200 len: 1281 microversion: 2.20 time: 0.079951 Sep 24 05:09:01.643649 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 419/864] 10.222.0.50 () {60 vars in 1277 bytes} [Sat Sep 24 05:09:01 2022] GET /compute/v2.1/servers/36f8e098-a4b5-40a4-8f49-f341c5ad940c => generated 1281 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 05:09:01.727654 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.policy [None req-f31cad4b-ddae-42f0-ad15-371f594e9921 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74a8cc19ab204424ab23c62915ac2bab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87d5229e39fe4817b5187068d8acecc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:09:01.735657 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [None req-f31cad4b-ddae-42f0-ad15-371f594e9921 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] 10.222.0.50 "GET /compute/v2.1/servers/34b2ef46-4969-469b-adcd-22abf7c4d6df" status: 200 len: 1682 microversion: 2.1 time: 0.172953 Sep 24 05:09:01.736221 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 446/865] 10.222.0.50 () {58 vars in 1236 bytes} [Sat Sep 24 05:09:01 2022] GET /compute/v2.1/servers/34b2ef46-4969-469b-adcd-22abf7c4d6df => generated 1682 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 05:09:01.948007 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-871f5662-b066-4824-8abc-73ae0e566e43 tempest-TestShelveInstance-1085488420 tempest-TestShelveInstance-1085488420-project] Calling method '>' {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:09:01.948714 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.compute.api [None req-871f5662-b066-4824-8abc-73ae0e566e43 tempest-TestShelveInstance-1085488420 tempest-TestShelveInstance-1085488420-project] [instance: 60d69c7d-69e4-4b2a-b41c-692867a6e28d] Fetching instance by UUID {{(pid=120593) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:09:01.956584 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-871f5662-b066-4824-8abc-73ae0e566e43 tempest-TestShelveInstance-1085488420 tempest-TestShelveInstance-1085488420-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:09:01.957068 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-871f5662-b066-4824-8abc-73ae0e566e43 tempest-TestShelveInstance-1085488420 tempest-TestShelveInstance-1085488420-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:09:01.957568 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-871f5662-b066-4824-8abc-73ae0e566e43 tempest-TestShelveInstance-1085488420 tempest-TestShelveInstance-1085488420-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:09:01.958609 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-871f5662-b066-4824-8abc-73ae0e566e43 tempest-TestShelveInstance-1085488420 tempest-TestShelveInstance-1085488420-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:09:01.959112 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-871f5662-b066-4824-8abc-73ae0e566e43 tempest-TestShelveInstance-1085488420 tempest-TestShelveInstance-1085488420-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:09:01.959604 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-871f5662-b066-4824-8abc-73ae0e566e43 tempest-TestShelveInstance-1085488420 tempest-TestShelveInstance-1085488420-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:09:02.092023 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-871f5662-b066-4824-8abc-73ae0e566e43 tempest-TestShelveInstance-1085488420 tempest-TestShelveInstance-1085488420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8fe3c5c28964b768b2c0023fc62f163', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd3d02b11bdf45fe99687fda3d1078cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:09:02.100484 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-871f5662-b066-4824-8abc-73ae0e566e43 tempest-TestShelveInstance-1085488420 tempest-TestShelveInstance-1085488420-project] 10.222.0.50 "GET /compute/v2.1/servers/60d69c7d-69e4-4b2a-b41c-692867a6e28d" status: 200 len: 1568 microversion: 2.1 time: 0.156412 Sep 24 05:09:02.101141 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 420/866] 10.222.0.50 () {58 vars in 1236 bytes} [Sat Sep 24 05:09:01 2022] GET /compute/v2.1/servers/60d69c7d-69e4-4b2a-b41c-692867a6e28d => generated 1568 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 05:09:02.660422 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-5a814ee9-0b4b-4bee-81dd-32f276c2b0d9 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Calling method '>' {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:09:02.661147 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.compute.api [None req-5a814ee9-0b4b-4bee-81dd-32f276c2b0d9 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] [instance: 36f8e098-a4b5-40a4-8f49-f341c5ad940c] Fetching instance by UUID {{(pid=120594) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:09:02.668037 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-5a814ee9-0b4b-4bee-81dd-32f276c2b0d9 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:09:02.668650 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-5a814ee9-0b4b-4bee-81dd-32f276c2b0d9 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:09:02.669211 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-5a814ee9-0b4b-4bee-81dd-32f276c2b0d9 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:09:02.670173 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-5a814ee9-0b4b-4bee-81dd-32f276c2b0d9 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:09:02.670736 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-5a814ee9-0b4b-4bee-81dd-32f276c2b0d9 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:09:02.671266 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-5a814ee9-0b4b-4bee-81dd-32f276c2b0d9 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:09:02.739779 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.policy [None req-5a814ee9-0b4b-4bee-81dd-32f276c2b0d9 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0948754217fc4ff2ba0241fa35feaf90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1aaf20f480a423ea5feca81585aeeed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:09:02.743305 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG dbcounter [-] [120594] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=120594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 05:09:02.748777 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.policy [None req-5a814ee9-0b4b-4bee-81dd-32f276c2b0d9 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0948754217fc4ff2ba0241fa35feaf90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1aaf20f480a423ea5feca81585aeeed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:09:02.750282 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.policy [None req-5a814ee9-0b4b-4bee-81dd-32f276c2b0d9 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0948754217fc4ff2ba0241fa35feaf90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1aaf20f480a423ea5feca81585aeeed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:09:02.751376 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [None req-5a814ee9-0b4b-4bee-81dd-32f276c2b0d9 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] 10.222.0.50 "GET /compute/v2.1/servers/36f8e098-a4b5-40a4-8f49-f341c5ad940c" status: 200 len: 1333 microversion: 2.20 time: 0.095046 Sep 24 05:09:02.751934 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 447/867] 10.222.0.50 () {60 vars in 1277 bytes} [Sat Sep 24 05:09:02 2022] GET /compute/v2.1/servers/36f8e098-a4b5-40a4-8f49-f341c5ad940c => generated 1333 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 05:09:02.759582 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-c9b33369-a5c5-47e0-8af1-d88cf92d5578 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Calling method '>' {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:09:02.760372 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.compute.api [None req-c9b33369-a5c5-47e0-8af1-d88cf92d5578 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] [instance: 34b2ef46-4969-469b-adcd-22abf7c4d6df] Fetching instance by UUID {{(pid=120593) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:09:02.766388 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-c9b33369-a5c5-47e0-8af1-d88cf92d5578 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:09:02.766941 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-c9b33369-a5c5-47e0-8af1-d88cf92d5578 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:09:02.767449 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-c9b33369-a5c5-47e0-8af1-d88cf92d5578 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:09:02.769388 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-c9b33369-a5c5-47e0-8af1-d88cf92d5578 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:09:02.769977 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-c9b33369-a5c5-47e0-8af1-d88cf92d5578 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:09:02.770436 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-c9b33369-a5c5-47e0-8af1-d88cf92d5578 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:09:02.906820 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-c9b33369-a5c5-47e0-8af1-d88cf92d5578 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74a8cc19ab204424ab23c62915ac2bab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87d5229e39fe4817b5187068d8acecc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:09:02.914412 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-c9b33369-a5c5-47e0-8af1-d88cf92d5578 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] 10.222.0.50 "GET /compute/v2.1/servers/34b2ef46-4969-469b-adcd-22abf7c4d6df" status: 200 len: 1682 microversion: 2.1 time: 0.158657 Sep 24 05:09:02.914961 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 421/868] 10.222.0.50 () {58 vars in 1236 bytes} [Sat Sep 24 05:09:02 2022] GET /compute/v2.1/servers/34b2ef46-4969-469b-adcd-22abf7c4d6df => generated 1682 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 05:09:03.124512 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-285fe90c-f332-4127-bfdb-e4af2bcd303d tempest-TestShelveInstance-1085488420 tempest-TestShelveInstance-1085488420-project] Calling method '>' {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:09:03.125118 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.compute.api [None req-285fe90c-f332-4127-bfdb-e4af2bcd303d tempest-TestShelveInstance-1085488420 tempest-TestShelveInstance-1085488420-project] [instance: 60d69c7d-69e4-4b2a-b41c-692867a6e28d] Fetching instance by UUID {{(pid=120594) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:09:03.133682 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-285fe90c-f332-4127-bfdb-e4af2bcd303d tempest-TestShelveInstance-1085488420 tempest-TestShelveInstance-1085488420-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:09:03.134367 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-285fe90c-f332-4127-bfdb-e4af2bcd303d tempest-TestShelveInstance-1085488420 tempest-TestShelveInstance-1085488420-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:09:03.134808 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-285fe90c-f332-4127-bfdb-e4af2bcd303d tempest-TestShelveInstance-1085488420 tempest-TestShelveInstance-1085488420-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:09:03.135499 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-285fe90c-f332-4127-bfdb-e4af2bcd303d tempest-TestShelveInstance-1085488420 tempest-TestShelveInstance-1085488420-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:09:03.135952 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-285fe90c-f332-4127-bfdb-e4af2bcd303d tempest-TestShelveInstance-1085488420 tempest-TestShelveInstance-1085488420-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:09:03.136378 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-285fe90c-f332-4127-bfdb-e4af2bcd303d tempest-TestShelveInstance-1085488420 tempest-TestShelveInstance-1085488420-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:09:03.269295 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.policy [None req-285fe90c-f332-4127-bfdb-e4af2bcd303d tempest-TestShelveInstance-1085488420 tempest-TestShelveInstance-1085488420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8fe3c5c28964b768b2c0023fc62f163', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd3d02b11bdf45fe99687fda3d1078cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:09:03.276852 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [None req-285fe90c-f332-4127-bfdb-e4af2bcd303d tempest-TestShelveInstance-1085488420 tempest-TestShelveInstance-1085488420-project] 10.222.0.50 "GET /compute/v2.1/servers/60d69c7d-69e4-4b2a-b41c-692867a6e28d" status: 200 len: 1568 microversion: 2.1 time: 0.156555 Sep 24 05:09:03.277406 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 448/869] 10.222.0.50 () {58 vars in 1236 bytes} [Sat Sep 24 05:09:03 2022] GET /compute/v2.1/servers/60d69c7d-69e4-4b2a-b41c-692867a6e28d => generated 1568 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 05:09:03.777337 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-d57d863f-0229-482b-9f36-66edfc8c864c tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Calling method '>' {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:09:03.777933 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.compute.api [None req-d57d863f-0229-482b-9f36-66edfc8c864c tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] [instance: 36f8e098-a4b5-40a4-8f49-f341c5ad940c] Fetching instance by UUID {{(pid=120593) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:09:03.784543 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-d57d863f-0229-482b-9f36-66edfc8c864c tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:09:03.785013 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-d57d863f-0229-482b-9f36-66edfc8c864c tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:09:03.785440 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-d57d863f-0229-482b-9f36-66edfc8c864c tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:09:03.786159 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-d57d863f-0229-482b-9f36-66edfc8c864c tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:09:03.786604 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-d57d863f-0229-482b-9f36-66edfc8c864c tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:09:03.787021 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-d57d863f-0229-482b-9f36-66edfc8c864c tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:09:03.849197 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-d57d863f-0229-482b-9f36-66edfc8c864c tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0948754217fc4ff2ba0241fa35feaf90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1aaf20f480a423ea5feca81585aeeed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:09:03.857356 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-d57d863f-0229-482b-9f36-66edfc8c864c tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0948754217fc4ff2ba0241fa35feaf90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1aaf20f480a423ea5feca81585aeeed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:09:03.858876 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-d57d863f-0229-482b-9f36-66edfc8c864c tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0948754217fc4ff2ba0241fa35feaf90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1aaf20f480a423ea5feca81585aeeed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:09:03.859968 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-d57d863f-0229-482b-9f36-66edfc8c864c tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] 10.222.0.50 "GET /compute/v2.1/servers/36f8e098-a4b5-40a4-8f49-f341c5ad940c" status: 200 len: 1333 microversion: 2.20 time: 0.086510 Sep 24 05:09:03.860524 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 422/870] 10.222.0.50 () {60 vars in 1277 bytes} [Sat Sep 24 05:09:03 2022] GET /compute/v2.1/servers/36f8e098-a4b5-40a4-8f49-f341c5ad940c => generated 1333 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 05:09:03.936544 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-06857601-2eb5-48e5-afe6-df0a39c2a430 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Calling method '>' {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:09:03.937152 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.compute.api [None req-06857601-2eb5-48e5-afe6-df0a39c2a430 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] [instance: 34b2ef46-4969-469b-adcd-22abf7c4d6df] Fetching instance by UUID {{(pid=120594) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:09:03.944247 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-06857601-2eb5-48e5-afe6-df0a39c2a430 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:09:03.944724 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-06857601-2eb5-48e5-afe6-df0a39c2a430 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:09:03.945150 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-06857601-2eb5-48e5-afe6-df0a39c2a430 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:09:03.945840 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-06857601-2eb5-48e5-afe6-df0a39c2a430 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:09:03.946304 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-06857601-2eb5-48e5-afe6-df0a39c2a430 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:09:03.946727 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-06857601-2eb5-48e5-afe6-df0a39c2a430 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:09:04.073560 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.policy [None req-06857601-2eb5-48e5-afe6-df0a39c2a430 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74a8cc19ab204424ab23c62915ac2bab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87d5229e39fe4817b5187068d8acecc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:09:04.081247 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [None req-06857601-2eb5-48e5-afe6-df0a39c2a430 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] 10.222.0.50 "GET /compute/v2.1/servers/34b2ef46-4969-469b-adcd-22abf7c4d6df" status: 200 len: 1682 microversion: 2.1 time: 0.148483 Sep 24 05:09:04.081814 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 449/871] 10.222.0.50 () {58 vars in 1236 bytes} [Sat Sep 24 05:09:03 2022] GET /compute/v2.1/servers/34b2ef46-4969-469b-adcd-22abf7c4d6df => generated 1682 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 05:09:04.303110 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-c49814dc-bca4-46ce-b5a0-c95e7817157c tempest-TestShelveInstance-1085488420 tempest-TestShelveInstance-1085488420-project] Calling method '>' {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:09:04.304161 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.compute.api [None req-c49814dc-bca4-46ce-b5a0-c95e7817157c tempest-TestShelveInstance-1085488420 tempest-TestShelveInstance-1085488420-project] [instance: 60d69c7d-69e4-4b2a-b41c-692867a6e28d] Fetching instance by UUID {{(pid=120593) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:09:04.311202 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-c49814dc-bca4-46ce-b5a0-c95e7817157c tempest-TestShelveInstance-1085488420 tempest-TestShelveInstance-1085488420-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:09:04.311755 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-c49814dc-bca4-46ce-b5a0-c95e7817157c tempest-TestShelveInstance-1085488420 tempest-TestShelveInstance-1085488420-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:09:04.312258 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-c49814dc-bca4-46ce-b5a0-c95e7817157c tempest-TestShelveInstance-1085488420 tempest-TestShelveInstance-1085488420-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:09:04.313011 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-c49814dc-bca4-46ce-b5a0-c95e7817157c tempest-TestShelveInstance-1085488420 tempest-TestShelveInstance-1085488420-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:09:04.314077 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-c49814dc-bca4-46ce-b5a0-c95e7817157c tempest-TestShelveInstance-1085488420 tempest-TestShelveInstance-1085488420-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:09:04.314568 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-c49814dc-bca4-46ce-b5a0-c95e7817157c tempest-TestShelveInstance-1085488420 tempest-TestShelveInstance-1085488420-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:09:04.460567 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-c49814dc-bca4-46ce-b5a0-c95e7817157c tempest-TestShelveInstance-1085488420 tempest-TestShelveInstance-1085488420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8fe3c5c28964b768b2c0023fc62f163', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd3d02b11bdf45fe99687fda3d1078cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:09:04.468273 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-c49814dc-bca4-46ce-b5a0-c95e7817157c tempest-TestShelveInstance-1085488420 tempest-TestShelveInstance-1085488420-project] 10.222.0.50 "GET /compute/v2.1/servers/60d69c7d-69e4-4b2a-b41c-692867a6e28d" status: 200 len: 1568 microversion: 2.1 time: 0.171476 Sep 24 05:09:04.468838 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 423/872] 10.222.0.50 () {58 vars in 1236 bytes} [Sat Sep 24 05:09:04 2022] GET /compute/v2.1/servers/60d69c7d-69e4-4b2a-b41c-692867a6e28d => generated 1568 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 05:09:04.886848 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-6b202345-6bd8-4f71-9344-442b300169b7 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Calling method '>' {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:09:04.893965 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.compute.api [None req-6b202345-6bd8-4f71-9344-442b300169b7 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] [instance: 36f8e098-a4b5-40a4-8f49-f341c5ad940c] Fetching instance by UUID {{(pid=120594) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:09:04.903334 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-6b202345-6bd8-4f71-9344-442b300169b7 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:09:04.904263 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-6b202345-6bd8-4f71-9344-442b300169b7 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:09:04.904907 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-6b202345-6bd8-4f71-9344-442b300169b7 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:09:04.906732 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-6b202345-6bd8-4f71-9344-442b300169b7 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:09:04.907944 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-6b202345-6bd8-4f71-9344-442b300169b7 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:09:04.908629 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-6b202345-6bd8-4f71-9344-442b300169b7 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:09:04.921247 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [req-041ff65d-1bb4-4f0d-a3b0-2c8ef2cd278f req-c46725b7-7192-429f-be73-f449d65cb792 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "34b2ef46-4969-469b-adcd-22abf7c4d6df", "name": "network-vif-deleted", "tag": "7496c434-3138-4ef6-8254-ee2787a76407"}]} {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 05:09:04.948835 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [req-041ff65d-1bb4-4f0d-a3b0-2c8ef2cd278f req-c46725b7-7192-429f-be73-f449d65cb792 service nova] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:09:04.951938 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [req-041ff65d-1bb4-4f0d-a3b0-2c8ef2cd278f req-c46725b7-7192-429f-be73-f449d65cb792 service nova] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:09:04.952590 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [req-041ff65d-1bb4-4f0d-a3b0-2c8ef2cd278f req-c46725b7-7192-429f-be73-f449d65cb792 service nova] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:09:04.981722 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.compute.server_external_events [req-041ff65d-1bb4-4f0d-a3b0-2c8ef2cd278f req-c46725b7-7192-429f-be73-f449d65cb792 service nova] Creating event network-vif-deleted:7496c434-3138-4ef6-8254-ee2787a76407 for instance 34b2ef46-4969-469b-adcd-22abf7c4d6df on hv-cinder-85918 Sep 24 05:09:04.989833 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [req-041ff65d-1bb4-4f0d-a3b0-2c8ef2cd278f req-c46725b7-7192-429f-be73-f449d65cb792 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.073890 Sep 24 05:09:04.991470 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 424/873] 10.222.0.50 () {64 vars in 1317 bytes} [Sat Sep 24 05:09:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 05:09:05.079493 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.policy [None req-6b202345-6bd8-4f71-9344-442b300169b7 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0948754217fc4ff2ba0241fa35feaf90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1aaf20f480a423ea5feca81585aeeed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:09:05.090174 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.policy [None req-6b202345-6bd8-4f71-9344-442b300169b7 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0948754217fc4ff2ba0241fa35feaf90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1aaf20f480a423ea5feca81585aeeed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:09:05.094613 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.policy [None req-6b202345-6bd8-4f71-9344-442b300169b7 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0948754217fc4ff2ba0241fa35feaf90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1aaf20f480a423ea5feca81585aeeed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:09:05.107788 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-5a5dfea4-4132-443e-8b0f-872890645f31 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Calling method '>' {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:09:05.109641 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.compute.api [None req-5a5dfea4-4132-443e-8b0f-872890645f31 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] [instance: 34b2ef46-4969-469b-adcd-22abf7c4d6df] Fetching instance by UUID {{(pid=120593) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:09:05.115527 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [None req-6b202345-6bd8-4f71-9344-442b300169b7 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] 10.222.0.50 "GET /compute/v2.1/servers/36f8e098-a4b5-40a4-8f49-f341c5ad940c" status: 200 len: 1339 microversion: 2.20 time: 0.234579 Sep 24 05:09:05.116133 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 450/874] 10.222.0.50 () {60 vars in 1277 bytes} [Sat Sep 24 05:09:04 2022] GET /compute/v2.1/servers/36f8e098-a4b5-40a4-8f49-f341c5ad940c => generated 1339 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 05:09:05.118477 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-5a5dfea4-4132-443e-8b0f-872890645f31 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:09:05.119454 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-5a5dfea4-4132-443e-8b0f-872890645f31 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:09:05.120131 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-5a5dfea4-4132-443e-8b0f-872890645f31 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:09:05.121046 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-5a5dfea4-4132-443e-8b0f-872890645f31 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:09:05.121597 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-5a5dfea4-4132-443e-8b0f-872890645f31 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:09:05.122161 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-5a5dfea4-4132-443e-8b0f-872890645f31 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:09:05.127770 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG dbcounter [-] [120593] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 05:09:05.171769 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-5a5dfea4-4132-443e-8b0f-872890645f31 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:09:05.172401 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-5a5dfea4-4132-443e-8b0f-872890645f31 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:09:05.172936 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-5a5dfea4-4132-443e-8b0f-872890645f31 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:09:05.173510 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.objects.instance [None req-5a5dfea4-4132-443e-8b0f-872890645f31 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Lazy-loading 'fault' on Instance uuid 34b2ef46-4969-469b-adcd-22abf7c4d6df {{(pid=120593) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 24 05:09:05.232764 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-5a5dfea4-4132-443e-8b0f-872890645f31 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74a8cc19ab204424ab23c62915ac2bab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87d5229e39fe4817b5187068d8acecc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:09:05.242106 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-5a5dfea4-4132-443e-8b0f-872890645f31 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] 10.222.0.50 "GET /compute/v2.1/servers/34b2ef46-4969-469b-adcd-22abf7c4d6df" status: 200 len: 1330 microversion: 2.1 time: 0.140190 Sep 24 05:09:05.243169 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 425/875] 10.222.0.50 () {58 vars in 1236 bytes} [Sat Sep 24 05:09:05 2022] GET /compute/v2.1/servers/34b2ef46-4969-469b-adcd-22abf7c4d6df => generated 1330 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 24 05:09:05.492530 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-b3cc2e47-19d7-48ee-885d-e23ddd20ec88 tempest-TestShelveInstance-1085488420 tempest-TestShelveInstance-1085488420-project] Calling method '>' {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:09:05.493154 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.compute.api [None req-b3cc2e47-19d7-48ee-885d-e23ddd20ec88 tempest-TestShelveInstance-1085488420 tempest-TestShelveInstance-1085488420-project] [instance: 60d69c7d-69e4-4b2a-b41c-692867a6e28d] Fetching instance by UUID {{(pid=120594) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:09:05.499343 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-b3cc2e47-19d7-48ee-885d-e23ddd20ec88 tempest-TestShelveInstance-1085488420 tempest-TestShelveInstance-1085488420-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:09:05.499837 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-b3cc2e47-19d7-48ee-885d-e23ddd20ec88 tempest-TestShelveInstance-1085488420 tempest-TestShelveInstance-1085488420-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:09:05.500272 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-b3cc2e47-19d7-48ee-885d-e23ddd20ec88 tempest-TestShelveInstance-1085488420 tempest-TestShelveInstance-1085488420-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:09:05.501202 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-b3cc2e47-19d7-48ee-885d-e23ddd20ec88 tempest-TestShelveInstance-1085488420 tempest-TestShelveInstance-1085488420-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:09:05.501832 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-b3cc2e47-19d7-48ee-885d-e23ddd20ec88 tempest-TestShelveInstance-1085488420 tempest-TestShelveInstance-1085488420-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:09:05.502984 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-b3cc2e47-19d7-48ee-885d-e23ddd20ec88 tempest-TestShelveInstance-1085488420 tempest-TestShelveInstance-1085488420-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:09:05.732285 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.policy [None req-b3cc2e47-19d7-48ee-885d-e23ddd20ec88 tempest-TestShelveInstance-1085488420 tempest-TestShelveInstance-1085488420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8fe3c5c28964b768b2c0023fc62f163', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd3d02b11bdf45fe99687fda3d1078cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:09:05.744363 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [None req-b3cc2e47-19d7-48ee-885d-e23ddd20ec88 tempest-TestShelveInstance-1085488420 tempest-TestShelveInstance-1085488420-project] 10.222.0.50 "GET /compute/v2.1/servers/60d69c7d-69e4-4b2a-b41c-692867a6e28d" status: 200 len: 1568 microversion: 2.1 time: 0.255662 Sep 24 05:09:05.745979 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 451/876] 10.222.0.50 () {58 vars in 1236 bytes} [Sat Sep 24 05:09:05 2022] GET /compute/v2.1/servers/60d69c7d-69e4-4b2a-b41c-692867a6e28d => generated 1568 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 05:09:06.142230 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-4076282b-0855-4ac0-912b-b9ae543d66f5 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Calling method '>' {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:09:06.144600 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.compute.api [None req-4076282b-0855-4ac0-912b-b9ae543d66f5 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] [instance: 36f8e098-a4b5-40a4-8f49-f341c5ad940c] Fetching instance by UUID {{(pid=120593) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:09:06.153133 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-4076282b-0855-4ac0-912b-b9ae543d66f5 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:09:06.153665 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-4076282b-0855-4ac0-912b-b9ae543d66f5 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:09:06.154131 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-4076282b-0855-4ac0-912b-b9ae543d66f5 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:09:06.154881 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-4076282b-0855-4ac0-912b-b9ae543d66f5 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:09:06.155340 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-4076282b-0855-4ac0-912b-b9ae543d66f5 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:09:06.156014 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-4076282b-0855-4ac0-912b-b9ae543d66f5 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:09:06.266832 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-431a0732-edfb-42f8-a811-3932f79570fd tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Calling method '>' {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:09:06.267423 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.compute.api [None req-431a0732-edfb-42f8-a811-3932f79570fd tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] [instance: 34b2ef46-4969-469b-adcd-22abf7c4d6df] Fetching instance by UUID {{(pid=120594) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:09:06.274113 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-431a0732-edfb-42f8-a811-3932f79570fd tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:09:06.274602 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-431a0732-edfb-42f8-a811-3932f79570fd tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:09:06.275036 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-431a0732-edfb-42f8-a811-3932f79570fd tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:09:06.275739 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-431a0732-edfb-42f8-a811-3932f79570fd tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:09:06.276181 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-431a0732-edfb-42f8-a811-3932f79570fd tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:09:06.276808 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-431a0732-edfb-42f8-a811-3932f79570fd tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:09:06.291766 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: INFO nova.api.openstack.wsgi [None req-431a0732-edfb-42f8-a811-3932f79570fd tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] HTTP exception thrown: Instance 34b2ef46-4969-469b-adcd-22abf7c4d6df could not be found. Sep 24 05:09:06.293200 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-431a0732-edfb-42f8-a811-3932f79570fd tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Request method failure captured: Sep 24 05:09:06.293200 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: request: GET /compute/v2.1/servers/34b2ef46-4969-469b-adcd-22abf7c4d6df HTTP/1.1 Sep 24 05:09:06.293200 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: Accept: application/json Sep 24 05:09:06.293200 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: Accept-Encoding: identity Sep 24 05:09:06.293200 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: Connection: close Sep 24 05:09:06.293200 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: Content-Length: 0 Sep 24 05:09:06.293200 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: Content-Type: application/json Sep 24 05:09:06.293200 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: Host: 10.222.0.50 Sep 24 05:09:06.293200 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: Openstack-System-Scope: None Sep 24 05:09:06.293200 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: User-Agent: python-urllib3/1.26.12 Sep 24 05:09:06.293200 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: X-Auth-Token: gAAAAABjLo8KJCPvHtvWyKaOwXAaewqfKJp-c56tHrqhjOY7vtWfARY07rjbw-W3QgTA2kDEaQgMq3ex8QYwhqyDv3WoWsnpjVPsFiqcb7HeDBvc5PhwgKBF3RB3Cu-UrcKVmBtV6eiqI3YpZ_J_-BmGo2bP4YmrVUCEd9XZC45eF-x5INM7y8Q Sep 24 05:09:06.293200 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: X-Domain-Id: None Sep 24 05:09:06.293200 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: X-Domain-Name: None Sep 24 05:09:06.293200 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: X-Identity-Status: Confirmed Sep 24 05:09:06.293200 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: X-Is-Admin-Project: True Sep 24 05:09:06.293200 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: X-Project-Domain-Id: default Sep 24 05:09:06.293200 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: X-Project-Domain-Name: Default Sep 24 05:09:06.293200 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: X-Project-Id: 87d5229e39fe4817b5187068d8acecc7 Sep 24 05:09:06.293200 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: X-Project-Name: tempest-AttachVolumeNegativeTest-993993432 Sep 24 05:09:06.293200 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: X-Role: member,reader Sep 24 05:09:06.293200 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: X-Roles: member,reader Sep 24 05:09:06.294917 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/87d5229e39fe4817b5187068d8acecc7"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/87d5229e39fe4817b5187068d8acecc7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/87d5229e39fe4817b5187068d8acecc7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.50:8080", "publicURL": "http://10.222.0.50:8080/v1/AUTH_87d5229e39fe4817b5187068d8acecc7"}]}] Sep 24 05:09:06.294917 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: X-Tenant: tempest-AttachVolumeNegativeTest-993993432 Sep 24 05:09:06.294917 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: X-Tenant-Id: 87d5229e39fe4817b5187068d8acecc7 Sep 24 05:09:06.294917 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-993993432 Sep 24 05:09:06.294917 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: X-User: tempest-AttachVolumeNegativeTest-993993432-project Sep 24 05:09:06.294917 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: X-User-Domain-Id: default Sep 24 05:09:06.294917 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: X-User-Domain-Name: Default Sep 24 05:09:06.294917 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: X-User-Id: 74a8cc19ab204424ab23c62915ac2bab Sep 24 05:09:06.294917 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: X-User-Name: tempest-AttachVolumeNegativeTest-993993432-project Sep 24 05:09:06.294917 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: method: > Sep 24 05:09:06.294917 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: exception: Instance 34b2ef46-4969-469b-adcd-22abf7c4d6df could not be found. Sep 24 05:09:06.294917 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: action_args: {'id': '34b2ef46-4969-469b-adcd-22abf7c4d6df'} Sep 24 05:09:06.295687 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 24 05:09:06.295687 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 05:09:06.295687 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 24 05:09:06.295687 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 24 05:09:06.295687 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 24 05:09:06.295687 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 24 05:09:06.295687 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 24 05:09:06.295687 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 24 05:09:06.295687 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 24 05:09:06.295687 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 24 05:09:06.295687 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 34b2ef46-4969-469b-adcd-22abf7c4d6df could not be found. Sep 24 05:09:06.295687 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi Sep 24 05:09:06.295687 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 05:09:06.295687 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi Sep 24 05:09:06.295687 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 05:09:06.295687 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 05:09:06.295687 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 05:09:06.295687 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 24 05:09:06.295687 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 24 05:09:06.295687 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 24 05:09:06.296990 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 24 05:09:06.296990 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 24 05:09:06.296990 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 24 05:09:06.296990 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 24 05:09:06.296990 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 24 05:09:06.296990 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 24 05:09:06.296990 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 24 05:09:06.296990 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 34b2ef46-4969-469b-adcd-22abf7c4d6df could not be found. Sep 24 05:09:06.296990 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi Sep 24 05:09:06.296990 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 05:09:06.296990 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi Sep 24 05:09:06.296990 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 05:09:06.296990 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 05:09:06.296990 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 05:09:06.296990 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 24 05:09:06.296990 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 24 05:09:06.296990 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 34b2ef46-4969-469b-adcd-22abf7c4d6df could not be found. Sep 24 05:09:06.296990 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi Sep 24 05:09:06.298177 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-431a0732-edfb-42f8-a811-3932f79570fd tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Returning 404 to user: Instance 34b2ef46-4969-469b-adcd-22abf7c4d6df could not be found. {{(pid=120594) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 24 05:09:06.298177 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [None req-431a0732-edfb-42f8-a811-3932f79570fd tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] 10.222.0.50 "GET /compute/v2.1/servers/34b2ef46-4969-469b-adcd-22abf7c4d6df" status: 404 len: 111 microversion: 2.1 time: 0.031666 Sep 24 05:09:06.298689 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 452/877] 10.222.0.50 () {58 vars in 1236 bytes} [Sat Sep 24 05:09:06 2022] GET /compute/v2.1/servers/34b2ef46-4969-469b-adcd-22abf7c4d6df => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 24 05:09:06.304227 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-dd71bbda-61b8-4b8d-bf0b-942deb875f23 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Calling method '.version_select at 0x7f79505bf820>' {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:09:06.311343 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-4076282b-0855-4ac0-912b-b9ae543d66f5 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0948754217fc4ff2ba0241fa35feaf90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1aaf20f480a423ea5feca81585aeeed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:09:06.320708 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-4076282b-0855-4ac0-912b-b9ae543d66f5 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0948754217fc4ff2ba0241fa35feaf90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1aaf20f480a423ea5feca81585aeeed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:09:06.322584 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-4076282b-0855-4ac0-912b-b9ae543d66f5 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0948754217fc4ff2ba0241fa35feaf90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1aaf20f480a423ea5feca81585aeeed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:09:06.323836 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-4076282b-0855-4ac0-912b-b9ae543d66f5 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] 10.222.0.50 "GET /compute/v2.1/servers/36f8e098-a4b5-40a4-8f49-f341c5ad940c" status: 200 len: 1407 microversion: 2.20 time: 0.186597 Sep 24 05:09:06.334208 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 426/878] 10.222.0.50 () {60 vars in 1277 bytes} [Sat Sep 24 05:09:06 2022] GET /compute/v2.1/servers/36f8e098-a4b5-40a4-8f49-f341c5ad940c => generated 1407 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 05:09:06.334551 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [None req-dd71bbda-61b8-4b8d-bf0b-942deb875f23 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] 10.222.0.50 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-467337428" status: 202 len: 0 microversion: 2.1 time: 0.025490 Sep 24 05:09:06.334551 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 453/879] 10.222.0.50 () {58 vars in 1218 bytes} [Sat Sep 24 05:09:06 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-467337428 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 24 05:09:06.771727 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-efc231be-b59d-4314-bbed-9c0ad208c490 tempest-TestShelveInstance-1085488420 tempest-TestShelveInstance-1085488420-project] Calling method '>' {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:09:06.773032 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.compute.api [None req-efc231be-b59d-4314-bbed-9c0ad208c490 tempest-TestShelveInstance-1085488420 tempest-TestShelveInstance-1085488420-project] [instance: 60d69c7d-69e4-4b2a-b41c-692867a6e28d] Fetching instance by UUID {{(pid=120593) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:09:06.780633 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-efc231be-b59d-4314-bbed-9c0ad208c490 tempest-TestShelveInstance-1085488420 tempest-TestShelveInstance-1085488420-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:09:06.781605 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-efc231be-b59d-4314-bbed-9c0ad208c490 tempest-TestShelveInstance-1085488420 tempest-TestShelveInstance-1085488420-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:09:06.782228 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-efc231be-b59d-4314-bbed-9c0ad208c490 tempest-TestShelveInstance-1085488420 tempest-TestShelveInstance-1085488420-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:09:06.783488 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-efc231be-b59d-4314-bbed-9c0ad208c490 tempest-TestShelveInstance-1085488420 tempest-TestShelveInstance-1085488420-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:09:06.784580 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-efc231be-b59d-4314-bbed-9c0ad208c490 tempest-TestShelveInstance-1085488420 tempest-TestShelveInstance-1085488420-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:09:06.786341 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-efc231be-b59d-4314-bbed-9c0ad208c490 tempest-TestShelveInstance-1085488420 tempest-TestShelveInstance-1085488420-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:09:06.989652 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [req-29e26300-9873-400d-9dbd-70c0211d576d req-c269435b-2241-4987-8b32-06b5e3410c71 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "60d69c7d-69e4-4b2a-b41c-692867a6e28d", "name": "network-vif-plugged", "status": "completed", "tag": "fab1bdaa-696a-4cf2-b4c6-ca1ee5692022"}]} {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 05:09:07.011014 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [req-29e26300-9873-400d-9dbd-70c0211d576d req-c269435b-2241-4987-8b32-06b5e3410c71 service nova] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:09:07.011858 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [req-29e26300-9873-400d-9dbd-70c0211d576d req-c269435b-2241-4987-8b32-06b5e3410c71 service nova] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:09:07.012583 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [req-29e26300-9873-400d-9dbd-70c0211d576d req-c269435b-2241-4987-8b32-06b5e3410c71 service nova] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:09:07.024258 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: INFO nova.api.openstack.compute.server_external_events [req-29e26300-9873-400d-9dbd-70c0211d576d req-c269435b-2241-4987-8b32-06b5e3410c71 service nova] Creating event network-vif-plugged:fab1bdaa-696a-4cf2-b4c6-ca1ee5692022 for instance 60d69c7d-69e4-4b2a-b41c-692867a6e28d on hv-cinder-85918 Sep 24 05:09:07.029752 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [req-29e26300-9873-400d-9dbd-70c0211d576d req-c269435b-2241-4987-8b32-06b5e3410c71 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046835 Sep 24 05:09:07.030562 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 454/880] 10.222.0.50 () {64 vars in 1317 bytes} [Sat Sep 24 05:09:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 24 05:09:07.035993 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [req-6788902d-c998-4b38-91f6-2096a7de756d req-485f2427-9bef-433f-9c5d-1dc590e32fc9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "36f8e098-a4b5-40a4-8f49-f341c5ad940c", "tag": "e1514bf0-06bf-454f-bb1a-b1c69713927f"}]} {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 05:09:07.047763 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [req-6788902d-c998-4b38-91f6-2096a7de756d req-485f2427-9bef-433f-9c5d-1dc590e32fc9 service nova] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:09:07.048478 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [req-6788902d-c998-4b38-91f6-2096a7de756d req-485f2427-9bef-433f-9c5d-1dc590e32fc9 service nova] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:09:07.048917 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [req-6788902d-c998-4b38-91f6-2096a7de756d req-485f2427-9bef-433f-9c5d-1dc590e32fc9 service nova] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:09:07.058173 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-efc231be-b59d-4314-bbed-9c0ad208c490 tempest-TestShelveInstance-1085488420 tempest-TestShelveInstance-1085488420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8fe3c5c28964b768b2c0023fc62f163', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd3d02b11bdf45fe99687fda3d1078cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:09:07.066582 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-efc231be-b59d-4314-bbed-9c0ad208c490 tempest-TestShelveInstance-1085488420 tempest-TestShelveInstance-1085488420-project] 10.222.0.50 "GET /compute/v2.1/servers/60d69c7d-69e4-4b2a-b41c-692867a6e28d" status: 200 len: 1568 microversion: 2.1 time: 0.301337 Sep 24 05:09:07.071352 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 427/881] 10.222.0.50 () {58 vars in 1236 bytes} [Sat Sep 24 05:09:06 2022] GET /compute/v2.1/servers/60d69c7d-69e4-4b2a-b41c-692867a6e28d => generated 1568 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 05:09:07.079285 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: INFO nova.api.openstack.compute.server_external_events [req-6788902d-c998-4b38-91f6-2096a7de756d req-485f2427-9bef-433f-9c5d-1dc590e32fc9 service nova] Creating event network-changed:e1514bf0-06bf-454f-bb1a-b1c69713927f for instance 36f8e098-a4b5-40a4-8f49-f341c5ad940c on hv-cinder-85918 Sep 24 05:09:07.085720 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [req-6788902d-c998-4b38-91f6-2096a7de756d req-485f2427-9bef-433f-9c5d-1dc590e32fc9 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.053311 Sep 24 05:09:07.086577 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 455/882] 10.222.0.50 () {64 vars in 1317 bytes} [Sat Sep 24 05:09:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 05:09:07.146489 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-54f1a717-1c68-438b-a13d-3cc2c85a510b tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Calling method '>' {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:09:07.147090 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.compute.api [None req-54f1a717-1c68-438b-a13d-3cc2c85a510b tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] [instance: 201433d5-db4e-4e57-a800-42fe5cfc95ca] Fetching instance by UUID {{(pid=120593) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:09:07.153343 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-54f1a717-1c68-438b-a13d-3cc2c85a510b tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:09:07.153828 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-54f1a717-1c68-438b-a13d-3cc2c85a510b tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:09:07.154306 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-54f1a717-1c68-438b-a13d-3cc2c85a510b tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:09:07.154999 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-54f1a717-1c68-438b-a13d-3cc2c85a510b tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:09:07.155463 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-54f1a717-1c68-438b-a13d-3cc2c85a510b tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:09:07.156151 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-54f1a717-1c68-438b-a13d-3cc2c85a510b tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:09:07.236327 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.objects.instance [None req-54f1a717-1c68-438b-a13d-3cc2c85a510b tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Lazy-loading 'services' on Instance uuid 201433d5-db4e-4e57-a800-42fe5cfc95ca {{(pid=120593) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 24 05:09:07.307224 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-54f1a717-1c68-438b-a13d-3cc2c85a510b tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] 10.222.0.50 "DELETE /compute/v2.1/servers/201433d5-db4e-4e57-a800-42fe5cfc95ca/os-volume_attachments/22a35095-46cf-4ed9-9de3-4e3c7adf3ef6" status: 202 len: 0 microversion: 2.1 time: 0.165100 Sep 24 05:09:07.307809 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 428/883] 10.222.0.50 () {58 vars in 1416 bytes} [Sat Sep 24 05:09:07 2022] DELETE /compute/v2.1/servers/201433d5-db4e-4e57-a800-42fe5cfc95ca/os-volume_attachments/22a35095-46cf-4ed9-9de3-4e3c7adf3ef6 => generated 0 bytes in 167 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 24 05:09:07.317203 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-ad9d4e71-37e9-49ff-8d7a-9a6b596c9f9f tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Calling method '>' {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:09:07.319512 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.compute.api [None req-ad9d4e71-37e9-49ff-8d7a-9a6b596c9f9f tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] [instance: 201433d5-db4e-4e57-a800-42fe5cfc95ca] Fetching instance by UUID {{(pid=120594) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:09:07.325484 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-ad9d4e71-37e9-49ff-8d7a-9a6b596c9f9f tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:09:07.325961 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-ad9d4e71-37e9-49ff-8d7a-9a6b596c9f9f tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:09:07.326427 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-ad9d4e71-37e9-49ff-8d7a-9a6b596c9f9f tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:09:07.327150 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-ad9d4e71-37e9-49ff-8d7a-9a6b596c9f9f tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:09:07.327551 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-ad9d4e71-37e9-49ff-8d7a-9a6b596c9f9f tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:09:07.327971 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-ad9d4e71-37e9-49ff-8d7a-9a6b596c9f9f tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:09:07.351205 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-99fd9c61-6a03-4e6f-a118-2ee4ce026f92 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Calling method '>' {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:09:07.351987 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.compute.api [None req-99fd9c61-6a03-4e6f-a118-2ee4ce026f92 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] [instance: 36f8e098-a4b5-40a4-8f49-f341c5ad940c] Fetching instance by UUID {{(pid=120593) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:09:07.357418 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [None req-ad9d4e71-37e9-49ff-8d7a-9a6b596c9f9f tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] 10.222.0.50 "GET /compute/v2.1/servers/201433d5-db4e-4e57-a800-42fe5cfc95ca/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044898 Sep 24 05:09:07.358170 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 456/884] 10.222.0.50 () {58 vars in 1302 bytes} [Sat Sep 24 05:09:07 2022] GET /compute/v2.1/servers/201433d5-db4e-4e57-a800-42fe5cfc95ca/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 05:09:07.358289 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-99fd9c61-6a03-4e6f-a118-2ee4ce026f92 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:09:07.358499 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-99fd9c61-6a03-4e6f-a118-2ee4ce026f92 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:09:07.358933 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-99fd9c61-6a03-4e6f-a118-2ee4ce026f92 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:09:07.359616 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-99fd9c61-6a03-4e6f-a118-2ee4ce026f92 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:09:07.360065 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-99fd9c61-6a03-4e6f-a118-2ee4ce026f92 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:09:07.360481 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-99fd9c61-6a03-4e6f-a118-2ee4ce026f92 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:09:07.497339 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-99fd9c61-6a03-4e6f-a118-2ee4ce026f92 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0948754217fc4ff2ba0241fa35feaf90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1aaf20f480a423ea5feca81585aeeed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:09:07.505579 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-99fd9c61-6a03-4e6f-a118-2ee4ce026f92 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0948754217fc4ff2ba0241fa35feaf90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1aaf20f480a423ea5feca81585aeeed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:09:07.507132 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-99fd9c61-6a03-4e6f-a118-2ee4ce026f92 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0948754217fc4ff2ba0241fa35feaf90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1aaf20f480a423ea5feca81585aeeed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:09:07.508235 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-99fd9c61-6a03-4e6f-a118-2ee4ce026f92 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] 10.222.0.50 "GET /compute/v2.1/servers/36f8e098-a4b5-40a4-8f49-f341c5ad940c" status: 200 len: 1407 microversion: 2.20 time: 0.161378 Sep 24 05:09:07.508798 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 429/885] 10.222.0.50 () {60 vars in 1277 bytes} [Sat Sep 24 05:09:07 2022] GET /compute/v2.1/servers/36f8e098-a4b5-40a4-8f49-f341c5ad940c => generated 1407 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 24 05:09:08.094451 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-91de46b5-2ed9-4288-8de2-f34176703e63 tempest-TestShelveInstance-1085488420 tempest-TestShelveInstance-1085488420-project] Calling method '>' {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:09:08.095061 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.compute.api [None req-91de46b5-2ed9-4288-8de2-f34176703e63 tempest-TestShelveInstance-1085488420 tempest-TestShelveInstance-1085488420-project] [instance: 60d69c7d-69e4-4b2a-b41c-692867a6e28d] Fetching instance by UUID {{(pid=120594) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:09:08.100912 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-91de46b5-2ed9-4288-8de2-f34176703e63 tempest-TestShelveInstance-1085488420 tempest-TestShelveInstance-1085488420-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:09:08.101393 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-91de46b5-2ed9-4288-8de2-f34176703e63 tempest-TestShelveInstance-1085488420 tempest-TestShelveInstance-1085488420-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:09:08.101828 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-91de46b5-2ed9-4288-8de2-f34176703e63 tempest-TestShelveInstance-1085488420 tempest-TestShelveInstance-1085488420-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:09:08.102546 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-91de46b5-2ed9-4288-8de2-f34176703e63 tempest-TestShelveInstance-1085488420 tempest-TestShelveInstance-1085488420-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:09:08.102995 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-91de46b5-2ed9-4288-8de2-f34176703e63 tempest-TestShelveInstance-1085488420 tempest-TestShelveInstance-1085488420-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:09:08.103413 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-91de46b5-2ed9-4288-8de2-f34176703e63 tempest-TestShelveInstance-1085488420 tempest-TestShelveInstance-1085488420-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:09:08.242711 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.policy [None req-91de46b5-2ed9-4288-8de2-f34176703e63 tempest-TestShelveInstance-1085488420 tempest-TestShelveInstance-1085488420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8fe3c5c28964b768b2c0023fc62f163', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd3d02b11bdf45fe99687fda3d1078cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:09:08.250307 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [None req-91de46b5-2ed9-4288-8de2-f34176703e63 tempest-TestShelveInstance-1085488420 tempest-TestShelveInstance-1085488420-project] 10.222.0.50 "GET /compute/v2.1/servers/60d69c7d-69e4-4b2a-b41c-692867a6e28d" status: 200 len: 1568 microversion: 2.1 time: 0.159695 Sep 24 05:09:08.250867 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 457/886] 10.222.0.50 () {58 vars in 1236 bytes} [Sat Sep 24 05:09:08 2022] GET /compute/v2.1/servers/60d69c7d-69e4-4b2a-b41c-692867a6e28d => generated 1568 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 05:09:08.370614 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-7f9b77b3-8a3f-44c0-a3cc-01964ef426ad tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Calling method '>' {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:09:08.372886 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.compute.api [None req-7f9b77b3-8a3f-44c0-a3cc-01964ef426ad tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] [instance: 201433d5-db4e-4e57-a800-42fe5cfc95ca] Fetching instance by UUID {{(pid=120593) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:09:08.379981 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-7f9b77b3-8a3f-44c0-a3cc-01964ef426ad tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:09:08.380464 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-7f9b77b3-8a3f-44c0-a3cc-01964ef426ad tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:09:08.380901 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-7f9b77b3-8a3f-44c0-a3cc-01964ef426ad tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:09:08.381589 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-7f9b77b3-8a3f-44c0-a3cc-01964ef426ad tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:09:08.382072 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-7f9b77b3-8a3f-44c0-a3cc-01964ef426ad tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:09:08.382505 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-7f9b77b3-8a3f-44c0-a3cc-01964ef426ad tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:09:08.411034 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-7f9b77b3-8a3f-44c0-a3cc-01964ef426ad tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] 10.222.0.50 "GET /compute/v2.1/servers/201433d5-db4e-4e57-a800-42fe5cfc95ca/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044361 Sep 24 05:09:08.411580 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 430/887] 10.222.0.50 () {58 vars in 1302 bytes} [Sat Sep 24 05:09:08 2022] GET /compute/v2.1/servers/201433d5-db4e-4e57-a800-42fe5cfc95ca/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 05:09:08.536177 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-bda8cd46-0fba-48cd-bffe-9a916dd3ae25 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Calling method '>' {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:09:08.536710 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.compute.api [None req-bda8cd46-0fba-48cd-bffe-9a916dd3ae25 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] [instance: 36f8e098-a4b5-40a4-8f49-f341c5ad940c] Fetching instance by UUID {{(pid=120594) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:09:08.542582 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-bda8cd46-0fba-48cd-bffe-9a916dd3ae25 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:09:08.543060 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-bda8cd46-0fba-48cd-bffe-9a916dd3ae25 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:09:08.543494 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-bda8cd46-0fba-48cd-bffe-9a916dd3ae25 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:09:08.544182 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-bda8cd46-0fba-48cd-bffe-9a916dd3ae25 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:09:08.544634 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-bda8cd46-0fba-48cd-bffe-9a916dd3ae25 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:09:08.545057 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-bda8cd46-0fba-48cd-bffe-9a916dd3ae25 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:09:08.669940 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.policy [None req-bda8cd46-0fba-48cd-bffe-9a916dd3ae25 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0948754217fc4ff2ba0241fa35feaf90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1aaf20f480a423ea5feca81585aeeed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:09:08.678648 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.policy [None req-bda8cd46-0fba-48cd-bffe-9a916dd3ae25 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0948754217fc4ff2ba0241fa35feaf90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1aaf20f480a423ea5feca81585aeeed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:09:08.680086 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.policy [None req-bda8cd46-0fba-48cd-bffe-9a916dd3ae25 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0948754217fc4ff2ba0241fa35feaf90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1aaf20f480a423ea5feca81585aeeed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:09:08.681169 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [None req-bda8cd46-0fba-48cd-bffe-9a916dd3ae25 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] 10.222.0.50 "GET /compute/v2.1/servers/36f8e098-a4b5-40a4-8f49-f341c5ad940c" status: 200 len: 1407 microversion: 2.20 time: 0.149567 Sep 24 05:09:08.681717 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 458/888] 10.222.0.50 () {60 vars in 1277 bytes} [Sat Sep 24 05:09:08 2022] GET /compute/v2.1/servers/36f8e098-a4b5-40a4-8f49-f341c5ad940c => generated 1407 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 05:09:09.273569 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-cc8f84ab-27c9-4406-a6ad-6ab698bcb068 tempest-TestShelveInstance-1085488420 tempest-TestShelveInstance-1085488420-project] Calling method '>' {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:09:09.274203 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.compute.api [None req-cc8f84ab-27c9-4406-a6ad-6ab698bcb068 tempest-TestShelveInstance-1085488420 tempest-TestShelveInstance-1085488420-project] [instance: 60d69c7d-69e4-4b2a-b41c-692867a6e28d] Fetching instance by UUID {{(pid=120593) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:09:09.280164 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-cc8f84ab-27c9-4406-a6ad-6ab698bcb068 tempest-TestShelveInstance-1085488420 tempest-TestShelveInstance-1085488420-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:09:09.280641 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-cc8f84ab-27c9-4406-a6ad-6ab698bcb068 tempest-TestShelveInstance-1085488420 tempest-TestShelveInstance-1085488420-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:09:09.281329 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-cc8f84ab-27c9-4406-a6ad-6ab698bcb068 tempest-TestShelveInstance-1085488420 tempest-TestShelveInstance-1085488420-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:09:09.282026 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-cc8f84ab-27c9-4406-a6ad-6ab698bcb068 tempest-TestShelveInstance-1085488420 tempest-TestShelveInstance-1085488420-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:09:09.282487 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-cc8f84ab-27c9-4406-a6ad-6ab698bcb068 tempest-TestShelveInstance-1085488420 tempest-TestShelveInstance-1085488420-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:09:09.282906 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-cc8f84ab-27c9-4406-a6ad-6ab698bcb068 tempest-TestShelveInstance-1085488420 tempest-TestShelveInstance-1085488420-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:09:09.408749 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-cc8f84ab-27c9-4406-a6ad-6ab698bcb068 tempest-TestShelveInstance-1085488420 tempest-TestShelveInstance-1085488420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8fe3c5c28964b768b2c0023fc62f163', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd3d02b11bdf45fe99687fda3d1078cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:09:09.416339 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-cc8f84ab-27c9-4406-a6ad-6ab698bcb068 tempest-TestShelveInstance-1085488420 tempest-TestShelveInstance-1085488420-project] 10.222.0.50 "GET /compute/v2.1/servers/60d69c7d-69e4-4b2a-b41c-692867a6e28d" status: 200 len: 1568 microversion: 2.1 time: 0.146677 Sep 24 05:09:09.416911 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 431/889] 10.222.0.50 () {58 vars in 1236 bytes} [Sat Sep 24 05:09:09 2022] GET /compute/v2.1/servers/60d69c7d-69e4-4b2a-b41c-692867a6e28d => generated 1568 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 05:09:09.422849 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-1ece6a60-7e69-4738-b8da-14c3995745cd tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Calling method '>' {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:09:09.425025 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.compute.api [None req-1ece6a60-7e69-4738-b8da-14c3995745cd tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] [instance: 201433d5-db4e-4e57-a800-42fe5cfc95ca] Fetching instance by UUID {{(pid=120594) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:09:09.431586 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-1ece6a60-7e69-4738-b8da-14c3995745cd tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:09:09.431586 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-1ece6a60-7e69-4738-b8da-14c3995745cd tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:09:09.432314 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-1ece6a60-7e69-4738-b8da-14c3995745cd tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:09:09.432897 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-1ece6a60-7e69-4738-b8da-14c3995745cd tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:09:09.433348 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-1ece6a60-7e69-4738-b8da-14c3995745cd tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:09:09.433768 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-1ece6a60-7e69-4738-b8da-14c3995745cd tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:09:09.463654 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [None req-1ece6a60-7e69-4738-b8da-14c3995745cd tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] 10.222.0.50 "GET /compute/v2.1/servers/201433d5-db4e-4e57-a800-42fe5cfc95ca/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044595 Sep 24 05:09:09.464215 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 459/890] 10.222.0.50 () {58 vars in 1302 bytes} [Sat Sep 24 05:09:09 2022] GET /compute/v2.1/servers/201433d5-db4e-4e57-a800-42fe5cfc95ca/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 05:09:09.705442 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-c9b00e06-12ff-46e8-bea0-c932a443f820 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Calling method '>' {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:09:09.706072 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.compute.api [None req-c9b00e06-12ff-46e8-bea0-c932a443f820 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] [instance: 36f8e098-a4b5-40a4-8f49-f341c5ad940c] Fetching instance by UUID {{(pid=120593) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:09:09.712149 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-c9b00e06-12ff-46e8-bea0-c932a443f820 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:09:09.712626 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-c9b00e06-12ff-46e8-bea0-c932a443f820 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:09:09.713056 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-c9b00e06-12ff-46e8-bea0-c932a443f820 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:09:09.713733 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-c9b00e06-12ff-46e8-bea0-c932a443f820 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:09:09.714226 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-c9b00e06-12ff-46e8-bea0-c932a443f820 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:09:09.714644 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-c9b00e06-12ff-46e8-bea0-c932a443f820 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:09:09.852920 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-c9b00e06-12ff-46e8-bea0-c932a443f820 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0948754217fc4ff2ba0241fa35feaf90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1aaf20f480a423ea5feca81585aeeed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:09:09.860904 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-c9b00e06-12ff-46e8-bea0-c932a443f820 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0948754217fc4ff2ba0241fa35feaf90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1aaf20f480a423ea5feca81585aeeed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:09:09.862921 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-c9b00e06-12ff-46e8-bea0-c932a443f820 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0948754217fc4ff2ba0241fa35feaf90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1aaf20f480a423ea5feca81585aeeed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:09:09.864038 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-c9b00e06-12ff-46e8-bea0-c932a443f820 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] 10.222.0.50 "GET /compute/v2.1/servers/36f8e098-a4b5-40a4-8f49-f341c5ad940c" status: 200 len: 1407 microversion: 2.20 time: 0.162556 Sep 24 05:09:09.864582 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 432/891] 10.222.0.50 () {60 vars in 1277 bytes} [Sat Sep 24 05:09:09 2022] GET /compute/v2.1/servers/36f8e098-a4b5-40a4-8f49-f341c5ad940c => generated 1407 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 05:09:10.439802 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-983d64ca-8358-4716-a13d-60c4f51aadf1 tempest-TestShelveInstance-1085488420 tempest-TestShelveInstance-1085488420-project] Calling method '>' {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:09:10.440718 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.compute.api [None req-983d64ca-8358-4716-a13d-60c4f51aadf1 tempest-TestShelveInstance-1085488420 tempest-TestShelveInstance-1085488420-project] [instance: 60d69c7d-69e4-4b2a-b41c-692867a6e28d] Fetching instance by UUID {{(pid=120594) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:09:10.448021 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-983d64ca-8358-4716-a13d-60c4f51aadf1 tempest-TestShelveInstance-1085488420 tempest-TestShelveInstance-1085488420-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:09:10.448500 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-983d64ca-8358-4716-a13d-60c4f51aadf1 tempest-TestShelveInstance-1085488420 tempest-TestShelveInstance-1085488420-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:09:10.448931 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-983d64ca-8358-4716-a13d-60c4f51aadf1 tempest-TestShelveInstance-1085488420 tempest-TestShelveInstance-1085488420-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:09:10.449613 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-983d64ca-8358-4716-a13d-60c4f51aadf1 tempest-TestShelveInstance-1085488420 tempest-TestShelveInstance-1085488420-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:09:10.450081 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-983d64ca-8358-4716-a13d-60c4f51aadf1 tempest-TestShelveInstance-1085488420 tempest-TestShelveInstance-1085488420-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:09:10.450501 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-983d64ca-8358-4716-a13d-60c4f51aadf1 tempest-TestShelveInstance-1085488420 tempest-TestShelveInstance-1085488420-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:09:10.476471 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-7d90b00e-4bbe-42c9-ae48-b2544fa019d0 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Calling method '>' {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:09:10.478655 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.compute.api [None req-7d90b00e-4bbe-42c9-ae48-b2544fa019d0 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] [instance: 201433d5-db4e-4e57-a800-42fe5cfc95ca] Fetching instance by UUID {{(pid=120593) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:09:10.484865 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-7d90b00e-4bbe-42c9-ae48-b2544fa019d0 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:09:10.485347 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-7d90b00e-4bbe-42c9-ae48-b2544fa019d0 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:09:10.485779 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-7d90b00e-4bbe-42c9-ae48-b2544fa019d0 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:09:10.486495 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-7d90b00e-4bbe-42c9-ae48-b2544fa019d0 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:09:10.486988 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-7d90b00e-4bbe-42c9-ae48-b2544fa019d0 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:09:10.487407 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-7d90b00e-4bbe-42c9-ae48-b2544fa019d0 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:09:10.522090 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-7d90b00e-4bbe-42c9-ae48-b2544fa019d0 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] 10.222.0.50 "GET /compute/v2.1/servers/201433d5-db4e-4e57-a800-42fe5cfc95ca/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049543 Sep 24 05:09:10.522972 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 433/892] 10.222.0.50 () {58 vars in 1302 bytes} [Sat Sep 24 05:09:10 2022] GET /compute/v2.1/servers/201433d5-db4e-4e57-a800-42fe5cfc95ca/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 24 05:09:10.585870 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.policy [None req-983d64ca-8358-4716-a13d-60c4f51aadf1 tempest-TestShelveInstance-1085488420 tempest-TestShelveInstance-1085488420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8fe3c5c28964b768b2c0023fc62f163', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd3d02b11bdf45fe99687fda3d1078cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:09:10.593828 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [None req-983d64ca-8358-4716-a13d-60c4f51aadf1 tempest-TestShelveInstance-1085488420 tempest-TestShelveInstance-1085488420-project] 10.222.0.50 "GET /compute/v2.1/servers/60d69c7d-69e4-4b2a-b41c-692867a6e28d" status: 200 len: 1568 microversion: 2.1 time: 0.158217 Sep 24 05:09:10.594414 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 460/893] 10.222.0.50 () {58 vars in 1236 bytes} [Sat Sep 24 05:09:10 2022] GET /compute/v2.1/servers/60d69c7d-69e4-4b2a-b41c-692867a6e28d => generated 1568 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 05:09:10.889193 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-55b449df-f195-42ad-9dcf-ca6c50aa8f2a tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Calling method '>' {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:09:10.889833 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.compute.api [None req-55b449df-f195-42ad-9dcf-ca6c50aa8f2a tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] [instance: 36f8e098-a4b5-40a4-8f49-f341c5ad940c] Fetching instance by UUID {{(pid=120593) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:09:10.895818 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-55b449df-f195-42ad-9dcf-ca6c50aa8f2a tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:09:10.896297 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-55b449df-f195-42ad-9dcf-ca6c50aa8f2a tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:09:10.896732 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-55b449df-f195-42ad-9dcf-ca6c50aa8f2a tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:09:10.897423 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-55b449df-f195-42ad-9dcf-ca6c50aa8f2a tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:09:10.897872 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-55b449df-f195-42ad-9dcf-ca6c50aa8f2a tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:09:10.898336 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-55b449df-f195-42ad-9dcf-ca6c50aa8f2a tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:09:11.032325 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-55b449df-f195-42ad-9dcf-ca6c50aa8f2a tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0948754217fc4ff2ba0241fa35feaf90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1aaf20f480a423ea5feca81585aeeed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:09:11.041167 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-55b449df-f195-42ad-9dcf-ca6c50aa8f2a tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0948754217fc4ff2ba0241fa35feaf90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1aaf20f480a423ea5feca81585aeeed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:09:11.042656 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-55b449df-f195-42ad-9dcf-ca6c50aa8f2a tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0948754217fc4ff2ba0241fa35feaf90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1aaf20f480a423ea5feca81585aeeed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:09:11.043753 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-55b449df-f195-42ad-9dcf-ca6c50aa8f2a tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] 10.222.0.50 "GET /compute/v2.1/servers/36f8e098-a4b5-40a4-8f49-f341c5ad940c" status: 200 len: 1407 microversion: 2.20 time: 0.158546 Sep 24 05:09:11.044308 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 434/894] 10.222.0.50 () {60 vars in 1277 bytes} [Sat Sep 24 05:09:10 2022] GET /compute/v2.1/servers/36f8e098-a4b5-40a4-8f49-f341c5ad940c => generated 1407 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 05:09:11.534903 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-9e94daa3-8bc0-44dd-a13c-a12133207d43 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Calling method '>' {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:09:11.537045 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.compute.api [None req-9e94daa3-8bc0-44dd-a13c-a12133207d43 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] [instance: 201433d5-db4e-4e57-a800-42fe5cfc95ca] Fetching instance by UUID {{(pid=120594) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:09:11.539457 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG dbcounter [-] [120594] Writing DB stats nova_cell0:SELECT=2 {{(pid=120594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 05:09:11.540125 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG dbcounter [-] [120594] Writing DB stats nova_cell0:SELECT=6 {{(pid=120594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 05:09:11.546103 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-9e94daa3-8bc0-44dd-a13c-a12133207d43 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:09:11.546590 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-9e94daa3-8bc0-44dd-a13c-a12133207d43 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:09:11.547031 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-9e94daa3-8bc0-44dd-a13c-a12133207d43 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:09:11.547722 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-9e94daa3-8bc0-44dd-a13c-a12133207d43 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:09:11.548175 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-9e94daa3-8bc0-44dd-a13c-a12133207d43 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:09:11.548602 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-9e94daa3-8bc0-44dd-a13c-a12133207d43 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:09:11.577244 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [None req-9e94daa3-8bc0-44dd-a13c-a12133207d43 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] 10.222.0.50 "GET /compute/v2.1/servers/201433d5-db4e-4e57-a800-42fe5cfc95ca/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.046694 Sep 24 05:09:11.577796 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 461/895] 10.222.0.50 () {58 vars in 1302 bytes} [Sat Sep 24 05:09:11 2022] GET /compute/v2.1/servers/201433d5-db4e-4e57-a800-42fe5cfc95ca/os-volume_attachments => generated 25 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 24 05:09:11.618504 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-25c7a97c-c2c0-4415-b82d-ac32ad7fcf46 tempest-TestShelveInstance-1085488420 tempest-TestShelveInstance-1085488420-project] Calling method '>' {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:09:11.619246 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.compute.api [None req-25c7a97c-c2c0-4415-b82d-ac32ad7fcf46 tempest-TestShelveInstance-1085488420 tempest-TestShelveInstance-1085488420-project] [instance: 60d69c7d-69e4-4b2a-b41c-692867a6e28d] Fetching instance by UUID {{(pid=120593) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:09:11.634454 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-25c7a97c-c2c0-4415-b82d-ac32ad7fcf46 tempest-TestShelveInstance-1085488420 tempest-TestShelveInstance-1085488420-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:09:11.634454 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-25c7a97c-c2c0-4415-b82d-ac32ad7fcf46 tempest-TestShelveInstance-1085488420 tempest-TestShelveInstance-1085488420-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:09:11.634454 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-25c7a97c-c2c0-4415-b82d-ac32ad7fcf46 tempest-TestShelveInstance-1085488420 tempest-TestShelveInstance-1085488420-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:09:11.634454 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-25c7a97c-c2c0-4415-b82d-ac32ad7fcf46 tempest-TestShelveInstance-1085488420 tempest-TestShelveInstance-1085488420-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:09:11.634877 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-25c7a97c-c2c0-4415-b82d-ac32ad7fcf46 tempest-TestShelveInstance-1085488420 tempest-TestShelveInstance-1085488420-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:09:11.634877 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-25c7a97c-c2c0-4415-b82d-ac32ad7fcf46 tempest-TestShelveInstance-1085488420 tempest-TestShelveInstance-1085488420-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:09:11.634877 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG dbcounter [-] [120593] Writing DB stats nova_cell0:SELECT=6 {{(pid=120593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 05:09:11.645265 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-f81587c6-80c2-4515-9dfd-49b8d0d397f6 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Calling method '>' {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:09:11.646191 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.compute.api [None req-f81587c6-80c2-4515-9dfd-49b8d0d397f6 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] [instance: 201433d5-db4e-4e57-a800-42fe5cfc95ca] Fetching instance by UUID {{(pid=120594) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:09:11.652413 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-f81587c6-80c2-4515-9dfd-49b8d0d397f6 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:09:11.653676 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-f81587c6-80c2-4515-9dfd-49b8d0d397f6 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:09:11.654153 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-f81587c6-80c2-4515-9dfd-49b8d0d397f6 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:09:11.654862 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-f81587c6-80c2-4515-9dfd-49b8d0d397f6 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:09:11.655319 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-f81587c6-80c2-4515-9dfd-49b8d0d397f6 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:09:11.655903 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-f81587c6-80c2-4515-9dfd-49b8d0d397f6 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:09:11.683507 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.compute.api [None req-f81587c6-80c2-4515-9dfd-49b8d0d397f6 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] [instance: 201433d5-db4e-4e57-a800-42fe5cfc95ca] Going to try to terminate instance {{(pid=120594) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 24 05:09:11.746018 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG dbcounter [-] [120594] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=1,nova_api:INSERT=3,nova_api:DELETE=1 {{(pid=120594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 05:09:11.763316 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [None req-f81587c6-80c2-4515-9dfd-49b8d0d397f6 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] 10.222.0.50 "DELETE /compute/v2.1/servers/201433d5-db4e-4e57-a800-42fe5cfc95ca" status: 204 len: 0 microversion: 2.1 time: 0.121979 Sep 24 05:09:11.763737 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 462/896] 10.222.0.50 () {58 vars in 1239 bytes} [Sat Sep 24 05:09:11 2022] DELETE /compute/v2.1/servers/201433d5-db4e-4e57-a800-42fe5cfc95ca => generated 0 bytes in 123 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Sep 24 05:09:11.773487 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-ca802e4e-429f-4bd4-b398-0e767c955bc9 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Calling method '>' {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:09:11.774240 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.compute.api [None req-ca802e4e-429f-4bd4-b398-0e767c955bc9 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] [instance: 201433d5-db4e-4e57-a800-42fe5cfc95ca] Fetching instance by UUID {{(pid=120594) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:09:11.777423 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-25c7a97c-c2c0-4415-b82d-ac32ad7fcf46 tempest-TestShelveInstance-1085488420 tempest-TestShelveInstance-1085488420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8fe3c5c28964b768b2c0023fc62f163', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd3d02b11bdf45fe99687fda3d1078cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:09:11.781445 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-ca802e4e-429f-4bd4-b398-0e767c955bc9 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:09:11.781927 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-ca802e4e-429f-4bd4-b398-0e767c955bc9 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:09:11.782527 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-ca802e4e-429f-4bd4-b398-0e767c955bc9 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:09:11.783221 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-ca802e4e-429f-4bd4-b398-0e767c955bc9 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:09:11.783702 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-ca802e4e-429f-4bd4-b398-0e767c955bc9 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:09:11.784126 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-ca802e4e-429f-4bd4-b398-0e767c955bc9 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:09:11.785658 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-25c7a97c-c2c0-4415-b82d-ac32ad7fcf46 tempest-TestShelveInstance-1085488420 tempest-TestShelveInstance-1085488420-project] 10.222.0.50 "GET /compute/v2.1/servers/60d69c7d-69e4-4b2a-b41c-692867a6e28d" status: 200 len: 1568 microversion: 2.1 time: 0.171487 Sep 24 05:09:11.786224 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 435/897] 10.222.0.50 () {58 vars in 1236 bytes} [Sat Sep 24 05:09:11 2022] GET /compute/v2.1/servers/60d69c7d-69e4-4b2a-b41c-692867a6e28d => generated 1568 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 05:09:11.917338 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.policy [None req-ca802e4e-429f-4bd4-b398-0e767c955bc9 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74a8cc19ab204424ab23c62915ac2bab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87d5229e39fe4817b5187068d8acecc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:09:11.925920 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [None req-ca802e4e-429f-4bd4-b398-0e767c955bc9 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] 10.222.0.50 "GET /compute/v2.1/servers/201433d5-db4e-4e57-a800-42fe5cfc95ca" status: 200 len: 1682 microversion: 2.1 time: 0.157836 Sep 24 05:09:11.926514 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 463/898] 10.222.0.50 () {58 vars in 1236 bytes} [Sat Sep 24 05:09:11 2022] GET /compute/v2.1/servers/201433d5-db4e-4e57-a800-42fe5cfc95ca => generated 1682 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 24 05:09:12.069515 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-139207b5-5403-4fc9-848c-f779c7a1fa99 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Calling method '>' {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:09:12.070069 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.compute.api [None req-139207b5-5403-4fc9-848c-f779c7a1fa99 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] [instance: 36f8e098-a4b5-40a4-8f49-f341c5ad940c] Fetching instance by UUID {{(pid=120593) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:09:12.072904 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG dbcounter [-] [120593] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=2,nova_api:DELETE=1,nova_api:INSERT=1 {{(pid=120593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 05:09:12.076719 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-139207b5-5403-4fc9-848c-f779c7a1fa99 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:09:12.077204 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-139207b5-5403-4fc9-848c-f779c7a1fa99 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:09:12.077637 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-139207b5-5403-4fc9-848c-f779c7a1fa99 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:09:12.078359 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-139207b5-5403-4fc9-848c-f779c7a1fa99 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:09:12.078812 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-139207b5-5403-4fc9-848c-f779c7a1fa99 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:09:12.079238 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-139207b5-5403-4fc9-848c-f779c7a1fa99 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:09:12.205814 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-139207b5-5403-4fc9-848c-f779c7a1fa99 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0948754217fc4ff2ba0241fa35feaf90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1aaf20f480a423ea5feca81585aeeed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:09:12.214465 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-139207b5-5403-4fc9-848c-f779c7a1fa99 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0948754217fc4ff2ba0241fa35feaf90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1aaf20f480a423ea5feca81585aeeed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:09:12.215919 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-139207b5-5403-4fc9-848c-f779c7a1fa99 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0948754217fc4ff2ba0241fa35feaf90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1aaf20f480a423ea5feca81585aeeed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:09:12.217061 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-139207b5-5403-4fc9-848c-f779c7a1fa99 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] 10.222.0.50 "GET /compute/v2.1/servers/36f8e098-a4b5-40a4-8f49-f341c5ad940c" status: 200 len: 1407 microversion: 2.20 time: 0.152246 Sep 24 05:09:12.217648 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 436/899] 10.222.0.50 () {60 vars in 1277 bytes} [Sat Sep 24 05:09:12 2022] GET /compute/v2.1/servers/36f8e098-a4b5-40a4-8f49-f341c5ad940c => generated 1407 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 05:09:12.808398 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-9ee0269c-bbbd-4ab1-b895-a400a7447f94 tempest-TestShelveInstance-1085488420 tempest-TestShelveInstance-1085488420-project] Calling method '>' {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:09:12.809029 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.compute.api [None req-9ee0269c-bbbd-4ab1-b895-a400a7447f94 tempest-TestShelveInstance-1085488420 tempest-TestShelveInstance-1085488420-project] [instance: 60d69c7d-69e4-4b2a-b41c-692867a6e28d] Fetching instance by UUID {{(pid=120594) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:09:12.816047 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-9ee0269c-bbbd-4ab1-b895-a400a7447f94 tempest-TestShelveInstance-1085488420 tempest-TestShelveInstance-1085488420-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:09:12.816521 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-9ee0269c-bbbd-4ab1-b895-a400a7447f94 tempest-TestShelveInstance-1085488420 tempest-TestShelveInstance-1085488420-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:09:12.816956 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-9ee0269c-bbbd-4ab1-b895-a400a7447f94 tempest-TestShelveInstance-1085488420 tempest-TestShelveInstance-1085488420-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:09:12.817641 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-9ee0269c-bbbd-4ab1-b895-a400a7447f94 tempest-TestShelveInstance-1085488420 tempest-TestShelveInstance-1085488420-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:09:12.818118 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-9ee0269c-bbbd-4ab1-b895-a400a7447f94 tempest-TestShelveInstance-1085488420 tempest-TestShelveInstance-1085488420-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:09:12.818539 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-9ee0269c-bbbd-4ab1-b895-a400a7447f94 tempest-TestShelveInstance-1085488420 tempest-TestShelveInstance-1085488420-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:09:12.949098 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.policy [None req-9ee0269c-bbbd-4ab1-b895-a400a7447f94 tempest-TestShelveInstance-1085488420 tempest-TestShelveInstance-1085488420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8fe3c5c28964b768b2c0023fc62f163', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd3d02b11bdf45fe99687fda3d1078cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:09:12.949875 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-32004969-b7b1-412d-9d9d-8550d7f86b66 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Calling method '>' {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:09:12.950529 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.compute.api [None req-32004969-b7b1-412d-9d9d-8550d7f86b66 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] [instance: 201433d5-db4e-4e57-a800-42fe5cfc95ca] Fetching instance by UUID {{(pid=120593) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:09:12.957756 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-32004969-b7b1-412d-9d9d-8550d7f86b66 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:09:12.958434 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [None req-9ee0269c-bbbd-4ab1-b895-a400a7447f94 tempest-TestShelveInstance-1085488420 tempest-TestShelveInstance-1085488420-project] 10.222.0.50 "GET /compute/v2.1/servers/60d69c7d-69e4-4b2a-b41c-692867a6e28d" status: 200 len: 1555 microversion: 2.1 time: 0.153857 Sep 24 05:09:12.958568 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-32004969-b7b1-412d-9d9d-8550d7f86b66 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:09:12.958909 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-32004969-b7b1-412d-9d9d-8550d7f86b66 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:09:12.959382 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 464/900] 10.222.0.50 () {58 vars in 1236 bytes} [Sat Sep 24 05:09:12 2022] GET /compute/v2.1/servers/60d69c7d-69e4-4b2a-b41c-692867a6e28d => generated 1555 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 05:09:12.959609 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-32004969-b7b1-412d-9d9d-8550d7f86b66 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:09:12.960169 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-32004969-b7b1-412d-9d9d-8550d7f86b66 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:09:12.960581 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-32004969-b7b1-412d-9d9d-8550d7f86b66 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:09:13.086491 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [req-9a46a842-f854-4e55-ba64-5ed00efada7c req-df717da9-9e01-4dfa-b3b8-eb34fcf4eb6c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "36f8e098-a4b5-40a4-8f49-f341c5ad940c", "name": "network-vif-plugged", "status": "completed", "tag": "e1514bf0-06bf-454f-bb1a-b1c69713927f"}]} {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 05:09:13.096586 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [req-9a46a842-f854-4e55-ba64-5ed00efada7c req-df717da9-9e01-4dfa-b3b8-eb34fcf4eb6c service nova] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:09:13.097065 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [req-9a46a842-f854-4e55-ba64-5ed00efada7c req-df717da9-9e01-4dfa-b3b8-eb34fcf4eb6c service nova] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:09:13.097500 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [req-9a46a842-f854-4e55-ba64-5ed00efada7c req-df717da9-9e01-4dfa-b3b8-eb34fcf4eb6c service nova] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:09:13.101024 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-32004969-b7b1-412d-9d9d-8550d7f86b66 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74a8cc19ab204424ab23c62915ac2bab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87d5229e39fe4817b5187068d8acecc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:09:13.109096 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-32004969-b7b1-412d-9d9d-8550d7f86b66 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] 10.222.0.50 "GET /compute/v2.1/servers/201433d5-db4e-4e57-a800-42fe5cfc95ca" status: 200 len: 1682 microversion: 2.1 time: 0.163464 Sep 24 05:09:13.109591 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: INFO nova.api.openstack.compute.server_external_events [req-9a46a842-f854-4e55-ba64-5ed00efada7c req-df717da9-9e01-4dfa-b3b8-eb34fcf4eb6c service nova] Creating event network-vif-plugged:e1514bf0-06bf-454f-bb1a-b1c69713927f for instance 36f8e098-a4b5-40a4-8f49-f341c5ad940c on hv-cinder-85918 Sep 24 05:09:13.109968 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 437/901] 10.222.0.50 () {58 vars in 1236 bytes} [Sat Sep 24 05:09:12 2022] GET /compute/v2.1/servers/201433d5-db4e-4e57-a800-42fe5cfc95ca => generated 1682 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 05:09:13.128835 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [req-9a46a842-f854-4e55-ba64-5ed00efada7c req-df717da9-9e01-4dfa-b3b8-eb34fcf4eb6c service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046569 Sep 24 05:09:13.129419 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 465/902] 10.222.0.50 () {64 vars in 1317 bytes} [Sat Sep 24 05:09:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 24 05:09:13.241204 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-af572d5f-df35-4993-b98f-abd50d821a5e tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Calling method '>' {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:09:13.241963 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.compute.api [None req-af572d5f-df35-4993-b98f-abd50d821a5e tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] [instance: 36f8e098-a4b5-40a4-8f49-f341c5ad940c] Fetching instance by UUID {{(pid=120593) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:09:13.248379 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-af572d5f-df35-4993-b98f-abd50d821a5e tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:09:13.248868 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-af572d5f-df35-4993-b98f-abd50d821a5e tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:09:13.249302 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-af572d5f-df35-4993-b98f-abd50d821a5e tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:09:13.250028 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-af572d5f-df35-4993-b98f-abd50d821a5e tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:09:13.250489 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-af572d5f-df35-4993-b98f-abd50d821a5e tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:09:13.250904 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-af572d5f-df35-4993-b98f-abd50d821a5e tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:09:13.396996 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-af572d5f-df35-4993-b98f-abd50d821a5e tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0948754217fc4ff2ba0241fa35feaf90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1aaf20f480a423ea5feca81585aeeed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:09:13.405243 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-af572d5f-df35-4993-b98f-abd50d821a5e tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0948754217fc4ff2ba0241fa35feaf90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1aaf20f480a423ea5feca81585aeeed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:09:13.406963 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-af572d5f-df35-4993-b98f-abd50d821a5e tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0948754217fc4ff2ba0241fa35feaf90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1aaf20f480a423ea5feca81585aeeed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:09:13.408275 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-af572d5f-df35-4993-b98f-abd50d821a5e tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] 10.222.0.50 "GET /compute/v2.1/servers/36f8e098-a4b5-40a4-8f49-f341c5ad940c" status: 200 len: 1407 microversion: 2.20 time: 0.171497 Sep 24 05:09:13.408929 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 438/903] 10.222.0.50 () {60 vars in 1277 bytes} [Sat Sep 24 05:09:13 2022] GET /compute/v2.1/servers/36f8e098-a4b5-40a4-8f49-f341c5ad940c => generated 1407 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 05:09:14.132520 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-02d37913-ea89-4ba4-af75-3ae1dd509dec tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Calling method '>' {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:09:14.133196 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.compute.api [None req-02d37913-ea89-4ba4-af75-3ae1dd509dec tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] [instance: 201433d5-db4e-4e57-a800-42fe5cfc95ca] Fetching instance by UUID {{(pid=120594) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:09:14.139840 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-02d37913-ea89-4ba4-af75-3ae1dd509dec tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:09:14.140330 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-02d37913-ea89-4ba4-af75-3ae1dd509dec tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:09:14.140772 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-02d37913-ea89-4ba4-af75-3ae1dd509dec tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:09:14.141478 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-02d37913-ea89-4ba4-af75-3ae1dd509dec tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:09:14.141929 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-02d37913-ea89-4ba4-af75-3ae1dd509dec tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:09:14.142465 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-02d37913-ea89-4ba4-af75-3ae1dd509dec tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:09:14.164093 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG dbcounter [-] [120594] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 05:09:14.208129 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [req-6e70355b-7568-46e7-85ef-e1bf428ad2fa req-c812b758-bc8d-4804-ab59-70e4904495cf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "201433d5-db4e-4e57-a800-42fe5cfc95ca", "name": "network-vif-deleted", "tag": "7efb703e-b766-4972-b442-eaba81c854e8"}]} {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 05:09:14.214653 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.policy [None req-02d37913-ea89-4ba4-af75-3ae1dd509dec tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74a8cc19ab204424ab23c62915ac2bab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87d5229e39fe4817b5187068d8acecc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:09:14.218454 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [req-6e70355b-7568-46e7-85ef-e1bf428ad2fa req-c812b758-bc8d-4804-ab59-70e4904495cf service nova] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:09:14.218939 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [req-6e70355b-7568-46e7-85ef-e1bf428ad2fa req-c812b758-bc8d-4804-ab59-70e4904495cf service nova] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:09:14.219371 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [req-6e70355b-7568-46e7-85ef-e1bf428ad2fa req-c812b758-bc8d-4804-ab59-70e4904495cf service nova] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:09:14.224153 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [None req-02d37913-ea89-4ba4-af75-3ae1dd509dec tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] 10.222.0.50 "GET /compute/v2.1/servers/201433d5-db4e-4e57-a800-42fe5cfc95ca" status: 200 len: 1615 microversion: 2.1 time: 0.096366 Sep 24 05:09:14.224963 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 466/904] 10.222.0.50 () {58 vars in 1236 bytes} [Sat Sep 24 05:09:14 2022] GET /compute/v2.1/servers/201433d5-db4e-4e57-a800-42fe5cfc95ca => generated 1615 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 05:09:14.233044 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.compute.server_external_events [req-6e70355b-7568-46e7-85ef-e1bf428ad2fa req-c812b758-bc8d-4804-ab59-70e4904495cf service nova] Creating event network-vif-deleted:7efb703e-b766-4972-b442-eaba81c854e8 for instance 201433d5-db4e-4e57-a800-42fe5cfc95ca on hv-cinder-85918 Sep 24 05:09:14.238380 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [req-6e70355b-7568-46e7-85ef-e1bf428ad2fa req-c812b758-bc8d-4804-ab59-70e4904495cf service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034454 Sep 24 05:09:14.239076 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 439/905] 10.222.0.50 () {64 vars in 1317 bytes} [Sat Sep 24 05:09:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 24 05:09:14.433679 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-df9424d7-0065-4e82-b804-4383c4171981 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Calling method '>' {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:09:14.434433 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.compute.api [None req-df9424d7-0065-4e82-b804-4383c4171981 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] [instance: 36f8e098-a4b5-40a4-8f49-f341c5ad940c] Fetching instance by UUID {{(pid=120594) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:09:14.440370 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-df9424d7-0065-4e82-b804-4383c4171981 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:09:14.440850 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-df9424d7-0065-4e82-b804-4383c4171981 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:09:14.441284 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-df9424d7-0065-4e82-b804-4383c4171981 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:09:14.442189 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-df9424d7-0065-4e82-b804-4383c4171981 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:09:14.442712 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-df9424d7-0065-4e82-b804-4383c4171981 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:09:14.443298 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-df9424d7-0065-4e82-b804-4383c4171981 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:09:14.576971 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.policy [None req-df9424d7-0065-4e82-b804-4383c4171981 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0948754217fc4ff2ba0241fa35feaf90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1aaf20f480a423ea5feca81585aeeed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:09:14.586550 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.policy [None req-df9424d7-0065-4e82-b804-4383c4171981 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0948754217fc4ff2ba0241fa35feaf90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1aaf20f480a423ea5feca81585aeeed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:09:14.587982 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.policy [None req-df9424d7-0065-4e82-b804-4383c4171981 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0948754217fc4ff2ba0241fa35feaf90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1aaf20f480a423ea5feca81585aeeed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:09:14.589073 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [None req-df9424d7-0065-4e82-b804-4383c4171981 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] 10.222.0.50 "GET /compute/v2.1/servers/36f8e098-a4b5-40a4-8f49-f341c5ad940c" status: 200 len: 1407 microversion: 2.20 time: 0.159328 Sep 24 05:09:14.597693 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 467/906] 10.222.0.50 () {60 vars in 1277 bytes} [Sat Sep 24 05:09:14 2022] GET /compute/v2.1/servers/36f8e098-a4b5-40a4-8f49-f341c5ad940c => generated 1407 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 05:09:15.248906 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-e21bac74-a89d-4d01-a36c-5d280ee60996 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Calling method '>' {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:09:15.249630 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.compute.api [None req-e21bac74-a89d-4d01-a36c-5d280ee60996 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] [instance: 201433d5-db4e-4e57-a800-42fe5cfc95ca] Fetching instance by UUID {{(pid=120593) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:09:15.256346 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-e21bac74-a89d-4d01-a36c-5d280ee60996 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:09:15.256830 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-e21bac74-a89d-4d01-a36c-5d280ee60996 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:09:15.257269 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-e21bac74-a89d-4d01-a36c-5d280ee60996 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:09:15.257964 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-e21bac74-a89d-4d01-a36c-5d280ee60996 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:09:15.258433 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-e21bac74-a89d-4d01-a36c-5d280ee60996 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:09:15.258881 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-e21bac74-a89d-4d01-a36c-5d280ee60996 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:09:15.290668 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-e21bac74-a89d-4d01-a36c-5d280ee60996 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:09:15.291146 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-e21bac74-a89d-4d01-a36c-5d280ee60996 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:09:15.291576 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-e21bac74-a89d-4d01-a36c-5d280ee60996 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:09:15.292013 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.objects.instance [None req-e21bac74-a89d-4d01-a36c-5d280ee60996 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Lazy-loading 'fault' on Instance uuid 201433d5-db4e-4e57-a800-42fe5cfc95ca {{(pid=120593) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 24 05:09:15.332713 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-e21bac74-a89d-4d01-a36c-5d280ee60996 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74a8cc19ab204424ab23c62915ac2bab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87d5229e39fe4817b5187068d8acecc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:09:15.340309 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-e21bac74-a89d-4d01-a36c-5d280ee60996 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] 10.222.0.50 "GET /compute/v2.1/servers/201433d5-db4e-4e57-a800-42fe5cfc95ca" status: 200 len: 1332 microversion: 2.1 time: 0.096159 Sep 24 05:09:15.340866 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 440/907] 10.222.0.50 () {58 vars in 1236 bytes} [Sat Sep 24 05:09:15 2022] GET /compute/v2.1/servers/201433d5-db4e-4e57-a800-42fe5cfc95ca => generated 1332 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 05:09:15.614623 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-ad507844-04ec-4d3c-9db2-6146a95c5985 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Calling method '>' {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:09:15.615232 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.compute.api [None req-ad507844-04ec-4d3c-9db2-6146a95c5985 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] [instance: 36f8e098-a4b5-40a4-8f49-f341c5ad940c] Fetching instance by UUID {{(pid=120594) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:09:15.621652 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-ad507844-04ec-4d3c-9db2-6146a95c5985 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:09:15.622170 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-ad507844-04ec-4d3c-9db2-6146a95c5985 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:09:15.622611 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-ad507844-04ec-4d3c-9db2-6146a95c5985 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:09:15.623305 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-ad507844-04ec-4d3c-9db2-6146a95c5985 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:09:15.623755 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-ad507844-04ec-4d3c-9db2-6146a95c5985 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:09:15.624181 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-ad507844-04ec-4d3c-9db2-6146a95c5985 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:09:15.755482 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.policy [None req-ad507844-04ec-4d3c-9db2-6146a95c5985 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0948754217fc4ff2ba0241fa35feaf90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1aaf20f480a423ea5feca81585aeeed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:09:15.763469 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.policy [None req-ad507844-04ec-4d3c-9db2-6146a95c5985 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0948754217fc4ff2ba0241fa35feaf90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1aaf20f480a423ea5feca81585aeeed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:09:15.764909 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.policy [None req-ad507844-04ec-4d3c-9db2-6146a95c5985 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0948754217fc4ff2ba0241fa35feaf90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1aaf20f480a423ea5feca81585aeeed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:09:15.766071 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [None req-ad507844-04ec-4d3c-9db2-6146a95c5985 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] 10.222.0.50 "GET /compute/v2.1/servers/36f8e098-a4b5-40a4-8f49-f341c5ad940c" status: 200 len: 1599 microversion: 2.20 time: 0.156043 Sep 24 05:09:15.766629 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 468/908] 10.222.0.50 () {60 vars in 1277 bytes} [Sat Sep 24 05:09:15 2022] GET /compute/v2.1/servers/36f8e098-a4b5-40a4-8f49-f341c5ad940c => generated 1599 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 05:09:15.791255 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-1f018be0-8958-416a-a628-173f6d3b49e0 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Calling method '>' {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:09:15.791766 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.compute.api [None req-1f018be0-8958-416a-a628-173f6d3b49e0 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] [instance: 36f8e098-a4b5-40a4-8f49-f341c5ad940c] Fetching instance by UUID {{(pid=120593) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:09:15.797568 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-1f018be0-8958-416a-a628-173f6d3b49e0 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:09:15.798138 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-1f018be0-8958-416a-a628-173f6d3b49e0 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:09:15.798584 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-1f018be0-8958-416a-a628-173f6d3b49e0 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:09:15.799264 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-1f018be0-8958-416a-a628-173f6d3b49e0 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:09:15.799712 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-1f018be0-8958-416a-a628-173f6d3b49e0 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:09:15.800135 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-1f018be0-8958-416a-a628-173f6d3b49e0 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:09:15.803767 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG dbcounter [-] [120593] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=120593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 05:09:15.875121 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-1f018be0-8958-416a-a628-173f6d3b49e0 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] 10.222.0.50 "GET /compute/v2.1/servers/36f8e098-a4b5-40a4-8f49-f341c5ad940c/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.087748 Sep 24 05:09:15.875710 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 441/909] 10.222.0.50 () {60 vars in 1316 bytes} [Sat Sep 24 05:09:15 2022] GET /compute/v2.1/servers/36f8e098-a4b5-40a4-8f49-f341c5ad940c/os-interface => generated 284 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 24 05:09:16.364275 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-3aaee9ff-630c-484e-9d50-487274165dac tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Calling method '>' {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:09:16.364915 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.compute.api [None req-3aaee9ff-630c-484e-9d50-487274165dac tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] [instance: 201433d5-db4e-4e57-a800-42fe5cfc95ca] Fetching instance by UUID {{(pid=120594) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:09:16.370810 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-3aaee9ff-630c-484e-9d50-487274165dac tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:09:16.371293 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-3aaee9ff-630c-484e-9d50-487274165dac tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:09:16.371737 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-3aaee9ff-630c-484e-9d50-487274165dac tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:09:16.372452 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-3aaee9ff-630c-484e-9d50-487274165dac tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:09:16.372906 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-3aaee9ff-630c-484e-9d50-487274165dac tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:09:16.373327 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-3aaee9ff-630c-484e-9d50-487274165dac tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:09:16.387267 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: INFO nova.api.openstack.wsgi [None req-3aaee9ff-630c-484e-9d50-487274165dac tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] HTTP exception thrown: Instance 201433d5-db4e-4e57-a800-42fe5cfc95ca could not be found. Sep 24 05:09:16.388858 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-3aaee9ff-630c-484e-9d50-487274165dac tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Request method failure captured: Sep 24 05:09:16.388858 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: request: GET /compute/v2.1/servers/201433d5-db4e-4e57-a800-42fe5cfc95ca HTTP/1.1 Sep 24 05:09:16.388858 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: Accept: application/json Sep 24 05:09:16.388858 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: Accept-Encoding: identity Sep 24 05:09:16.388858 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: Connection: close Sep 24 05:09:16.388858 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: Content-Length: 0 Sep 24 05:09:16.388858 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: Content-Type: application/json Sep 24 05:09:16.388858 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: Host: 10.222.0.50 Sep 24 05:09:16.388858 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: Openstack-System-Scope: None Sep 24 05:09:16.388858 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: User-Agent: python-urllib3/1.26.12 Sep 24 05:09:16.388858 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: X-Auth-Token: gAAAAABjLo8KJCPvHtvWyKaOwXAaewqfKJp-c56tHrqhjOY7vtWfARY07rjbw-W3QgTA2kDEaQgMq3ex8QYwhqyDv3WoWsnpjVPsFiqcb7HeDBvc5PhwgKBF3RB3Cu-UrcKVmBtV6eiqI3YpZ_J_-BmGo2bP4YmrVUCEd9XZC45eF-x5INM7y8Q Sep 24 05:09:16.388858 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: X-Domain-Id: None Sep 24 05:09:16.388858 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: X-Domain-Name: None Sep 24 05:09:16.388858 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: X-Identity-Status: Confirmed Sep 24 05:09:16.388858 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: X-Is-Admin-Project: True Sep 24 05:09:16.388858 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: X-Project-Domain-Id: default Sep 24 05:09:16.388858 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: X-Project-Domain-Name: Default Sep 24 05:09:16.388858 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: X-Project-Id: 87d5229e39fe4817b5187068d8acecc7 Sep 24 05:09:16.388858 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: X-Project-Name: tempest-AttachVolumeNegativeTest-993993432 Sep 24 05:09:16.388858 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: X-Role: member,reader Sep 24 05:09:16.388858 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: X-Roles: member,reader Sep 24 05:09:16.390208 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/87d5229e39fe4817b5187068d8acecc7"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/87d5229e39fe4817b5187068d8acecc7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/87d5229e39fe4817b5187068d8acecc7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.50:8080", "publicURL": "http://10.222.0.50:8080/v1/AUTH_87d5229e39fe4817b5187068d8acecc7"}]}] Sep 24 05:09:16.390208 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: X-Tenant: tempest-AttachVolumeNegativeTest-993993432 Sep 24 05:09:16.390208 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: X-Tenant-Id: 87d5229e39fe4817b5187068d8acecc7 Sep 24 05:09:16.390208 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-993993432 Sep 24 05:09:16.390208 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: X-User: tempest-AttachVolumeNegativeTest-993993432-project Sep 24 05:09:16.390208 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: X-User-Domain-Id: default Sep 24 05:09:16.390208 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: X-User-Domain-Name: Default Sep 24 05:09:16.390208 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: X-User-Id: 74a8cc19ab204424ab23c62915ac2bab Sep 24 05:09:16.390208 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: X-User-Name: tempest-AttachVolumeNegativeTest-993993432-project Sep 24 05:09:16.390208 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: method: > Sep 24 05:09:16.390208 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: exception: Instance 201433d5-db4e-4e57-a800-42fe5cfc95ca could not be found. Sep 24 05:09:16.390208 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: action_args: {'id': '201433d5-db4e-4e57-a800-42fe5cfc95ca'} Sep 24 05:09:16.390959 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 24 05:09:16.390959 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 05:09:16.390959 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 24 05:09:16.390959 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 24 05:09:16.390959 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 24 05:09:16.390959 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 24 05:09:16.390959 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 24 05:09:16.390959 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 24 05:09:16.390959 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 24 05:09:16.390959 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 24 05:09:16.390959 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 201433d5-db4e-4e57-a800-42fe5cfc95ca could not be found. Sep 24 05:09:16.390959 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi Sep 24 05:09:16.390959 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 05:09:16.390959 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi Sep 24 05:09:16.390959 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 05:09:16.390959 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 05:09:16.390959 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 05:09:16.390959 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 24 05:09:16.390959 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 24 05:09:16.390959 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 24 05:09:16.392794 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 24 05:09:16.392794 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 24 05:09:16.392794 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 24 05:09:16.392794 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 24 05:09:16.392794 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 24 05:09:16.392794 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 24 05:09:16.392794 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 24 05:09:16.392794 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 201433d5-db4e-4e57-a800-42fe5cfc95ca could not be found. Sep 24 05:09:16.392794 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi Sep 24 05:09:16.392794 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 05:09:16.392794 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi Sep 24 05:09:16.392794 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 05:09:16.392794 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 05:09:16.392794 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 05:09:16.392794 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 24 05:09:16.392794 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 24 05:09:16.392794 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 201433d5-db4e-4e57-a800-42fe5cfc95ca could not be found. Sep 24 05:09:16.392794 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi Sep 24 05:09:16.395352 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-3aaee9ff-630c-484e-9d50-487274165dac tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Returning 404 to user: Instance 201433d5-db4e-4e57-a800-42fe5cfc95ca could not be found. {{(pid=120594) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 24 05:09:16.395352 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [None req-3aaee9ff-630c-484e-9d50-487274165dac tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] 10.222.0.50 "GET /compute/v2.1/servers/201433d5-db4e-4e57-a800-42fe5cfc95ca" status: 404 len: 111 microversion: 2.1 time: 0.030551 Sep 24 05:09:16.395352 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 469/910] 10.222.0.50 () {58 vars in 1236 bytes} [Sat Sep 24 05:09:16 2022] GET /compute/v2.1/servers/201433d5-db4e-4e57-a800-42fe5cfc95ca => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 24 05:09:16.399731 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-ecfd04f2-d9b5-424d-bc53-dd1b9fa0abbf tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Calling method '.version_select at 0x7f79505e7430>' {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:09:16.418466 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-ecfd04f2-d9b5-424d-bc53-dd1b9fa0abbf tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] 10.222.0.50 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1733771919" status: 202 len: 0 microversion: 2.1 time: 0.022918 Sep 24 05:09:16.419046 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 442/911] 10.222.0.50 () {58 vars in 1221 bytes} [Sat Sep 24 05:09:16 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1733771919 => generated 0 bytes in 24 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 24 05:09:16.918765 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-bfe5c3b6-9202-463f-8268-f47b805588c0 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Calling method '>' {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:09:16.919817 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.compute.api [None req-bfe5c3b6-9202-463f-8268-f47b805588c0 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] [instance: 3e1c080b-492d-4c55-880a-14e89c938fce] Fetching instance by UUID {{(pid=120594) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:09:16.927673 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-bfe5c3b6-9202-463f-8268-f47b805588c0 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:09:16.928365 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-bfe5c3b6-9202-463f-8268-f47b805588c0 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:09:16.929001 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-bfe5c3b6-9202-463f-8268-f47b805588c0 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:09:16.929794 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-bfe5c3b6-9202-463f-8268-f47b805588c0 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:09:16.930305 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-bfe5c3b6-9202-463f-8268-f47b805588c0 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:09:16.930956 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-bfe5c3b6-9202-463f-8268-f47b805588c0 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:09:17.036881 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.objects.instance [None req-bfe5c3b6-9202-463f-8268-f47b805588c0 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Lazy-loading 'services' on Instance uuid 3e1c080b-492d-4c55-880a-14e89c938fce {{(pid=120594) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 24 05:09:17.037105 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [req-809b38dd-79f3-4d14-be0f-23fda105f3d1 req-d5ee4beb-f0e0-4e0a-b20e-f355fb09c03d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "36f8e098-a4b5-40a4-8f49-f341c5ad940c", "tag": "e1514bf0-06bf-454f-bb1a-b1c69713927f"}]} {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 05:09:17.050660 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [req-809b38dd-79f3-4d14-be0f-23fda105f3d1 req-d5ee4beb-f0e0-4e0a-b20e-f355fb09c03d service nova] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:09:17.051384 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [req-809b38dd-79f3-4d14-be0f-23fda105f3d1 req-d5ee4beb-f0e0-4e0a-b20e-f355fb09c03d service nova] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:09:17.051975 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [req-809b38dd-79f3-4d14-be0f-23fda105f3d1 req-d5ee4beb-f0e0-4e0a-b20e-f355fb09c03d service nova] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:09:17.062849 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.compute.server_external_events [req-809b38dd-79f3-4d14-be0f-23fda105f3d1 req-d5ee4beb-f0e0-4e0a-b20e-f355fb09c03d service nova] Creating event network-changed:e1514bf0-06bf-454f-bb1a-b1c69713927f for instance 36f8e098-a4b5-40a4-8f49-f341c5ad940c on hv-cinder-85918 Sep 24 05:09:17.067838 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [req-809b38dd-79f3-4d14-be0f-23fda105f3d1 req-d5ee4beb-f0e0-4e0a-b20e-f355fb09c03d service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035012 Sep 24 05:09:17.068772 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 443/912] 10.222.0.50 () {64 vars in 1317 bytes} [Sat Sep 24 05:09:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 24 05:09:17.126211 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-19beccb6-e2ad-4c29-8174-be8549c49b17 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Action: 'create', calling method: .version_select at 0x7f795064d5e0>, body: {"keypair": {"name": "tempest-keypair-576671557", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFAV3T2oIEA2FGqljKgYjEn/lmFdVh6Pw/kjPW+rxnjAOlNIU3ppTGHlCZa9uLrgKIlnK4bCLZZshczE6sPoTrrQFmFDo9YjnsuC13s8E+dg72YKsWqI443KE+GSLF0gBg=="}} {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 05:09:17.131419 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [None req-bfe5c3b6-9202-463f-8268-f47b805588c0 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] 10.222.0.50 "DELETE /compute/v2.1/servers/3e1c080b-492d-4c55-880a-14e89c938fce/os-volume_attachments/1dcf8fbf-c105-4513-b34f-0f4cb8fcca61" status: 202 len: 0 microversion: 2.1 time: 0.216338 Sep 24 05:09:17.139076 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 470/913] 10.222.0.50 () {58 vars in 1416 bytes} [Sat Sep 24 05:09:16 2022] DELETE /compute/v2.1/servers/3e1c080b-492d-4c55-880a-14e89c938fce/os-volume_attachments/1dcf8fbf-c105-4513-b34f-0f4cb8fcca61 => generated 0 bytes in 225 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 24 05:09:17.146842 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-67d75b41-38a8-4444-bcdc-cf3c4f013ece tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Calling method '>' {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:09:17.148857 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.quota [None req-19beccb6-e2ad-4c29-8174-be8549c49b17 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Getting quotas for project 87d5229e39fe4817b5187068d8acecc7. Resources: {'key_pairs'} {{(pid=120593) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 24 05:09:17.151466 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.compute.api [None req-67d75b41-38a8-4444-bcdc-cf3c4f013ece tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] [instance: 3e1c080b-492d-4c55-880a-14e89c938fce] Fetching instance by UUID {{(pid=120594) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:09:17.153481 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.quota [None req-19beccb6-e2ad-4c29-8174-be8549c49b17 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Getting quotas for user 74a8cc19ab204424ab23c62915ac2bab and project 87d5229e39fe4817b5187068d8acecc7. Resources: {'key_pairs'} {{(pid=120593) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 24 05:09:17.160693 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-67d75b41-38a8-4444-bcdc-cf3c4f013ece tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:09:17.161752 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-67d75b41-38a8-4444-bcdc-cf3c4f013ece tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:09:17.162622 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-67d75b41-38a8-4444-bcdc-cf3c4f013ece tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:09:17.163595 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-67d75b41-38a8-4444-bcdc-cf3c4f013ece tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:09:17.164551 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-67d75b41-38a8-4444-bcdc-cf3c4f013ece tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:09:17.165261 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-67d75b41-38a8-4444-bcdc-cf3c4f013ece tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:09:17.193058 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-19beccb6-e2ad-4c29-8174-be8549c49b17 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] 10.222.0.50 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.072920 Sep 24 05:09:17.193682 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 444/914] 10.222.0.50 () {60 vars in 1159 bytes} [Sat Sep 24 05:09:17 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 05:09:17.213537 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [None req-67d75b41-38a8-4444-bcdc-cf3c4f013ece tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] 10.222.0.50 "GET /compute/v2.1/servers/3e1c080b-492d-4c55-880a-14e89c938fce/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.072702 Sep 24 05:09:17.214151 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 471/915] 10.222.0.50 () {58 vars in 1302 bytes} [Sat Sep 24 05:09:17 2022] GET /compute/v2.1/servers/3e1c080b-492d-4c55-880a-14e89c938fce/os-volume_attachments => generated 197 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 05:09:18.228900 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-d0e112b4-bb7e-4f3f-8979-76afb3b50662 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Calling method '>' {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:09:18.242433 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.compute.api [None req-d0e112b4-bb7e-4f3f-8979-76afb3b50662 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] [instance: 3e1c080b-492d-4c55-880a-14e89c938fce] Fetching instance by UUID {{(pid=120593) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:09:18.251590 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-d0e112b4-bb7e-4f3f-8979-76afb3b50662 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:09:18.252085 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-d0e112b4-bb7e-4f3f-8979-76afb3b50662 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:09:18.253018 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-d0e112b4-bb7e-4f3f-8979-76afb3b50662 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:09:18.253955 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-d0e112b4-bb7e-4f3f-8979-76afb3b50662 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:09:18.254603 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-d0e112b4-bb7e-4f3f-8979-76afb3b50662 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:09:18.255034 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-d0e112b4-bb7e-4f3f-8979-76afb3b50662 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:09:18.287997 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-d0e112b4-bb7e-4f3f-8979-76afb3b50662 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] 10.222.0.50 "GET /compute/v2.1/servers/3e1c080b-492d-4c55-880a-14e89c938fce/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.064154 Sep 24 05:09:18.288536 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 445/916] 10.222.0.50 () {58 vars in 1302 bytes} [Sat Sep 24 05:09:18 2022] GET /compute/v2.1/servers/3e1c080b-492d-4c55-880a-14e89c938fce/os-volume_attachments => generated 25 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 24 05:09:18.370390 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-ed2a8fbc-9203-4b03-b9ed-e330edb3549c tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Calling method '>' {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:09:18.371843 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.compute.api [None req-ed2a8fbc-9203-4b03-b9ed-e330edb3549c tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] [instance: 3e1c080b-492d-4c55-880a-14e89c938fce] Fetching instance by UUID {{(pid=120594) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:09:18.380386 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-ed2a8fbc-9203-4b03-b9ed-e330edb3549c tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:09:18.380978 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-ed2a8fbc-9203-4b03-b9ed-e330edb3549c tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:09:18.381480 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-ed2a8fbc-9203-4b03-b9ed-e330edb3549c tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:09:18.382260 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-ed2a8fbc-9203-4b03-b9ed-e330edb3549c tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:09:18.382777 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-ed2a8fbc-9203-4b03-b9ed-e330edb3549c tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:09:18.383852 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-ed2a8fbc-9203-4b03-b9ed-e330edb3549c tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:09:18.410200 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.compute.api [None req-ed2a8fbc-9203-4b03-b9ed-e330edb3549c tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] [instance: 3e1c080b-492d-4c55-880a-14e89c938fce] Going to try to terminate instance {{(pid=120594) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 24 05:09:18.489776 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [None req-ed2a8fbc-9203-4b03-b9ed-e330edb3549c tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] 10.222.0.50 "DELETE /compute/v2.1/servers/3e1c080b-492d-4c55-880a-14e89c938fce" status: 204 len: 0 microversion: 2.1 time: 0.122541 Sep 24 05:09:18.490448 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 472/917] 10.222.0.50 () {58 vars in 1239 bytes} [Sat Sep 24 05:09:18 2022] DELETE /compute/v2.1/servers/3e1c080b-492d-4c55-880a-14e89c938fce => generated 0 bytes in 124 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 24 05:09:18.498446 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-f156fe20-da4d-47ad-aa6d-834925765704 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Calling method '>' {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:09:18.499070 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.compute.api [None req-f156fe20-da4d-47ad-aa6d-834925765704 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] [instance: 3e1c080b-492d-4c55-880a-14e89c938fce] Fetching instance by UUID {{(pid=120593) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:09:18.507856 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-f156fe20-da4d-47ad-aa6d-834925765704 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:09:18.508376 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-f156fe20-da4d-47ad-aa6d-834925765704 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:09:18.508815 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-f156fe20-da4d-47ad-aa6d-834925765704 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:09:18.509772 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-f156fe20-da4d-47ad-aa6d-834925765704 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:09:18.510467 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-f156fe20-da4d-47ad-aa6d-834925765704 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:09:18.510928 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-f156fe20-da4d-47ad-aa6d-834925765704 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:09:18.650635 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-f156fe20-da4d-47ad-aa6d-834925765704 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cdd0da2c7bc4139bcd48ef36a2ee183', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a18a3756ba2b460d977f738a115ebfe0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:09:18.658034 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-f156fe20-da4d-47ad-aa6d-834925765704 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] 10.222.0.50 "GET /compute/v2.1/servers/3e1c080b-492d-4c55-880a-14e89c938fce" status: 200 len: 1689 microversion: 2.1 time: 0.163370 Sep 24 05:09:18.658909 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 446/918] 10.222.0.50 () {58 vars in 1236 bytes} [Sat Sep 24 05:09:18 2022] GET /compute/v2.1/servers/3e1c080b-492d-4c55-880a-14e89c938fce => generated 1689 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 24 05:09:18.867339 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-cadd0800-b070-44c7-b3a3-6e7f3149c43f tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1319685819", "imageRef": "75ab730a-d8cc-4ea2-b58f-0f3eb476c976", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "17f0f6dc-1b39-4c78-b39c-2031585b359a"}], "security_groups": [{"name": "tempest-securitygroup--1365620079"}], "key_name": "tempest-keypair-576671557", "user_data": "}} {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 05:09:18.967420 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.network.neutron [None req-cadd0800-b070-44c7-b3a3-6e7f3149c43f tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] validate_networks() for [('17f0f6dc-1b39-4c78-b39c-2031585b359a', None, None, None, None, None)] {{(pid=120594) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 24 05:09:19.332928 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.virt.hardware [None req-cadd0800-b070-44c7-b3a3-6e7f3149c43f tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Flavor limits 0:0:0 {{(pid=120594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 24 05:09:19.333343 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.virt.hardware [None req-cadd0800-b070-44c7-b3a3-6e7f3149c43f tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Image limits 0:0:0 {{(pid=120594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 24 05:09:19.333809 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.virt.hardware [None req-cadd0800-b070-44c7-b3a3-6e7f3149c43f tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Flavor pref 0:0:0 {{(pid=120594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 24 05:09:19.334237 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.virt.hardware [None req-cadd0800-b070-44c7-b3a3-6e7f3149c43f tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Image pref 0:0:0 {{(pid=120594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 24 05:09:19.334641 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.virt.hardware [None req-cadd0800-b070-44c7-b3a3-6e7f3149c43f tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 24 05:09:19.343119 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-cadd0800-b070-44c7-b3a3-6e7f3149c43f tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:09:19.343593 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-cadd0800-b070-44c7-b3a3-6e7f3149c43f tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:09:19.344028 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-cadd0800-b070-44c7-b3a3-6e7f3149c43f tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:09:19.344772 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-cadd0800-b070-44c7-b3a3-6e7f3149c43f tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:09:19.345215 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-cadd0800-b070-44c7-b3a3-6e7f3149c43f tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:09:19.345634 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-cadd0800-b070-44c7-b3a3-6e7f3149c43f tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:09:19.362186 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.quota [None req-cadd0800-b070-44c7-b3a3-6e7f3149c43f tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Getting quotas for project 87d5229e39fe4817b5187068d8acecc7. Resources: {'instances', 'ram', 'cores'} {{(pid=120594) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 24 05:09:19.366107 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.quota [None req-cadd0800-b070-44c7-b3a3-6e7f3149c43f tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Getting quotas for user 74a8cc19ab204424ab23c62915ac2bab and project 87d5229e39fe4817b5187068d8acecc7. Resources: {'instances', 'ram', 'cores'} {{(pid=120594) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 24 05:09:19.376745 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.compute.api [None req-cadd0800-b070-44c7-b3a3-6e7f3149c43f tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Going to run 1 instances... {{(pid=120594) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 24 05:09:19.379725 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.compute.api [None req-cadd0800-b070-44c7-b3a3-6e7f3149c43f tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] [instance: 87b5a30a-8b76-44d0-a014-23e753d0835f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='75ab730a-d8cc-4ea2-b58f-0f3eb476c976',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120594) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 24 05:09:19.426477 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [None req-cadd0800-b070-44c7-b3a3-6e7f3149c43f tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.563624 Sep 24 05:09:19.427123 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 473/919] 10.222.0.50 () {60 vars in 1147 bytes} [Sat Sep 24 05:09:18 2022] POST /compute/v2.1/servers => generated 402 bytes in 566 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 24 05:09:19.438048 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-79863949-b259-4fea-976c-a0c731b7705e tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Calling method '>' {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:09:19.438662 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.compute.api [None req-79863949-b259-4fea-976c-a0c731b7705e tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] [instance: 87b5a30a-8b76-44d0-a014-23e753d0835f] Fetching instance by UUID {{(pid=120593) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:09:19.491309 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-79863949-b259-4fea-976c-a0c731b7705e tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74a8cc19ab204424ab23c62915ac2bab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87d5229e39fe4817b5187068d8acecc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:09:19.498089 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-79863949-b259-4fea-976c-a0c731b7705e tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] 10.222.0.50 "GET /compute/v2.1/servers/87b5a30a-8b76-44d0-a014-23e753d0835f" status: 200 len: 1241 microversion: 2.1 time: 0.063863 Sep 24 05:09:19.498680 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 447/920] 10.222.0.50 () {58 vars in 1236 bytes} [Sat Sep 24 05:09:19 2022] GET /compute/v2.1/servers/87b5a30a-8b76-44d0-a014-23e753d0835f => generated 1241 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 05:09:19.681304 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-74411730-45d4-4579-b8f3-49fb041f63cb tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Calling method '>' {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:09:19.681924 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.compute.api [None req-74411730-45d4-4579-b8f3-49fb041f63cb tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] [instance: 3e1c080b-492d-4c55-880a-14e89c938fce] Fetching instance by UUID {{(pid=120594) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:09:19.687936 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-74411730-45d4-4579-b8f3-49fb041f63cb tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:09:19.688423 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-74411730-45d4-4579-b8f3-49fb041f63cb tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:09:19.688854 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-74411730-45d4-4579-b8f3-49fb041f63cb tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:09:19.689539 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-74411730-45d4-4579-b8f3-49fb041f63cb tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:09:19.690659 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-74411730-45d4-4579-b8f3-49fb041f63cb tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:09:19.691091 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-74411730-45d4-4579-b8f3-49fb041f63cb tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:09:19.834394 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.policy [None req-74411730-45d4-4579-b8f3-49fb041f63cb tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cdd0da2c7bc4139bcd48ef36a2ee183', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a18a3756ba2b460d977f738a115ebfe0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:09:19.841954 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [None req-74411730-45d4-4579-b8f3-49fb041f63cb tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] 10.222.0.50 "GET /compute/v2.1/servers/3e1c080b-492d-4c55-880a-14e89c938fce" status: 200 len: 1689 microversion: 2.1 time: 0.164653 Sep 24 05:09:19.842541 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 474/921] 10.222.0.50 () {58 vars in 1236 bytes} [Sat Sep 24 05:09:19 2022] GET /compute/v2.1/servers/3e1c080b-492d-4c55-880a-14e89c938fce => generated 1689 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 05:09:20.521962 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-2b95656e-fd9a-4fdc-abb9-244b249deda8 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Calling method '>' {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:09:20.522615 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.compute.api [None req-2b95656e-fd9a-4fdc-abb9-244b249deda8 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] [instance: 87b5a30a-8b76-44d0-a014-23e753d0835f] Fetching instance by UUID {{(pid=120593) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:09:20.529927 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-2b95656e-fd9a-4fdc-abb9-244b249deda8 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:09:20.530426 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-2b95656e-fd9a-4fdc-abb9-244b249deda8 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:09:20.530855 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-2b95656e-fd9a-4fdc-abb9-244b249deda8 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:09:20.531800 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-2b95656e-fd9a-4fdc-abb9-244b249deda8 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:09:20.532242 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-2b95656e-fd9a-4fdc-abb9-244b249deda8 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:09:20.532656 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-2b95656e-fd9a-4fdc-abb9-244b249deda8 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:09:20.591258 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-2b95656e-fd9a-4fdc-abb9-244b249deda8 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74a8cc19ab204424ab23c62915ac2bab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87d5229e39fe4817b5187068d8acecc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:09:20.598722 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-2b95656e-fd9a-4fdc-abb9-244b249deda8 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] 10.222.0.50 "GET /compute/v2.1/servers/87b5a30a-8b76-44d0-a014-23e753d0835f" status: 200 len: 1245 microversion: 2.1 time: 0.081225 Sep 24 05:09:20.599276 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 448/922] 10.222.0.50 () {58 vars in 1236 bytes} [Sat Sep 24 05:09:20 2022] GET /compute/v2.1/servers/87b5a30a-8b76-44d0-a014-23e753d0835f => generated 1245 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 05:09:20.865478 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-64292c78-b151-4448-b8ed-386d512ccd4c tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Calling method '>' {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:09:20.866150 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.compute.api [None req-64292c78-b151-4448-b8ed-386d512ccd4c tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] [instance: 3e1c080b-492d-4c55-880a-14e89c938fce] Fetching instance by UUID {{(pid=120594) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:09:20.872438 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-64292c78-b151-4448-b8ed-386d512ccd4c tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:09:20.872920 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-64292c78-b151-4448-b8ed-386d512ccd4c tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:09:20.873356 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-64292c78-b151-4448-b8ed-386d512ccd4c tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:09:20.874065 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-64292c78-b151-4448-b8ed-386d512ccd4c tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:09:20.874519 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-64292c78-b151-4448-b8ed-386d512ccd4c tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:09:20.875151 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-64292c78-b151-4448-b8ed-386d512ccd4c tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:09:21.023005 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.policy [None req-64292c78-b151-4448-b8ed-386d512ccd4c tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cdd0da2c7bc4139bcd48ef36a2ee183', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a18a3756ba2b460d977f738a115ebfe0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:09:21.030819 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [None req-64292c78-b151-4448-b8ed-386d512ccd4c tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] 10.222.0.50 "GET /compute/v2.1/servers/3e1c080b-492d-4c55-880a-14e89c938fce" status: 200 len: 1689 microversion: 2.1 time: 0.169889 Sep 24 05:09:21.031955 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 475/923] 10.222.0.50 () {58 vars in 1236 bytes} [Sat Sep 24 05:09:20 2022] GET /compute/v2.1/servers/3e1c080b-492d-4c55-880a-14e89c938fce => generated 1689 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 05:09:21.620960 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-27e18712-39e0-4c1c-9afc-8019e799c813 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Calling method '>' {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:09:21.621575 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.compute.api [None req-27e18712-39e0-4c1c-9afc-8019e799c813 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] [instance: 87b5a30a-8b76-44d0-a014-23e753d0835f] Fetching instance by UUID {{(pid=120593) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:09:21.629795 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-27e18712-39e0-4c1c-9afc-8019e799c813 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:09:21.630597 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-27e18712-39e0-4c1c-9afc-8019e799c813 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:09:21.631031 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-27e18712-39e0-4c1c-9afc-8019e799c813 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:09:21.631727 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-27e18712-39e0-4c1c-9afc-8019e799c813 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:09:21.632209 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-27e18712-39e0-4c1c-9afc-8019e799c813 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:09:21.632634 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-27e18712-39e0-4c1c-9afc-8019e799c813 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:09:21.704081 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-27e18712-39e0-4c1c-9afc-8019e799c813 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74a8cc19ab204424ab23c62915ac2bab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87d5229e39fe4817b5187068d8acecc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:09:21.711584 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-27e18712-39e0-4c1c-9afc-8019e799c813 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] 10.222.0.50 "GET /compute/v2.1/servers/87b5a30a-8b76-44d0-a014-23e753d0835f" status: 200 len: 1293 microversion: 2.1 time: 0.094789 Sep 24 05:09:21.712342 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 449/924] 10.222.0.50 () {58 vars in 1236 bytes} [Sat Sep 24 05:09:21 2022] GET /compute/v2.1/servers/87b5a30a-8b76-44d0-a014-23e753d0835f => generated 1293 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 05:09:22.055017 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-1accfb5b-f35e-46e7-a13f-04652dfc22b3 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Calling method '>' {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:09:22.055720 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.compute.api [None req-1accfb5b-f35e-46e7-a13f-04652dfc22b3 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] [instance: 3e1c080b-492d-4c55-880a-14e89c938fce] Fetching instance by UUID {{(pid=120594) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:09:22.062413 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-1accfb5b-f35e-46e7-a13f-04652dfc22b3 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:09:22.063107 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-1accfb5b-f35e-46e7-a13f-04652dfc22b3 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:09:22.063537 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-1accfb5b-f35e-46e7-a13f-04652dfc22b3 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:09:22.064218 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-1accfb5b-f35e-46e7-a13f-04652dfc22b3 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:09:22.064662 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-1accfb5b-f35e-46e7-a13f-04652dfc22b3 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:09:22.065570 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-1accfb5b-f35e-46e7-a13f-04652dfc22b3 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:09:22.196585 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.policy [None req-1accfb5b-f35e-46e7-a13f-04652dfc22b3 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cdd0da2c7bc4139bcd48ef36a2ee183', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a18a3756ba2b460d977f738a115ebfe0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:09:22.204724 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [None req-1accfb5b-f35e-46e7-a13f-04652dfc22b3 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] 10.222.0.50 "GET /compute/v2.1/servers/3e1c080b-492d-4c55-880a-14e89c938fce" status: 200 len: 1689 microversion: 2.1 time: 0.153445 Sep 24 05:09:22.205315 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 476/925] 10.222.0.50 () {58 vars in 1236 bytes} [Sat Sep 24 05:09:22 2022] GET /compute/v2.1/servers/3e1c080b-492d-4c55-880a-14e89c938fce => generated 1689 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 24 05:09:22.734974 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-0c66bde3-5b43-4d76-aa5a-a57021f66c96 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Calling method '>' {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:09:22.735584 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.compute.api [None req-0c66bde3-5b43-4d76-aa5a-a57021f66c96 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] [instance: 87b5a30a-8b76-44d0-a014-23e753d0835f] Fetching instance by UUID {{(pid=120593) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:09:22.742594 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-0c66bde3-5b43-4d76-aa5a-a57021f66c96 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:09:22.743074 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-0c66bde3-5b43-4d76-aa5a-a57021f66c96 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:09:22.743509 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-0c66bde3-5b43-4d76-aa5a-a57021f66c96 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:09:22.744199 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-0c66bde3-5b43-4d76-aa5a-a57021f66c96 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:09:22.744648 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-0c66bde3-5b43-4d76-aa5a-a57021f66c96 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:09:22.745068 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-0c66bde3-5b43-4d76-aa5a-a57021f66c96 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:09:22.809513 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-0c66bde3-5b43-4d76-aa5a-a57021f66c96 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74a8cc19ab204424ab23c62915ac2bab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87d5229e39fe4817b5187068d8acecc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:09:22.823753 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-0c66bde3-5b43-4d76-aa5a-a57021f66c96 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] 10.222.0.50 "GET /compute/v2.1/servers/87b5a30a-8b76-44d0-a014-23e753d0835f" status: 200 len: 1299 microversion: 2.1 time: 0.092429 Sep 24 05:09:22.825401 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 450/926] 10.222.0.50 () {58 vars in 1236 bytes} [Sat Sep 24 05:09:22 2022] GET /compute/v2.1/servers/87b5a30a-8b76-44d0-a014-23e753d0835f => generated 1299 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 24 05:09:23.239382 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-bd329acc-2c33-413e-b26e-8952c14b296a tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Calling method '>' {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:09:23.239979 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [req-76b396fc-5598-4ce5-96bf-2b287dad3691 req-da184a2a-b45e-40af-b331-ab826bbfba61 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3e1c080b-492d-4c55-880a-14e89c938fce", "name": "network-vif-deleted", "tag": "a8325a52-865f-4aa2-a4eb-6cb94768def7"}]} {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 05:09:23.242596 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.compute.api [None req-bd329acc-2c33-413e-b26e-8952c14b296a tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] [instance: 3e1c080b-492d-4c55-880a-14e89c938fce] Fetching instance by UUID {{(pid=120594) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:09:23.260438 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-bd329acc-2c33-413e-b26e-8952c14b296a tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:09:23.260919 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-bd329acc-2c33-413e-b26e-8952c14b296a tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:09:23.261348 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-bd329acc-2c33-413e-b26e-8952c14b296a tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:09:23.267190 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-bd329acc-2c33-413e-b26e-8952c14b296a tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:09:23.267671 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-bd329acc-2c33-413e-b26e-8952c14b296a tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:09:23.269974 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-bd329acc-2c33-413e-b26e-8952c14b296a tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:09:23.273234 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [req-76b396fc-5598-4ce5-96bf-2b287dad3691 req-da184a2a-b45e-40af-b331-ab826bbfba61 service nova] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:09:23.273719 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [req-76b396fc-5598-4ce5-96bf-2b287dad3691 req-da184a2a-b45e-40af-b331-ab826bbfba61 service nova] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:09:23.274198 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [req-76b396fc-5598-4ce5-96bf-2b287dad3691 req-da184a2a-b45e-40af-b331-ab826bbfba61 service nova] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:09:23.290426 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.compute.server_external_events [req-76b396fc-5598-4ce5-96bf-2b287dad3691 req-da184a2a-b45e-40af-b331-ab826bbfba61 service nova] Creating event network-vif-deleted:a8325a52-865f-4aa2-a4eb-6cb94768def7 for instance 3e1c080b-492d-4c55-880a-14e89c938fce on hv-cinder-85918 Sep 24 05:09:23.325943 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [req-76b396fc-5598-4ce5-96bf-2b287dad3691 req-da184a2a-b45e-40af-b331-ab826bbfba61 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.097745 Sep 24 05:09:23.338255 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 451/927] 10.222.0.50 () {64 vars in 1317 bytes} [Sat Sep 24 05:09:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 05:09:23.403878 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.policy [None req-bd329acc-2c33-413e-b26e-8952c14b296a tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cdd0da2c7bc4139bcd48ef36a2ee183', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a18a3756ba2b460d977f738a115ebfe0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:09:23.422864 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [None req-bd329acc-2c33-413e-b26e-8952c14b296a tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] 10.222.0.50 "GET /compute/v2.1/servers/3e1c080b-492d-4c55-880a-14e89c938fce" status: 200 len: 1622 microversion: 2.1 time: 0.196085 Sep 24 05:09:23.425745 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 477/928] 10.222.0.50 () {58 vars in 1236 bytes} [Sat Sep 24 05:09:23 2022] GET /compute/v2.1/servers/3e1c080b-492d-4c55-880a-14e89c938fce => generated 1622 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 05:09:23.848623 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-60c6f625-d5b9-43ee-98f5-86cf8b0a10b8 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Calling method '>' {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:09:23.849237 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.compute.api [None req-60c6f625-d5b9-43ee-98f5-86cf8b0a10b8 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] [instance: 87b5a30a-8b76-44d0-a014-23e753d0835f] Fetching instance by UUID {{(pid=120593) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:09:23.857483 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-60c6f625-d5b9-43ee-98f5-86cf8b0a10b8 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:09:23.858357 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-60c6f625-d5b9-43ee-98f5-86cf8b0a10b8 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:09:23.859626 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-60c6f625-d5b9-43ee-98f5-86cf8b0a10b8 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:09:23.860669 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-60c6f625-d5b9-43ee-98f5-86cf8b0a10b8 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:09:23.861284 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-60c6f625-d5b9-43ee-98f5-86cf8b0a10b8 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:09:23.862635 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-60c6f625-d5b9-43ee-98f5-86cf8b0a10b8 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:09:24.013979 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-60c6f625-d5b9-43ee-98f5-86cf8b0a10b8 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74a8cc19ab204424ab23c62915ac2bab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87d5229e39fe4817b5187068d8acecc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:09:24.024369 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-60c6f625-d5b9-43ee-98f5-86cf8b0a10b8 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] 10.222.0.50 "GET /compute/v2.1/servers/87b5a30a-8b76-44d0-a014-23e753d0835f" status: 200 len: 1367 microversion: 2.1 time: 0.180662 Sep 24 05:09:24.024948 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 452/929] 10.222.0.50 () {58 vars in 1236 bytes} [Sat Sep 24 05:09:23 2022] GET /compute/v2.1/servers/87b5a30a-8b76-44d0-a014-23e753d0835f => generated 1367 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 05:09:24.448655 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-0d7639eb-3662-4fbe-a243-b5073b0ae79d tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Calling method '>' {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:09:24.449242 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.compute.api [None req-0d7639eb-3662-4fbe-a243-b5073b0ae79d tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] [instance: 3e1c080b-492d-4c55-880a-14e89c938fce] Fetching instance by UUID {{(pid=120594) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:09:24.456724 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-0d7639eb-3662-4fbe-a243-b5073b0ae79d tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:09:24.457180 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-0d7639eb-3662-4fbe-a243-b5073b0ae79d tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:09:24.457721 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-0d7639eb-3662-4fbe-a243-b5073b0ae79d tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:09:24.458582 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-0d7639eb-3662-4fbe-a243-b5073b0ae79d tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:09:24.459037 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-0d7639eb-3662-4fbe-a243-b5073b0ae79d tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:09:24.459465 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-0d7639eb-3662-4fbe-a243-b5073b0ae79d tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:09:24.474260 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: INFO nova.api.openstack.wsgi [None req-0d7639eb-3662-4fbe-a243-b5073b0ae79d tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] HTTP exception thrown: Instance 3e1c080b-492d-4c55-880a-14e89c938fce could not be found. Sep 24 05:09:24.475904 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-0d7639eb-3662-4fbe-a243-b5073b0ae79d tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Request method failure captured: Sep 24 05:09:24.475904 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: request: GET /compute/v2.1/servers/3e1c080b-492d-4c55-880a-14e89c938fce HTTP/1.1 Sep 24 05:09:24.475904 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: Accept: application/json Sep 24 05:09:24.475904 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: Accept-Encoding: identity Sep 24 05:09:24.475904 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: Connection: close Sep 24 05:09:24.475904 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: Content-Length: 0 Sep 24 05:09:24.475904 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: Content-Type: application/json Sep 24 05:09:24.475904 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: Host: 10.222.0.50 Sep 24 05:09:24.475904 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: Openstack-System-Scope: None Sep 24 05:09:24.475904 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: User-Agent: python-urllib3/1.26.12 Sep 24 05:09:24.475904 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: X-Auth-Token: gAAAAABjLo8HTzNG_FPeaRlb1iKtn70N4qXi3bCZUsBH5ev83dMKRgyc3ir4exWyX_HELoYhUZuaNsGC0Iz7uIZoAOnFSUT1gUYQNLBWBHD4Hr9Zo2LmNKYYpHEOSNBOqs6trhPvBX0Mbw8c_gmqJ1Foarii5zl7NKWXL_yy02zfSiE1i-m0pa8 Sep 24 05:09:24.475904 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: X-Domain-Id: None Sep 24 05:09:24.475904 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: X-Domain-Name: None Sep 24 05:09:24.475904 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: X-Identity-Status: Confirmed Sep 24 05:09:24.475904 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: X-Is-Admin-Project: True Sep 24 05:09:24.475904 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: X-Project-Domain-Id: default Sep 24 05:09:24.475904 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: X-Project-Domain-Name: Default Sep 24 05:09:24.475904 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: X-Project-Id: a18a3756ba2b460d977f738a115ebfe0 Sep 24 05:09:24.475904 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1841571325 Sep 24 05:09:24.475904 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: X-Role: member,reader Sep 24 05:09:24.475904 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: X-Roles: member,reader Sep 24 05:09:24.477483 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/a18a3756ba2b460d977f738a115ebfe0"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/a18a3756ba2b460d977f738a115ebfe0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/a18a3756ba2b460d977f738a115ebfe0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.50:8080", "publicURL": "http://10.222.0.50:8080/v1/AUTH_a18a3756ba2b460d977f738a115ebfe0"}]}] Sep 24 05:09:24.477483 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1841571325 Sep 24 05:09:24.477483 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: X-Tenant-Id: a18a3756ba2b460d977f738a115ebfe0 Sep 24 05:09:24.477483 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1841571325 Sep 24 05:09:24.477483 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: X-User: tempest-ServerRescueNegativeTestJSON-1841571325-project Sep 24 05:09:24.477483 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: X-User-Domain-Id: default Sep 24 05:09:24.477483 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: X-User-Domain-Name: Default Sep 24 05:09:24.477483 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: X-User-Id: 8cdd0da2c7bc4139bcd48ef36a2ee183 Sep 24 05:09:24.477483 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1841571325-project Sep 24 05:09:24.477483 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: method: > Sep 24 05:09:24.477483 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: exception: Instance 3e1c080b-492d-4c55-880a-14e89c938fce could not be found. Sep 24 05:09:24.477483 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: action_args: {'id': '3e1c080b-492d-4c55-880a-14e89c938fce'} Sep 24 05:09:24.478410 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 24 05:09:24.478410 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 05:09:24.478410 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 24 05:09:24.478410 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 24 05:09:24.478410 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 24 05:09:24.478410 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 24 05:09:24.478410 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 24 05:09:24.478410 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 24 05:09:24.478410 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 24 05:09:24.478410 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 24 05:09:24.478410 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3e1c080b-492d-4c55-880a-14e89c938fce could not be found. Sep 24 05:09:24.478410 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi Sep 24 05:09:24.478410 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 05:09:24.478410 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi Sep 24 05:09:24.478410 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 05:09:24.478410 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 05:09:24.478410 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 05:09:24.478410 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 24 05:09:24.478410 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 24 05:09:24.478410 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 24 05:09:24.479618 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 24 05:09:24.479618 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 24 05:09:24.479618 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 24 05:09:24.479618 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 24 05:09:24.479618 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 24 05:09:24.479618 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 24 05:09:24.479618 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 24 05:09:24.479618 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3e1c080b-492d-4c55-880a-14e89c938fce could not be found. Sep 24 05:09:24.479618 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi Sep 24 05:09:24.479618 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 05:09:24.479618 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi Sep 24 05:09:24.479618 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 05:09:24.479618 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 05:09:24.479618 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 05:09:24.479618 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 24 05:09:24.479618 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 24 05:09:24.479618 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3e1c080b-492d-4c55-880a-14e89c938fce could not be found. Sep 24 05:09:24.479618 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi Sep 24 05:09:24.480680 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-0d7639eb-3662-4fbe-a243-b5073b0ae79d tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Returning 404 to user: Instance 3e1c080b-492d-4c55-880a-14e89c938fce could not be found. {{(pid=120594) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 24 05:09:24.480680 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [None req-0d7639eb-3662-4fbe-a243-b5073b0ae79d tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] 10.222.0.50 "GET /compute/v2.1/servers/3e1c080b-492d-4c55-880a-14e89c938fce" status: 404 len: 111 microversion: 2.1 time: 0.033278 Sep 24 05:09:24.480680 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 478/930] 10.222.0.50 () {58 vars in 1236 bytes} [Sat Sep 24 05:09:24 2022] GET /compute/v2.1/servers/3e1c080b-492d-4c55-880a-14e89c938fce => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 24 05:09:24.488899 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-6c337807-f068-4f7b-9483-0ed8adc4f79f tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Calling method '.version_select at 0x7f7950830430>' {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:09:24.509675 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-6c337807-f068-4f7b-9483-0ed8adc4f79f tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] 10.222.0.50 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-859445215" status: 202 len: 0 microversion: 2.1 time: 0.026538 Sep 24 05:09:24.510382 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 453/931] 10.222.0.50 () {58 vars in 1218 bytes} [Sat Sep 24 05:09:24 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-859445215 => generated 0 bytes in 28 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 24 05:09:25.052789 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-d1fbf8d4-13f3-4c88-883d-9f33efdf478b tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Calling method '>' {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:09:25.053400 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.compute.api [None req-d1fbf8d4-13f3-4c88-883d-9f33efdf478b tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] [instance: 87b5a30a-8b76-44d0-a014-23e753d0835f] Fetching instance by UUID {{(pid=120594) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:09:25.059281 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-d1fbf8d4-13f3-4c88-883d-9f33efdf478b tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:09:25.059760 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-d1fbf8d4-13f3-4c88-883d-9f33efdf478b tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:09:25.060199 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-d1fbf8d4-13f3-4c88-883d-9f33efdf478b tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:09:25.060892 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-d1fbf8d4-13f3-4c88-883d-9f33efdf478b tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:09:25.061337 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-d1fbf8d4-13f3-4c88-883d-9f33efdf478b tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:09:25.061753 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-d1fbf8d4-13f3-4c88-883d-9f33efdf478b tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:09:25.196835 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.policy [None req-d1fbf8d4-13f3-4c88-883d-9f33efdf478b tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74a8cc19ab204424ab23c62915ac2bab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87d5229e39fe4817b5187068d8acecc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:09:25.204601 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [None req-d1fbf8d4-13f3-4c88-883d-9f33efdf478b tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] 10.222.0.50 "GET /compute/v2.1/servers/87b5a30a-8b76-44d0-a014-23e753d0835f" status: 200 len: 1367 microversion: 2.1 time: 0.156306 Sep 24 05:09:25.205153 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 479/932] 10.222.0.50 () {58 vars in 1236 bytes} [Sat Sep 24 05:09:25 2022] GET /compute/v2.1/servers/87b5a30a-8b76-44d0-a014-23e753d0835f => generated 1367 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 05:09:25.356562 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [req-0b391a31-7932-45a4-975d-c6dd87989929 req-5126d2d7-d1f4-486c-bc78-88374756c079 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "87b5a30a-8b76-44d0-a014-23e753d0835f", "tag": "69742a41-eeea-432a-8f65-c86e8714c51a"}]} {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 05:09:25.369419 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [req-0b391a31-7932-45a4-975d-c6dd87989929 req-5126d2d7-d1f4-486c-bc78-88374756c079 service nova] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:09:25.369894 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [req-0b391a31-7932-45a4-975d-c6dd87989929 req-5126d2d7-d1f4-486c-bc78-88374756c079 service nova] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:09:25.370352 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [req-0b391a31-7932-45a4-975d-c6dd87989929 req-5126d2d7-d1f4-486c-bc78-88374756c079 service nova] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:09:25.380375 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.compute.server_external_events [req-0b391a31-7932-45a4-975d-c6dd87989929 req-5126d2d7-d1f4-486c-bc78-88374756c079 service nova] Creating event network-changed:69742a41-eeea-432a-8f65-c86e8714c51a for instance 87b5a30a-8b76-44d0-a014-23e753d0835f on hv-cinder-85918 Sep 24 05:09:25.385363 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [req-0b391a31-7932-45a4-975d-c6dd87989929 req-5126d2d7-d1f4-486c-bc78-88374756c079 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032562 Sep 24 05:09:25.385943 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 454/933] 10.222.0.50 () {64 vars in 1317 bytes} [Sat Sep 24 05:09:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 05:09:26.226661 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-5bb519a9-b1ad-4219-99ce-fa5708b888e8 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Calling method '>' {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:09:26.227265 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.compute.api [None req-5bb519a9-b1ad-4219-99ce-fa5708b888e8 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] [instance: 87b5a30a-8b76-44d0-a014-23e753d0835f] Fetching instance by UUID {{(pid=120594) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:09:26.233915 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-5bb519a9-b1ad-4219-99ce-fa5708b888e8 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:09:26.234420 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-5bb519a9-b1ad-4219-99ce-fa5708b888e8 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:09:26.234845 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-5bb519a9-b1ad-4219-99ce-fa5708b888e8 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:09:26.235529 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-5bb519a9-b1ad-4219-99ce-fa5708b888e8 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:09:26.235971 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-5bb519a9-b1ad-4219-99ce-fa5708b888e8 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:09:26.236385 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-5bb519a9-b1ad-4219-99ce-fa5708b888e8 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:09:26.370986 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.policy [None req-5bb519a9-b1ad-4219-99ce-fa5708b888e8 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74a8cc19ab204424ab23c62915ac2bab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87d5229e39fe4817b5187068d8acecc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:09:26.379257 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [None req-5bb519a9-b1ad-4219-99ce-fa5708b888e8 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] 10.222.0.50 "GET /compute/v2.1/servers/87b5a30a-8b76-44d0-a014-23e753d0835f" status: 200 len: 1367 microversion: 2.1 time: 0.156365 Sep 24 05:09:26.379820 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 480/934] 10.222.0.50 () {58 vars in 1236 bytes} [Sat Sep 24 05:09:26 2022] GET /compute/v2.1/servers/87b5a30a-8b76-44d0-a014-23e753d0835f => generated 1367 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 05:09:27.371830 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-f78e3217-1df1-4ebe-8129-4163d00b6173 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Calling method '>' {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:09:27.372408 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.compute.api [None req-f78e3217-1df1-4ebe-8129-4163d00b6173 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] [instance: 50eed27b-6da2-4dda-94cc-02fc5cfec071] Fetching instance by UUID {{(pid=120593) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:09:27.379425 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-f78e3217-1df1-4ebe-8129-4163d00b6173 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:09:27.379900 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-f78e3217-1df1-4ebe-8129-4163d00b6173 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:09:27.380333 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-f78e3217-1df1-4ebe-8129-4163d00b6173 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:09:27.381009 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-f78e3217-1df1-4ebe-8129-4163d00b6173 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:09:27.381456 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-f78e3217-1df1-4ebe-8129-4163d00b6173 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:09:27.381880 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-f78e3217-1df1-4ebe-8129-4163d00b6173 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:09:27.400650 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-39c4f124-109b-4237-b959-6cb99d8b1f90 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Calling method '>' {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:09:27.401247 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.compute.api [None req-39c4f124-109b-4237-b959-6cb99d8b1f90 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] [instance: 87b5a30a-8b76-44d0-a014-23e753d0835f] Fetching instance by UUID {{(pid=120594) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:09:27.407561 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.compute.api [None req-f78e3217-1df1-4ebe-8129-4163d00b6173 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] [instance: 50eed27b-6da2-4dda-94cc-02fc5cfec071] Going to try to terminate instance {{(pid=120593) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 24 05:09:27.407933 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-39c4f124-109b-4237-b959-6cb99d8b1f90 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:09:27.408404 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-39c4f124-109b-4237-b959-6cb99d8b1f90 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:09:27.408874 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-39c4f124-109b-4237-b959-6cb99d8b1f90 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:09:27.409560 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-39c4f124-109b-4237-b959-6cb99d8b1f90 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:09:27.410018 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-39c4f124-109b-4237-b959-6cb99d8b1f90 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:09:27.410443 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-39c4f124-109b-4237-b959-6cb99d8b1f90 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:09:27.484078 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-f78e3217-1df1-4ebe-8129-4163d00b6173 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] 10.222.0.50 "DELETE /compute/v2.1/servers/50eed27b-6da2-4dda-94cc-02fc5cfec071" status: 204 len: 0 microversion: 2.1 time: 0.115980 Sep 24 05:09:27.484919 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 455/935] 10.222.0.50 () {58 vars in 1239 bytes} [Sat Sep 24 05:09:27 2022] DELETE /compute/v2.1/servers/50eed27b-6da2-4dda-94cc-02fc5cfec071 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 24 05:09:27.492938 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-f2f13445-49ce-4ea1-aae8-3696003b713c tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Calling method '>' {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:09:27.493616 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.compute.api [None req-f2f13445-49ce-4ea1-aae8-3696003b713c tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] [instance: 50eed27b-6da2-4dda-94cc-02fc5cfec071] Fetching instance by UUID {{(pid=120593) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:09:27.499341 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-f2f13445-49ce-4ea1-aae8-3696003b713c tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:09:27.499820 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-f2f13445-49ce-4ea1-aae8-3696003b713c tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:09:27.500253 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-f2f13445-49ce-4ea1-aae8-3696003b713c tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:09:27.500934 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-f2f13445-49ce-4ea1-aae8-3696003b713c tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:09:27.501376 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-f2f13445-49ce-4ea1-aae8-3696003b713c tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:09:27.501794 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-f2f13445-49ce-4ea1-aae8-3696003b713c tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:09:27.557115 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.policy [None req-39c4f124-109b-4237-b959-6cb99d8b1f90 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74a8cc19ab204424ab23c62915ac2bab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87d5229e39fe4817b5187068d8acecc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:09:27.568476 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [None req-39c4f124-109b-4237-b959-6cb99d8b1f90 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] 10.222.0.50 "GET /compute/v2.1/servers/87b5a30a-8b76-44d0-a014-23e753d0835f" status: 200 len: 1367 microversion: 2.1 time: 0.171561 Sep 24 05:09:27.569282 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 481/936] 10.222.0.50 () {58 vars in 1236 bytes} [Sat Sep 24 05:09:27 2022] GET /compute/v2.1/servers/87b5a30a-8b76-44d0-a014-23e753d0835f => generated 1367 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 24 05:09:27.649197 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-f2f13445-49ce-4ea1-aae8-3696003b713c tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cdd0da2c7bc4139bcd48ef36a2ee183', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a18a3756ba2b460d977f738a115ebfe0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:09:27.657275 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-f2f13445-49ce-4ea1-aae8-3696003b713c tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] 10.222.0.50 "GET /compute/v2.1/servers/50eed27b-6da2-4dda-94cc-02fc5cfec071" status: 200 len: 1508 microversion: 2.1 time: 0.168005 Sep 24 05:09:27.657825 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 456/937] 10.222.0.50 () {58 vars in 1236 bytes} [Sat Sep 24 05:09:27 2022] GET /compute/v2.1/servers/50eed27b-6da2-4dda-94cc-02fc5cfec071 => generated 1508 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 24 05:09:28.591750 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-97550d61-c786-4812-9301-88466adf7a4d tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Calling method '>' {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:09:28.592320 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.compute.api [None req-97550d61-c786-4812-9301-88466adf7a4d tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] [instance: 87b5a30a-8b76-44d0-a014-23e753d0835f] Fetching instance by UUID {{(pid=120594) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:09:28.599497 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-97550d61-c786-4812-9301-88466adf7a4d tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:09:28.599989 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-97550d61-c786-4812-9301-88466adf7a4d tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:09:28.600433 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-97550d61-c786-4812-9301-88466adf7a4d tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:09:28.601131 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-97550d61-c786-4812-9301-88466adf7a4d tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:09:28.601589 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-97550d61-c786-4812-9301-88466adf7a4d tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:09:28.602116 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-97550d61-c786-4812-9301-88466adf7a4d tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:09:28.680362 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-9ad27834-b9cf-47d9-9082-fad0756322ff tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Calling method '>' {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:09:28.680975 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.compute.api [None req-9ad27834-b9cf-47d9-9082-fad0756322ff tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] [instance: 50eed27b-6da2-4dda-94cc-02fc5cfec071] Fetching instance by UUID {{(pid=120593) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:09:28.687882 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-9ad27834-b9cf-47d9-9082-fad0756322ff tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:09:28.688774 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-9ad27834-b9cf-47d9-9082-fad0756322ff tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:09:28.689275 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-9ad27834-b9cf-47d9-9082-fad0756322ff tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:09:28.690081 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-9ad27834-b9cf-47d9-9082-fad0756322ff tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:09:28.690608 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-9ad27834-b9cf-47d9-9082-fad0756322ff tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:09:28.691100 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-9ad27834-b9cf-47d9-9082-fad0756322ff tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:09:28.775132 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.policy [None req-97550d61-c786-4812-9301-88466adf7a4d tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74a8cc19ab204424ab23c62915ac2bab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87d5229e39fe4817b5187068d8acecc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:09:28.778672 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG dbcounter [-] [120594] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=120594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 05:09:28.784168 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [None req-97550d61-c786-4812-9301-88466adf7a4d tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] 10.222.0.50 "GET /compute/v2.1/servers/87b5a30a-8b76-44d0-a014-23e753d0835f" status: 200 len: 1367 microversion: 2.1 time: 0.196364 Sep 24 05:09:28.784977 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 482/938] 10.222.0.50 () {58 vars in 1236 bytes} [Sat Sep 24 05:09:28 2022] GET /compute/v2.1/servers/87b5a30a-8b76-44d0-a014-23e753d0835f => generated 1367 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 05:09:28.838722 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-9ad27834-b9cf-47d9-9082-fad0756322ff tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cdd0da2c7bc4139bcd48ef36a2ee183', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a18a3756ba2b460d977f738a115ebfe0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:09:28.846525 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-9ad27834-b9cf-47d9-9082-fad0756322ff tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] 10.222.0.50 "GET /compute/v2.1/servers/50eed27b-6da2-4dda-94cc-02fc5cfec071" status: 200 len: 1508 microversion: 2.1 time: 0.170085 Sep 24 05:09:28.847027 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 457/939] 10.222.0.50 () {58 vars in 1236 bytes} [Sat Sep 24 05:09:28 2022] GET /compute/v2.1/servers/50eed27b-6da2-4dda-94cc-02fc5cfec071 => generated 1508 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 24 05:09:29.113185 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [req-7c5686ff-1ee5-4797-a472-f48d0d7609c3 req-c56a4720-1f8d-43ea-93af-340096a9dc15 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "50eed27b-6da2-4dda-94cc-02fc5cfec071", "name": "network-vif-deleted", "tag": "990ceab0-dcdb-43e0-ab13-ed36ddfbeabf"}]} {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 05:09:29.123443 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [req-7c5686ff-1ee5-4797-a472-f48d0d7609c3 req-c56a4720-1f8d-43ea-93af-340096a9dc15 service nova] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:09:29.124189 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [req-7c5686ff-1ee5-4797-a472-f48d0d7609c3 req-c56a4720-1f8d-43ea-93af-340096a9dc15 service nova] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:09:29.124613 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [req-7c5686ff-1ee5-4797-a472-f48d0d7609c3 req-c56a4720-1f8d-43ea-93af-340096a9dc15 service nova] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:09:29.137299 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: INFO nova.api.openstack.compute.server_external_events [req-7c5686ff-1ee5-4797-a472-f48d0d7609c3 req-c56a4720-1f8d-43ea-93af-340096a9dc15 service nova] Creating event network-vif-deleted:990ceab0-dcdb-43e0-ab13-ed36ddfbeabf for instance 50eed27b-6da2-4dda-94cc-02fc5cfec071 on hv-cinder-85918 Sep 24 05:09:29.142784 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [req-7c5686ff-1ee5-4797-a472-f48d0d7609c3 req-c56a4720-1f8d-43ea-93af-340096a9dc15 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034098 Sep 24 05:09:29.143661 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 483/940] 10.222.0.50 () {64 vars in 1317 bytes} [Sat Sep 24 05:09:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 05:09:29.806663 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-4fa270c9-7129-467a-b392-cb88baab06ea tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Calling method '>' {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:09:29.807276 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.compute.api [None req-4fa270c9-7129-467a-b392-cb88baab06ea tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] [instance: 87b5a30a-8b76-44d0-a014-23e753d0835f] Fetching instance by UUID {{(pid=120593) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:09:29.809204 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG dbcounter [-] [120593] Writing DB stats nova_cell0:SELECT=6 {{(pid=120593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 05:09:29.814860 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-4fa270c9-7129-467a-b392-cb88baab06ea tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:09:29.815343 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-4fa270c9-7129-467a-b392-cb88baab06ea tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:09:29.815781 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-4fa270c9-7129-467a-b392-cb88baab06ea tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:09:29.816472 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-4fa270c9-7129-467a-b392-cb88baab06ea tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:09:29.816924 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-4fa270c9-7129-467a-b392-cb88baab06ea tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:09:29.817349 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-4fa270c9-7129-467a-b392-cb88baab06ea tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:09:29.866337 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG dbcounter [-] [120594] Writing DB stats nova_cell0:SELECT=2 {{(pid=120594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 05:09:29.867305 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG dbcounter [-] [120594] Writing DB stats nova_cell0:SELECT=6 {{(pid=120594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 05:09:29.874086 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-af2e7b53-4771-40e3-b700-ca36dd114316 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Calling method '>' {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:09:29.875862 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.compute.api [None req-af2e7b53-4771-40e3-b700-ca36dd114316 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] [instance: 50eed27b-6da2-4dda-94cc-02fc5cfec071] Fetching instance by UUID {{(pid=120594) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:09:29.885799 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-af2e7b53-4771-40e3-b700-ca36dd114316 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:09:29.886550 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-af2e7b53-4771-40e3-b700-ca36dd114316 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:09:29.886982 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-af2e7b53-4771-40e3-b700-ca36dd114316 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:09:29.887863 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-af2e7b53-4771-40e3-b700-ca36dd114316 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:09:29.888498 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-af2e7b53-4771-40e3-b700-ca36dd114316 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:09:29.888927 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-af2e7b53-4771-40e3-b700-ca36dd114316 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:09:29.924750 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-af2e7b53-4771-40e3-b700-ca36dd114316 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:09:29.925156 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-af2e7b53-4771-40e3-b700-ca36dd114316 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:09:29.925718 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-af2e7b53-4771-40e3-b700-ca36dd114316 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:09:29.926432 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.objects.instance [None req-af2e7b53-4771-40e3-b700-ca36dd114316 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Lazy-loading 'fault' on Instance uuid 50eed27b-6da2-4dda-94cc-02fc5cfec071 {{(pid=120594) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 24 05:09:29.960793 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-4fa270c9-7129-467a-b392-cb88baab06ea tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74a8cc19ab204424ab23c62915ac2bab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87d5229e39fe4817b5187068d8acecc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:09:29.968830 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-4fa270c9-7129-467a-b392-cb88baab06ea tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] 10.222.0.50 "GET /compute/v2.1/servers/87b5a30a-8b76-44d0-a014-23e753d0835f" status: 200 len: 1367 microversion: 2.1 time: 0.166013 Sep 24 05:09:29.969408 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 458/941] 10.222.0.50 () {58 vars in 1236 bytes} [Sat Sep 24 05:09:29 2022] GET /compute/v2.1/servers/87b5a30a-8b76-44d0-a014-23e753d0835f => generated 1367 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 05:09:29.981179 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.policy [None req-af2e7b53-4771-40e3-b700-ca36dd114316 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cdd0da2c7bc4139bcd48ef36a2ee183', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a18a3756ba2b460d977f738a115ebfe0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:09:29.988807 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [None req-af2e7b53-4771-40e3-b700-ca36dd114316 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] 10.222.0.50 "GET /compute/v2.1/servers/50eed27b-6da2-4dda-94cc-02fc5cfec071" status: 200 len: 1312 microversion: 2.1 time: 0.123381 Sep 24 05:09:29.989373 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 484/942] 10.222.0.50 () {58 vars in 1236 bytes} [Sat Sep 24 05:09:29 2022] GET /compute/v2.1/servers/50eed27b-6da2-4dda-94cc-02fc5cfec071 => generated 1312 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 24 05:09:30.993209 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-9ab43d7a-a379-42a1-b653-495ad75c635c tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Calling method '>' {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:09:30.993822 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.compute.api [None req-9ab43d7a-a379-42a1-b653-495ad75c635c tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] [instance: 87b5a30a-8b76-44d0-a014-23e753d0835f] Fetching instance by UUID {{(pid=120593) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:09:31.000343 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-9ab43d7a-a379-42a1-b653-495ad75c635c tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:09:31.000824 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-9ab43d7a-a379-42a1-b653-495ad75c635c tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:09:31.001264 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-9ab43d7a-a379-42a1-b653-495ad75c635c tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:09:31.001951 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-9ab43d7a-a379-42a1-b653-495ad75c635c tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:09:31.002451 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-9ab43d7a-a379-42a1-b653-495ad75c635c tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:09:31.002874 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-9ab43d7a-a379-42a1-b653-495ad75c635c tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:09:31.011103 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-78963930-4db9-4834-b22d-96dbb1f7f65e tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Calling method '>' {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:09:31.011717 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.compute.api [None req-78963930-4db9-4834-b22d-96dbb1f7f65e tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] [instance: 50eed27b-6da2-4dda-94cc-02fc5cfec071] Fetching instance by UUID {{(pid=120594) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:09:31.018065 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-78963930-4db9-4834-b22d-96dbb1f7f65e tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:09:31.018551 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-78963930-4db9-4834-b22d-96dbb1f7f65e tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:09:31.018991 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-78963930-4db9-4834-b22d-96dbb1f7f65e tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:09:31.019682 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-78963930-4db9-4834-b22d-96dbb1f7f65e tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:09:31.020135 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-78963930-4db9-4834-b22d-96dbb1f7f65e tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:09:31.020558 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-78963930-4db9-4834-b22d-96dbb1f7f65e tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:09:31.034460 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: INFO nova.api.openstack.wsgi [None req-78963930-4db9-4834-b22d-96dbb1f7f65e tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] HTTP exception thrown: Instance 50eed27b-6da2-4dda-94cc-02fc5cfec071 could not be found. Sep 24 05:09:31.036089 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-78963930-4db9-4834-b22d-96dbb1f7f65e tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Request method failure captured: Sep 24 05:09:31.036089 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: request: GET /compute/v2.1/servers/50eed27b-6da2-4dda-94cc-02fc5cfec071 HTTP/1.1 Sep 24 05:09:31.036089 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: Accept: application/json Sep 24 05:09:31.036089 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: Accept-Encoding: identity Sep 24 05:09:31.036089 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: Connection: close Sep 24 05:09:31.036089 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: Content-Length: 0 Sep 24 05:09:31.036089 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: Content-Type: application/json Sep 24 05:09:31.036089 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: Host: 10.222.0.50 Sep 24 05:09:31.036089 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: Openstack-System-Scope: None Sep 24 05:09:31.036089 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: User-Agent: python-urllib3/1.26.12 Sep 24 05:09:31.036089 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: X-Auth-Token: gAAAAABjLo8HTzNG_FPeaRlb1iKtn70N4qXi3bCZUsBH5ev83dMKRgyc3ir4exWyX_HELoYhUZuaNsGC0Iz7uIZoAOnFSUT1gUYQNLBWBHD4Hr9Zo2LmNKYYpHEOSNBOqs6trhPvBX0Mbw8c_gmqJ1Foarii5zl7NKWXL_yy02zfSiE1i-m0pa8 Sep 24 05:09:31.036089 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: X-Domain-Id: None Sep 24 05:09:31.036089 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: X-Domain-Name: None Sep 24 05:09:31.036089 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: X-Identity-Status: Confirmed Sep 24 05:09:31.036089 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: X-Is-Admin-Project: True Sep 24 05:09:31.036089 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: X-Project-Domain-Id: default Sep 24 05:09:31.036089 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: X-Project-Domain-Name: Default Sep 24 05:09:31.036089 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: X-Project-Id: a18a3756ba2b460d977f738a115ebfe0 Sep 24 05:09:31.036089 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1841571325 Sep 24 05:09:31.036089 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: X-Role: member,reader Sep 24 05:09:31.036089 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: X-Roles: member,reader Sep 24 05:09:31.037707 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/a18a3756ba2b460d977f738a115ebfe0"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/a18a3756ba2b460d977f738a115ebfe0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/a18a3756ba2b460d977f738a115ebfe0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.50:8080", "publicURL": "http://10.222.0.50:8080/v1/AUTH_a18a3756ba2b460d977f738a115ebfe0"}]}] Sep 24 05:09:31.037707 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1841571325 Sep 24 05:09:31.037707 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: X-Tenant-Id: a18a3756ba2b460d977f738a115ebfe0 Sep 24 05:09:31.037707 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1841571325 Sep 24 05:09:31.037707 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: X-User: tempest-ServerRescueNegativeTestJSON-1841571325-project Sep 24 05:09:31.037707 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: X-User-Domain-Id: default Sep 24 05:09:31.037707 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: X-User-Domain-Name: Default Sep 24 05:09:31.037707 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: X-User-Id: 8cdd0da2c7bc4139bcd48ef36a2ee183 Sep 24 05:09:31.037707 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1841571325-project Sep 24 05:09:31.037707 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: method: > Sep 24 05:09:31.037707 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: exception: Instance 50eed27b-6da2-4dda-94cc-02fc5cfec071 could not be found. Sep 24 05:09:31.037707 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: action_args: {'id': '50eed27b-6da2-4dda-94cc-02fc5cfec071'} Sep 24 05:09:31.038613 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 24 05:09:31.038613 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 05:09:31.038613 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 24 05:09:31.038613 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 24 05:09:31.038613 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 24 05:09:31.038613 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 24 05:09:31.038613 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 24 05:09:31.038613 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 24 05:09:31.038613 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 24 05:09:31.038613 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 24 05:09:31.038613 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 50eed27b-6da2-4dda-94cc-02fc5cfec071 could not be found. Sep 24 05:09:31.038613 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi Sep 24 05:09:31.038613 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 05:09:31.038613 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi Sep 24 05:09:31.038613 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 05:09:31.038613 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 05:09:31.038613 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 05:09:31.038613 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 24 05:09:31.038613 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 24 05:09:31.038613 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 24 05:09:31.040243 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 24 05:09:31.040243 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 24 05:09:31.040243 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 24 05:09:31.040243 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 24 05:09:31.040243 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 24 05:09:31.040243 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 24 05:09:31.040243 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 24 05:09:31.040243 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 50eed27b-6da2-4dda-94cc-02fc5cfec071 could not be found. Sep 24 05:09:31.040243 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi Sep 24 05:09:31.040243 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 05:09:31.040243 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi Sep 24 05:09:31.040243 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 05:09:31.040243 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 05:09:31.040243 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 05:09:31.040243 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 24 05:09:31.040243 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 24 05:09:31.040243 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 50eed27b-6da2-4dda-94cc-02fc5cfec071 could not be found. Sep 24 05:09:31.040243 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi Sep 24 05:09:31.041619 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-78963930-4db9-4834-b22d-96dbb1f7f65e tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Returning 404 to user: Instance 50eed27b-6da2-4dda-94cc-02fc5cfec071 could not be found. {{(pid=120594) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 24 05:09:31.041619 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [None req-78963930-4db9-4834-b22d-96dbb1f7f65e tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] 10.222.0.50 "GET /compute/v2.1/servers/50eed27b-6da2-4dda-94cc-02fc5cfec071" status: 404 len: 111 microversion: 2.1 time: 0.030190 Sep 24 05:09:31.041619 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 485/943] 10.222.0.50 () {58 vars in 1236 bytes} [Sat Sep 24 05:09:31 2022] GET /compute/v2.1/servers/50eed27b-6da2-4dda-94cc-02fc5cfec071 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 24 05:09:31.045726 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-300f09b2-d3d7-4036-af64-4b3648b873e1 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Calling method '>' {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:09:31.046263 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.compute.api [None req-300f09b2-d3d7-4036-af64-4b3648b873e1 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] [instance: 87dcedb5-91c7-4bc3-b46f-124ccffedf78] Fetching instance by UUID {{(pid=120594) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:09:31.052652 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-300f09b2-d3d7-4036-af64-4b3648b873e1 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:09:31.053136 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-300f09b2-d3d7-4036-af64-4b3648b873e1 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:09:31.053687 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-300f09b2-d3d7-4036-af64-4b3648b873e1 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:09:31.054454 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-300f09b2-d3d7-4036-af64-4b3648b873e1 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:09:31.054909 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-300f09b2-d3d7-4036-af64-4b3648b873e1 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:09:31.055337 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-300f09b2-d3d7-4036-af64-4b3648b873e1 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:09:31.080243 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.compute.api [None req-300f09b2-d3d7-4036-af64-4b3648b873e1 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] [instance: 87dcedb5-91c7-4bc3-b46f-124ccffedf78] Going to try to terminate instance {{(pid=120594) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 24 05:09:31.134564 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-9ab43d7a-a379-42a1-b653-495ad75c635c tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74a8cc19ab204424ab23c62915ac2bab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87d5229e39fe4817b5187068d8acecc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:09:31.143614 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-9ab43d7a-a379-42a1-b653-495ad75c635c tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] 10.222.0.50 "GET /compute/v2.1/servers/87b5a30a-8b76-44d0-a014-23e753d0835f" status: 200 len: 1367 microversion: 2.1 time: 0.154193 Sep 24 05:09:31.144190 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 459/944] 10.222.0.50 () {58 vars in 1236 bytes} [Sat Sep 24 05:09:30 2022] GET /compute/v2.1/servers/87b5a30a-8b76-44d0-a014-23e753d0835f => generated 1367 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 05:09:31.157184 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [None req-300f09b2-d3d7-4036-af64-4b3648b873e1 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] 10.222.0.50 "DELETE /compute/v2.1/servers/87dcedb5-91c7-4bc3-b46f-124ccffedf78" status: 204 len: 0 microversion: 2.1 time: 0.114067 Sep 24 05:09:31.162085 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 486/945] 10.222.0.50 () {58 vars in 1239 bytes} [Sat Sep 24 05:09:31 2022] DELETE /compute/v2.1/servers/87dcedb5-91c7-4bc3-b46f-124ccffedf78 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 24 05:09:31.169275 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-8f49c54a-02f7-49fa-b3a1-5418d7eda595 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Calling method '>' {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:09:31.170721 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.compute.api [None req-8f49c54a-02f7-49fa-b3a1-5418d7eda595 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] [instance: 87dcedb5-91c7-4bc3-b46f-124ccffedf78] Fetching instance by UUID {{(pid=120593) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:09:31.177614 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-8f49c54a-02f7-49fa-b3a1-5418d7eda595 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:09:31.178219 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-8f49c54a-02f7-49fa-b3a1-5418d7eda595 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:09:31.178684 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-8f49c54a-02f7-49fa-b3a1-5418d7eda595 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:09:31.179376 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-8f49c54a-02f7-49fa-b3a1-5418d7eda595 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:09:31.179827 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-8f49c54a-02f7-49fa-b3a1-5418d7eda595 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:09:31.180253 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-8f49c54a-02f7-49fa-b3a1-5418d7eda595 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:09:31.314386 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-8f49c54a-02f7-49fa-b3a1-5418d7eda595 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cdd0da2c7bc4139bcd48ef36a2ee183', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a18a3756ba2b460d977f738a115ebfe0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:09:31.321981 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-8f49c54a-02f7-49fa-b3a1-5418d7eda595 tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] 10.222.0.50 "GET /compute/v2.1/servers/87dcedb5-91c7-4bc3-b46f-124ccffedf78" status: 200 len: 1521 microversion: 2.1 time: 0.157797 Sep 24 05:09:31.322557 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 460/946] 10.222.0.50 () {58 vars in 1236 bytes} [Sat Sep 24 05:09:31 2022] GET /compute/v2.1/servers/87dcedb5-91c7-4bc3-b46f-124ccffedf78 => generated 1521 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 24 05:09:31.361233 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [req-7603d4c1-7665-48e7-8a30-dfd936bd3e38 req-c4612a2c-e84a-4ec1-b971-86c89ea716f1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "87b5a30a-8b76-44d0-a014-23e753d0835f", "name": "network-vif-plugged", "status": "completed", "tag": "69742a41-eeea-432a-8f65-c86e8714c51a"}]} {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 05:09:31.371261 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [req-7603d4c1-7665-48e7-8a30-dfd936bd3e38 req-c4612a2c-e84a-4ec1-b971-86c89ea716f1 service nova] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:09:31.371733 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [req-7603d4c1-7665-48e7-8a30-dfd936bd3e38 req-c4612a2c-e84a-4ec1-b971-86c89ea716f1 service nova] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:09:31.372159 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [req-7603d4c1-7665-48e7-8a30-dfd936bd3e38 req-c4612a2c-e84a-4ec1-b971-86c89ea716f1 service nova] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:09:31.382972 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: INFO nova.api.openstack.compute.server_external_events [req-7603d4c1-7665-48e7-8a30-dfd936bd3e38 req-c4612a2c-e84a-4ec1-b971-86c89ea716f1 service nova] Creating event network-vif-plugged:69742a41-eeea-432a-8f65-c86e8714c51a for instance 87b5a30a-8b76-44d0-a014-23e753d0835f on hv-cinder-85918 Sep 24 05:09:31.387714 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [req-7603d4c1-7665-48e7-8a30-dfd936bd3e38 req-c4612a2c-e84a-4ec1-b971-86c89ea716f1 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030505 Sep 24 05:09:31.388303 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 487/947] 10.222.0.50 () {64 vars in 1317 bytes} [Sat Sep 24 05:09:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 05:09:32.167054 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-d3cc1e47-45ad-4881-a14f-4f5aea0f47f0 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Calling method '>' {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:09:32.167691 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.compute.api [None req-d3cc1e47-45ad-4881-a14f-4f5aea0f47f0 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] [instance: 87b5a30a-8b76-44d0-a014-23e753d0835f] Fetching instance by UUID {{(pid=120593) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:09:32.174021 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-d3cc1e47-45ad-4881-a14f-4f5aea0f47f0 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:09:32.175000 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-d3cc1e47-45ad-4881-a14f-4f5aea0f47f0 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:09:32.175433 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-d3cc1e47-45ad-4881-a14f-4f5aea0f47f0 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:09:32.176115 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-d3cc1e47-45ad-4881-a14f-4f5aea0f47f0 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:09:32.176566 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-d3cc1e47-45ad-4881-a14f-4f5aea0f47f0 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:09:32.176988 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-d3cc1e47-45ad-4881-a14f-4f5aea0f47f0 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:09:32.304705 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-d3cc1e47-45ad-4881-a14f-4f5aea0f47f0 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74a8cc19ab204424ab23c62915ac2bab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87d5229e39fe4817b5187068d8acecc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:09:32.312231 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-d3cc1e47-45ad-4881-a14f-4f5aea0f47f0 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] 10.222.0.50 "GET /compute/v2.1/servers/87b5a30a-8b76-44d0-a014-23e753d0835f" status: 200 len: 1367 microversion: 2.1 time: 0.148987 Sep 24 05:09:32.312790 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 461/948] 10.222.0.50 () {58 vars in 1236 bytes} [Sat Sep 24 05:09:32 2022] GET /compute/v2.1/servers/87b5a30a-8b76-44d0-a014-23e753d0835f => generated 1367 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 05:09:32.345746 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-e6bb62b5-8a1b-44b4-8a55-9f81afb1cfba tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Calling method '>' {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:09:32.346464 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.compute.api [None req-e6bb62b5-8a1b-44b4-8a55-9f81afb1cfba tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] [instance: 87dcedb5-91c7-4bc3-b46f-124ccffedf78] Fetching instance by UUID {{(pid=120594) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:09:32.352418 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-e6bb62b5-8a1b-44b4-8a55-9f81afb1cfba tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:09:32.352889 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-e6bb62b5-8a1b-44b4-8a55-9f81afb1cfba tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:09:32.353315 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-e6bb62b5-8a1b-44b4-8a55-9f81afb1cfba tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:09:32.353986 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-e6bb62b5-8a1b-44b4-8a55-9f81afb1cfba tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:09:32.354451 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-e6bb62b5-8a1b-44b4-8a55-9f81afb1cfba tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:09:32.354864 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-e6bb62b5-8a1b-44b4-8a55-9f81afb1cfba tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:09:32.483123 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.policy [None req-e6bb62b5-8a1b-44b4-8a55-9f81afb1cfba tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cdd0da2c7bc4139bcd48ef36a2ee183', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a18a3756ba2b460d977f738a115ebfe0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:09:32.491302 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [None req-e6bb62b5-8a1b-44b4-8a55-9f81afb1cfba tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] 10.222.0.50 "GET /compute/v2.1/servers/87dcedb5-91c7-4bc3-b46f-124ccffedf78" status: 200 len: 1521 microversion: 2.1 time: 0.150266 Sep 24 05:09:32.491860 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 488/949] 10.222.0.50 () {58 vars in 1236 bytes} [Sat Sep 24 05:09:32 2022] GET /compute/v2.1/servers/87dcedb5-91c7-4bc3-b46f-124ccffedf78 => generated 1521 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 05:09:33.278637 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [req-b3b85537-7679-4f47-be65-6c10efd5680a req-332b28be-3b15-443e-b499-fb5e722cf56a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "87dcedb5-91c7-4bc3-b46f-124ccffedf78", "name": "network-vif-deleted", "tag": "0dd07bd5-e74b-434c-a105-6a9c537c3c96"}]} {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 05:09:33.288638 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [req-b3b85537-7679-4f47-be65-6c10efd5680a req-332b28be-3b15-443e-b499-fb5e722cf56a service nova] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:09:33.289109 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [req-b3b85537-7679-4f47-be65-6c10efd5680a req-332b28be-3b15-443e-b499-fb5e722cf56a service nova] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:09:33.289532 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [req-b3b85537-7679-4f47-be65-6c10efd5680a req-332b28be-3b15-443e-b499-fb5e722cf56a service nova] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:09:33.300386 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.compute.server_external_events [req-b3b85537-7679-4f47-be65-6c10efd5680a req-332b28be-3b15-443e-b499-fb5e722cf56a service nova] Creating event network-vif-deleted:0dd07bd5-e74b-434c-a105-6a9c537c3c96 for instance 87dcedb5-91c7-4bc3-b46f-124ccffedf78 on hv-cinder-85918 Sep 24 05:09:33.305406 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [req-b3b85537-7679-4f47-be65-6c10efd5680a req-332b28be-3b15-443e-b499-fb5e722cf56a service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030305 Sep 24 05:09:33.306039 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 462/950] 10.222.0.50 () {64 vars in 1317 bytes} [Sat Sep 24 05:09:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 05:09:33.335697 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-21a9bdbc-889e-4efe-b4e9-f32cf05255f3 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Calling method '>' {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:09:33.336305 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.compute.api [None req-21a9bdbc-889e-4efe-b4e9-f32cf05255f3 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] [instance: 87b5a30a-8b76-44d0-a014-23e753d0835f] Fetching instance by UUID {{(pid=120594) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:09:33.342245 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-21a9bdbc-889e-4efe-b4e9-f32cf05255f3 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:09:33.342717 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-21a9bdbc-889e-4efe-b4e9-f32cf05255f3 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:09:33.343149 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-21a9bdbc-889e-4efe-b4e9-f32cf05255f3 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:09:33.343822 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-21a9bdbc-889e-4efe-b4e9-f32cf05255f3 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:09:33.344268 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-21a9bdbc-889e-4efe-b4e9-f32cf05255f3 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:09:33.344684 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-21a9bdbc-889e-4efe-b4e9-f32cf05255f3 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:09:33.473214 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.policy [None req-21a9bdbc-889e-4efe-b4e9-f32cf05255f3 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74a8cc19ab204424ab23c62915ac2bab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87d5229e39fe4817b5187068d8acecc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:09:33.480752 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [None req-21a9bdbc-889e-4efe-b4e9-f32cf05255f3 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] 10.222.0.50 "GET /compute/v2.1/servers/87b5a30a-8b76-44d0-a014-23e753d0835f" status: 200 len: 1367 microversion: 2.1 time: 0.148868 Sep 24 05:09:33.481309 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 489/951] 10.222.0.50 () {58 vars in 1236 bytes} [Sat Sep 24 05:09:33 2022] GET /compute/v2.1/servers/87b5a30a-8b76-44d0-a014-23e753d0835f => generated 1367 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 05:09:33.514399 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-27d1333f-a8a0-4a6f-8716-2c6e4285395a tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Calling method '>' {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:09:33.515035 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.compute.api [None req-27d1333f-a8a0-4a6f-8716-2c6e4285395a tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] [instance: 87dcedb5-91c7-4bc3-b46f-124ccffedf78] Fetching instance by UUID {{(pid=120593) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:09:33.521697 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-27d1333f-a8a0-4a6f-8716-2c6e4285395a tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:09:33.522213 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-27d1333f-a8a0-4a6f-8716-2c6e4285395a tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:09:33.522652 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-27d1333f-a8a0-4a6f-8716-2c6e4285395a tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:09:33.523342 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-27d1333f-a8a0-4a6f-8716-2c6e4285395a tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:09:33.523824 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-27d1333f-a8a0-4a6f-8716-2c6e4285395a tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:09:33.524248 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-27d1333f-a8a0-4a6f-8716-2c6e4285395a tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:09:33.528146 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG dbcounter [-] [120593] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 05:09:33.589638 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-27d1333f-a8a0-4a6f-8716-2c6e4285395a tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cdd0da2c7bc4139bcd48ef36a2ee183', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a18a3756ba2b460d977f738a115ebfe0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:09:33.599631 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-27d1333f-a8a0-4a6f-8716-2c6e4285395a tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] 10.222.0.50 "GET /compute/v2.1/servers/87dcedb5-91c7-4bc3-b46f-124ccffedf78" status: 200 len: 1479 microversion: 2.1 time: 0.089306 Sep 24 05:09:33.604135 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 463/952] 10.222.0.50 () {58 vars in 1236 bytes} [Sat Sep 24 05:09:33 2022] GET /compute/v2.1/servers/87dcedb5-91c7-4bc3-b46f-124ccffedf78 => generated 1479 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 05:09:34.503791 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-12fb7740-8b4e-4003-8e12-3a7a346a1882 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Calling method '>' {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:09:34.504500 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.compute.api [None req-12fb7740-8b4e-4003-8e12-3a7a346a1882 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] [instance: 87b5a30a-8b76-44d0-a014-23e753d0835f] Fetching instance by UUID {{(pid=120594) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:09:34.511232 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-12fb7740-8b4e-4003-8e12-3a7a346a1882 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:09:34.511759 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-12fb7740-8b4e-4003-8e12-3a7a346a1882 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:09:34.512197 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-12fb7740-8b4e-4003-8e12-3a7a346a1882 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:09:34.512890 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-12fb7740-8b4e-4003-8e12-3a7a346a1882 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:09:34.513343 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-12fb7740-8b4e-4003-8e12-3a7a346a1882 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:09:34.513762 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-12fb7740-8b4e-4003-8e12-3a7a346a1882 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:09:34.623267 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-2391fd76-ca03-4d20-bc9b-be18370a1d2b tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Calling method '>' {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:09:34.623785 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.compute.api [None req-2391fd76-ca03-4d20-bc9b-be18370a1d2b tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] [instance: 87dcedb5-91c7-4bc3-b46f-124ccffedf78] Fetching instance by UUID {{(pid=120593) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:09:34.630266 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-2391fd76-ca03-4d20-bc9b-be18370a1d2b tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:09:34.630872 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-2391fd76-ca03-4d20-bc9b-be18370a1d2b tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:09:34.631316 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-2391fd76-ca03-4d20-bc9b-be18370a1d2b tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:09:34.632010 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-2391fd76-ca03-4d20-bc9b-be18370a1d2b tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:09:34.632461 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-2391fd76-ca03-4d20-bc9b-be18370a1d2b tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:09:34.632883 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-2391fd76-ca03-4d20-bc9b-be18370a1d2b tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:09:34.641065 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.policy [None req-12fb7740-8b4e-4003-8e12-3a7a346a1882 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74a8cc19ab204424ab23c62915ac2bab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87d5229e39fe4817b5187068d8acecc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:09:34.646670 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.wsgi [None req-2391fd76-ca03-4d20-bc9b-be18370a1d2b tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] HTTP exception thrown: Instance 87dcedb5-91c7-4bc3-b46f-124ccffedf78 could not be found. Sep 24 05:09:34.648322 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-2391fd76-ca03-4d20-bc9b-be18370a1d2b tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Request method failure captured: Sep 24 05:09:34.648322 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: request: GET /compute/v2.1/servers/87dcedb5-91c7-4bc3-b46f-124ccffedf78 HTTP/1.1 Sep 24 05:09:34.648322 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: Accept: application/json Sep 24 05:09:34.648322 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: Accept-Encoding: identity Sep 24 05:09:34.648322 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: Connection: close Sep 24 05:09:34.648322 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: Content-Length: 0 Sep 24 05:09:34.648322 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: Content-Type: application/json Sep 24 05:09:34.648322 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: Host: 10.222.0.50 Sep 24 05:09:34.648322 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: Openstack-System-Scope: None Sep 24 05:09:34.648322 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: User-Agent: python-urllib3/1.26.12 Sep 24 05:09:34.648322 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: X-Auth-Token: gAAAAABjLo8HTzNG_FPeaRlb1iKtn70N4qXi3bCZUsBH5ev83dMKRgyc3ir4exWyX_HELoYhUZuaNsGC0Iz7uIZoAOnFSUT1gUYQNLBWBHD4Hr9Zo2LmNKYYpHEOSNBOqs6trhPvBX0Mbw8c_gmqJ1Foarii5zl7NKWXL_yy02zfSiE1i-m0pa8 Sep 24 05:09:34.648322 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: X-Domain-Id: None Sep 24 05:09:34.648322 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: X-Domain-Name: None Sep 24 05:09:34.648322 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: X-Identity-Status: Confirmed Sep 24 05:09:34.648322 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: X-Is-Admin-Project: True Sep 24 05:09:34.648322 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: X-Project-Domain-Id: default Sep 24 05:09:34.648322 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: X-Project-Domain-Name: Default Sep 24 05:09:34.648322 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: X-Project-Id: a18a3756ba2b460d977f738a115ebfe0 Sep 24 05:09:34.648322 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1841571325 Sep 24 05:09:34.648322 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: X-Role: member,reader Sep 24 05:09:34.648322 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: X-Roles: member,reader Sep 24 05:09:34.649690 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/a18a3756ba2b460d977f738a115ebfe0"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/a18a3756ba2b460d977f738a115ebfe0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/a18a3756ba2b460d977f738a115ebfe0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.50:8080", "publicURL": "http://10.222.0.50:8080/v1/AUTH_a18a3756ba2b460d977f738a115ebfe0"}]}] Sep 24 05:09:34.649690 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1841571325 Sep 24 05:09:34.649690 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: X-Tenant-Id: a18a3756ba2b460d977f738a115ebfe0 Sep 24 05:09:34.649690 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1841571325 Sep 24 05:09:34.649690 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: X-User: tempest-ServerRescueNegativeTestJSON-1841571325-project Sep 24 05:09:34.649690 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: X-User-Domain-Id: default Sep 24 05:09:34.649690 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: X-User-Domain-Name: Default Sep 24 05:09:34.649690 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: X-User-Id: 8cdd0da2c7bc4139bcd48ef36a2ee183 Sep 24 05:09:34.649690 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1841571325-project Sep 24 05:09:34.649690 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: method: > Sep 24 05:09:34.649690 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: exception: Instance 87dcedb5-91c7-4bc3-b46f-124ccffedf78 could not be found. Sep 24 05:09:34.649690 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: action_args: {'id': '87dcedb5-91c7-4bc3-b46f-124ccffedf78'} Sep 24 05:09:34.650471 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 24 05:09:34.650471 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 05:09:34.650471 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 24 05:09:34.650471 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 24 05:09:34.650471 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 24 05:09:34.650471 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 24 05:09:34.650471 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 24 05:09:34.650471 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 24 05:09:34.650471 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 24 05:09:34.650471 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 24 05:09:34.650471 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 87dcedb5-91c7-4bc3-b46f-124ccffedf78 could not be found. Sep 24 05:09:34.650471 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi Sep 24 05:09:34.650471 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 05:09:34.650471 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi Sep 24 05:09:34.650471 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 05:09:34.650471 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 05:09:34.650471 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 05:09:34.650471 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 24 05:09:34.650471 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 24 05:09:34.650471 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 24 05:09:34.651856 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 24 05:09:34.651856 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 24 05:09:34.651856 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 24 05:09:34.651856 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 24 05:09:34.651856 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 24 05:09:34.651856 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 24 05:09:34.651856 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 24 05:09:34.651856 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 87dcedb5-91c7-4bc3-b46f-124ccffedf78 could not be found. Sep 24 05:09:34.651856 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi Sep 24 05:09:34.651856 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 05:09:34.651856 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi Sep 24 05:09:34.651856 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 05:09:34.651856 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 05:09:34.651856 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 05:09:34.651856 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 24 05:09:34.651856 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 24 05:09:34.651856 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 87dcedb5-91c7-4bc3-b46f-124ccffedf78 could not be found. Sep 24 05:09:34.651856 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi Sep 24 05:09:34.654016 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-2391fd76-ca03-4d20-bc9b-be18370a1d2b tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] Returning 404 to user: Instance 87dcedb5-91c7-4bc3-b46f-124ccffedf78 could not be found. {{(pid=120593) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 24 05:09:34.654016 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-2391fd76-ca03-4d20-bc9b-be18370a1d2b tempest-ServerRescueNegativeTestJSON-1841571325 tempest-ServerRescueNegativeTestJSON-1841571325-project] 10.222.0.50 "GET /compute/v2.1/servers/87dcedb5-91c7-4bc3-b46f-124ccffedf78" status: 404 len: 111 microversion: 2.1 time: 0.030433 Sep 24 05:09:34.654016 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 464/953] 10.222.0.50 () {58 vars in 1236 bytes} [Sat Sep 24 05:09:34 2022] GET /compute/v2.1/servers/87dcedb5-91c7-4bc3-b46f-124ccffedf78 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 24 05:09:34.654497 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [None req-12fb7740-8b4e-4003-8e12-3a7a346a1882 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] 10.222.0.50 "GET /compute/v2.1/servers/87b5a30a-8b76-44d0-a014-23e753d0835f" status: 200 len: 1557 microversion: 2.1 time: 0.150705 Sep 24 05:09:34.666504 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 490/954] 10.222.0.50 () {58 vars in 1236 bytes} [Sat Sep 24 05:09:34 2022] GET /compute/v2.1/servers/87b5a30a-8b76-44d0-a014-23e753d0835f => generated 1557 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 05:09:34.674462 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-cac0bfe1-74a4-4ee3-9596-e7c0545785d4 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Calling method '>' {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:09:34.674955 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.compute.api [None req-cac0bfe1-74a4-4ee3-9596-e7c0545785d4 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] [instance: 87b5a30a-8b76-44d0-a014-23e753d0835f] Fetching instance by UUID {{(pid=120593) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:09:34.680893 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-cac0bfe1-74a4-4ee3-9596-e7c0545785d4 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:09:34.681374 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-cac0bfe1-74a4-4ee3-9596-e7c0545785d4 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:09:34.681852 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-cac0bfe1-74a4-4ee3-9596-e7c0545785d4 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:09:34.682570 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-cac0bfe1-74a4-4ee3-9596-e7c0545785d4 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:09:34.683019 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-cac0bfe1-74a4-4ee3-9596-e7c0545785d4 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:09:34.683561 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-cac0bfe1-74a4-4ee3-9596-e7c0545785d4 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:09:34.765768 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-cac0bfe1-74a4-4ee3-9596-e7c0545785d4 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] 10.222.0.50 "GET /compute/v2.1/servers/87b5a30a-8b76-44d0-a014-23e753d0835f/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.095395 Sep 24 05:09:34.766397 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 465/955] 10.222.0.50 () {58 vars in 1275 bytes} [Sat Sep 24 05:09:34 2022] GET /compute/v2.1/servers/87b5a30a-8b76-44d0-a014-23e753d0835f/os-interface => generated 284 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 05:09:36.523201 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [req-95ff5fd5-fa88-41f1-a453-bdd262e08bf9 req-c6d4296d-bdf1-4c6f-aeba-5a51122326e8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "87b5a30a-8b76-44d0-a014-23e753d0835f", "tag": "69742a41-eeea-432a-8f65-c86e8714c51a"}]} {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 05:09:36.540752 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [req-95ff5fd5-fa88-41f1-a453-bdd262e08bf9 req-c6d4296d-bdf1-4c6f-aeba-5a51122326e8 service nova] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:09:36.541464 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [req-95ff5fd5-fa88-41f1-a453-bdd262e08bf9 req-c6d4296d-bdf1-4c6f-aeba-5a51122326e8 service nova] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:09:36.542722 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [req-95ff5fd5-fa88-41f1-a453-bdd262e08bf9 req-c6d4296d-bdf1-4c6f-aeba-5a51122326e8 service nova] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:09:36.556489 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: INFO nova.api.openstack.compute.server_external_events [req-95ff5fd5-fa88-41f1-a453-bdd262e08bf9 req-c6d4296d-bdf1-4c6f-aeba-5a51122326e8 service nova] Creating event network-changed:69742a41-eeea-432a-8f65-c86e8714c51a for instance 87b5a30a-8b76-44d0-a014-23e753d0835f on hv-cinder-85918 Sep 24 05:09:36.561503 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [req-95ff5fd5-fa88-41f1-a453-bdd262e08bf9 req-c6d4296d-bdf1-4c6f-aeba-5a51122326e8 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043286 Sep 24 05:09:36.562673 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 491/956] 10.222.0.50 () {64 vars in 1317 bytes} [Sat Sep 24 05:09:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 05:09:41.842124 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-d3982221-6859-400b-8dd1-e26cada29a14 tempest-VolumesTestJSON-1949272856 tempest-VolumesTestJSON-1949272856-project] Calling method '.version_select at 0x7f79505e7b80>' {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:09:41.888372 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-d3982221-6859-400b-8dd1-e26cada29a14 tempest-VolumesTestJSON-1949272856 tempest-VolumesTestJSON-1949272856-project] 10.222.0.50 "GET /compute/v2.1/os-volumes/5c683b2c-fc24-4af3-ae2e-fe533d9eb842" status: 200 len: 351 microversion: 2.1 time: 0.050795 Sep 24 05:09:41.888932 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 466/957] 10.222.0.50 () {58 vars in 1245 bytes} [Sat Sep 24 05:09:41 2022] GET /compute/v2.1/os-volumes/5c683b2c-fc24-4af3-ae2e-fe533d9eb842 => generated 351 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 05:09:43.227952 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-be826a5b-fe03-4123-ae97-8e4578e24802 tempest-VolumesTestJSON-1949272856 tempest-VolumesTestJSON-1949272856-project] Calling method '.version_select at 0x7f7950568670>' {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:09:43.273411 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [None req-be826a5b-fe03-4123-ae97-8e4578e24802 tempest-VolumesTestJSON-1949272856 tempest-VolumesTestJSON-1949272856-project] 10.222.0.50 "GET /compute/v2.1/os-volumes/418f2a9c-89d8-4f3f-8830-c55bb2321c83" status: 200 len: 350 microversion: 2.1 time: 0.050303 Sep 24 05:09:43.273969 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 492/958] 10.222.0.50 () {58 vars in 1245 bytes} [Sat Sep 24 05:09:43 2022] GET /compute/v2.1/os-volumes/418f2a9c-89d8-4f3f-8830-c55bb2321c83 => generated 350 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 05:09:44.614509 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-d910f843-1704-445d-840a-729552db83e8 tempest-VolumesTestJSON-1949272856 tempest-VolumesTestJSON-1949272856-project] Calling method '.version_select at 0x7f795055bf70>' {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:09:44.661280 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-d910f843-1704-445d-840a-729552db83e8 tempest-VolumesTestJSON-1949272856 tempest-VolumesTestJSON-1949272856-project] 10.222.0.50 "GET /compute/v2.1/os-volumes/ead6cff3-e3d9-42bc-a0ad-202198563486" status: 200 len: 351 microversion: 2.1 time: 0.051034 Sep 24 05:09:44.661844 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 467/959] 10.222.0.50 () {58 vars in 1245 bytes} [Sat Sep 24 05:09:44 2022] GET /compute/v2.1/os-volumes/ead6cff3-e3d9-42bc-a0ad-202198563486 => generated 351 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 05:09:44.675337 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-77e10132-4b85-4a6e-9621-4c59483b2957 tempest-VolumesTestJSON-1949272856 tempest-VolumesTestJSON-1949272856-project] Calling method '.version_select at 0x7f795050ba60>' {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:09:44.762193 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [None req-77e10132-4b85-4a6e-9621-4c59483b2957 tempest-VolumesTestJSON-1949272856 tempest-VolumesTestJSON-1949272856-project] 10.222.0.50 "GET /compute/v2.1/os-volumes" status: 200 len: 1035 microversion: 2.1 time: 0.091132 Sep 24 05:09:44.762762 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 493/960] 10.222.0.50 () {58 vars in 1134 bytes} [Sat Sep 24 05:09:44 2022] GET /compute/v2.1/os-volumes => generated 1035 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 05:09:44.774394 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG dbcounter [-] [120593] Writing DB stats nova_api:SELECT=78,nova_api:DELETE=2,nova_api:INSERT=1,nova_api:UPDATE=1 {{(pid=120593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 05:09:44.775157 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG dbcounter [-] [120593] Writing DB stats nova_cell1:SELECT=10 {{(pid=120593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 05:09:44.779324 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-07c7b88a-53d8-4078-8adf-506354c6882c tempest-VolumesTestJSON-1949272856 tempest-VolumesTestJSON-1949272856-project] Calling method '.version_select at 0x7f79505ca1f0>' {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:09:44.861414 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-07c7b88a-53d8-4078-8adf-506354c6882c tempest-VolumesTestJSON-1949272856 tempest-VolumesTestJSON-1949272856-project] 10.222.0.50 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.087617 Sep 24 05:09:44.862660 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 468/961] 10.222.0.50 () {58 vars in 1149 bytes} [Sat Sep 24 05:09:44 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 694 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 05:09:44.876271 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-74255468-3859-4856-a8ed-708975d0bc01 tempest-VolumesTestJSON-1949272856 tempest-VolumesTestJSON-1949272856-project] Calling method '.version_select at 0x7f79505e5af0>' {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:09:44.956346 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [None req-74255468-3859-4856-a8ed-708975d0bc01 tempest-VolumesTestJSON-1949272856 tempest-VolumesTestJSON-1949272856-project] 10.222.0.50 "GET /compute/v2.1/os-volumes" status: 200 len: 1035 microversion: 2.1 time: 0.083750 Sep 24 05:09:44.956909 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 494/962] 10.222.0.50 () {58 vars in 1134 bytes} [Sat Sep 24 05:09:44 2022] GET /compute/v2.1/os-volumes => generated 1035 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 05:09:44.970037 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-4352cbfc-f607-4be1-8df2-6f1069b30d66 tempest-VolumesTestJSON-1949272856 tempest-VolumesTestJSON-1949272856-project] Calling method '.version_select at 0x7f7950830430>' {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:09:45.067134 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-4352cbfc-f607-4be1-8df2-6f1069b30d66 tempest-VolumesTestJSON-1949272856 tempest-VolumesTestJSON-1949272856-project] 10.222.0.50 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.100838 Sep 24 05:09:45.067707 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 469/963] 10.222.0.50 () {58 vars in 1167 bytes} [Sat Sep 24 05:09:44 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 353 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 05:09:45.080997 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-62daae43-9431-4ede-96e8-238041d46475 tempest-VolumesTestJSON-1949272856 tempest-VolumesTestJSON-1949272856-project] Calling method '.version_select at 0x7f79505bf5e0>' {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:09:45.312288 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [None req-62daae43-9431-4ede-96e8-238041d46475 tempest-VolumesTestJSON-1949272856 tempest-VolumesTestJSON-1949272856-project] 10.222.0.50 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.235029 Sep 24 05:09:45.312845 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 495/964] 10.222.0.50 () {58 vars in 1170 bytes} [Sat Sep 24 05:09:45 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 694 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 05:09:45.326709 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-89fec380-12c2-4357-b791-1595af941e4b tempest-VolumesTestJSON-1949272856 tempest-VolumesTestJSON-1949272856-project] Calling method '.version_select at 0x7f79505e7af0>' {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:09:45.407781 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-89fec380-12c2-4357-b791-1595af941e4b tempest-VolumesTestJSON-1949272856 tempest-VolumesTestJSON-1949272856-project] 10.222.0.50 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1035 microversion: 2.1 time: 0.084419 Sep 24 05:09:45.408347 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 470/965] 10.222.0.50 () {58 vars in 1155 bytes} [Sat Sep 24 05:09:45 2022] GET /compute/v2.1/os-volumes/detail => generated 1035 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 05:09:45.421832 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-b7c7fcc2-f8c8-4b83-8227-d415425c3cdd tempest-VolumesTestJSON-1949272856 tempest-VolumesTestJSON-1949272856-project] Calling method '.version_select at 0x7f79505bf280>' {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:09:45.502537 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [None req-b7c7fcc2-f8c8-4b83-8227-d415425c3cdd tempest-VolumesTestJSON-1949272856 tempest-VolumesTestJSON-1949272856-project] 10.222.0.50 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.084359 Sep 24 05:09:45.503093 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 496/966] 10.222.0.50 () {58 vars in 1188 bytes} [Sat Sep 24 05:09:45 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 353 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 05:09:45.516195 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-4204cc42-05a1-4180-a2b6-daa39b4cc1a3 tempest-VolumesTestJSON-1949272856 tempest-VolumesTestJSON-1949272856-project] Calling method '.version_select at 0x7f795067cca0>' {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:09:45.596759 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-4204cc42-05a1-4180-a2b6-daa39b4cc1a3 tempest-VolumesTestJSON-1949272856 tempest-VolumesTestJSON-1949272856-project] 10.222.0.50 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1035 microversion: 2.1 time: 0.083710 Sep 24 05:09:45.597401 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 471/967] 10.222.0.50 () {58 vars in 1155 bytes} [Sat Sep 24 05:09:45 2022] GET /compute/v2.1/os-volumes/detail => generated 1035 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 24 05:10:00.299868 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG dbcounter [-] [120594] Writing DB stats nova_api:SELECT=87,nova_api:UPDATE=3,nova_api:INSERT=3 {{(pid=120594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 05:10:00.300950 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG dbcounter [-] [120594] Writing DB stats nova_cell1:SELECT=48,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 05:10:00.305871 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-11cfa957-77cc-411e-9012-c3ebfe7e2765 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Calling method '>' {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:10:00.308071 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.compute.api [None req-11cfa957-77cc-411e-9012-c3ebfe7e2765 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] [instance: b2daebb8-dfea-4ab9-8253-008a21f906e1] Fetching instance by UUID {{(pid=120594) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:10:00.316288 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-11cfa957-77cc-411e-9012-c3ebfe7e2765 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:10:00.316769 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-11cfa957-77cc-411e-9012-c3ebfe7e2765 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:10:00.317193 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-11cfa957-77cc-411e-9012-c3ebfe7e2765 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:10:00.317871 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-11cfa957-77cc-411e-9012-c3ebfe7e2765 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:10:00.318414 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-11cfa957-77cc-411e-9012-c3ebfe7e2765 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:10:00.318886 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-11cfa957-77cc-411e-9012-c3ebfe7e2765 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:10:00.349172 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [None req-11cfa957-77cc-411e-9012-c3ebfe7e2765 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] 10.222.0.50 "GET /compute/v2.1/servers/b2daebb8-dfea-4ab9-8253-008a21f906e1/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.050397 Sep 24 05:10:00.350219 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 497/968] 10.222.0.50 () {58 vars in 1302 bytes} [Sat Sep 24 05:10:00 2022] GET /compute/v2.1/servers/b2daebb8-dfea-4ab9-8253-008a21f906e1/os-volume_attachments => generated 25 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 24 05:10:00.414924 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-a7768287-b5ca-4aaa-bd64-22afdfb31b7b tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Calling method '>' {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:10:00.415464 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.compute.api [None req-a7768287-b5ca-4aaa-bd64-22afdfb31b7b tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] [instance: b2daebb8-dfea-4ab9-8253-008a21f906e1] Fetching instance by UUID {{(pid=120593) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:10:00.421411 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-a7768287-b5ca-4aaa-bd64-22afdfb31b7b tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:10:00.421888 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-a7768287-b5ca-4aaa-bd64-22afdfb31b7b tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:10:00.422356 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-a7768287-b5ca-4aaa-bd64-22afdfb31b7b tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:10:00.423036 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-a7768287-b5ca-4aaa-bd64-22afdfb31b7b tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:10:00.423485 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-a7768287-b5ca-4aaa-bd64-22afdfb31b7b tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:10:00.423911 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-a7768287-b5ca-4aaa-bd64-22afdfb31b7b tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:10:00.449874 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.compute.api [None req-a7768287-b5ca-4aaa-bd64-22afdfb31b7b tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] [instance: b2daebb8-dfea-4ab9-8253-008a21f906e1] Going to try to terminate instance {{(pid=120593) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 24 05:10:00.525345 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-a7768287-b5ca-4aaa-bd64-22afdfb31b7b tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] 10.222.0.50 "DELETE /compute/v2.1/servers/b2daebb8-dfea-4ab9-8253-008a21f906e1" status: 204 len: 0 microversion: 2.1 time: 0.115256 Sep 24 05:10:00.526126 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 472/969] 10.222.0.50 () {58 vars in 1239 bytes} [Sat Sep 24 05:10:00 2022] DELETE /compute/v2.1/servers/b2daebb8-dfea-4ab9-8253-008a21f906e1 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 24 05:10:00.535346 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-586d470a-0e6d-495b-8a82-7f9909418cd2 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Calling method '>' {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:10:00.536178 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.compute.api [None req-586d470a-0e6d-495b-8a82-7f9909418cd2 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] [instance: b2daebb8-dfea-4ab9-8253-008a21f906e1] Fetching instance by UUID {{(pid=120594) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:10:00.542878 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-586d470a-0e6d-495b-8a82-7f9909418cd2 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:10:00.543359 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-586d470a-0e6d-495b-8a82-7f9909418cd2 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:10:00.543795 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-586d470a-0e6d-495b-8a82-7f9909418cd2 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:10:00.544478 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-586d470a-0e6d-495b-8a82-7f9909418cd2 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:10:00.544932 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-586d470a-0e6d-495b-8a82-7f9909418cd2 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:10:00.545390 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-586d470a-0e6d-495b-8a82-7f9909418cd2 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:10:00.674212 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.policy [None req-586d470a-0e6d-495b-8a82-7f9909418cd2 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b1b0448e7f54e3aaae49e411699269e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66ec8bde739145dda504995dbea0914a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:10:00.682599 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [None req-586d470a-0e6d-495b-8a82-7f9909418cd2 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] 10.222.0.50 "GET /compute/v2.1/servers/b2daebb8-dfea-4ab9-8253-008a21f906e1" status: 200 len: 1674 microversion: 2.1 time: 0.151908 Sep 24 05:10:00.683153 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 498/970] 10.222.0.50 () {58 vars in 1236 bytes} [Sat Sep 24 05:10:00 2022] GET /compute/v2.1/servers/b2daebb8-dfea-4ab9-8253-008a21f906e1 => generated 1674 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 05:10:01.707231 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-9e86165b-7ab0-4370-a155-e3be407b2b82 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Calling method '>' {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:10:01.707940 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.compute.api [None req-9e86165b-7ab0-4370-a155-e3be407b2b82 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] [instance: b2daebb8-dfea-4ab9-8253-008a21f906e1] Fetching instance by UUID {{(pid=120593) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:10:01.714868 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-9e86165b-7ab0-4370-a155-e3be407b2b82 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:10:01.715363 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-9e86165b-7ab0-4370-a155-e3be407b2b82 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:10:01.715981 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-9e86165b-7ab0-4370-a155-e3be407b2b82 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:10:01.716689 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-9e86165b-7ab0-4370-a155-e3be407b2b82 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:10:01.717140 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-9e86165b-7ab0-4370-a155-e3be407b2b82 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:10:01.718199 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-9e86165b-7ab0-4370-a155-e3be407b2b82 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:10:01.854895 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-9e86165b-7ab0-4370-a155-e3be407b2b82 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b1b0448e7f54e3aaae49e411699269e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66ec8bde739145dda504995dbea0914a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:10:01.862631 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-9e86165b-7ab0-4370-a155-e3be407b2b82 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] 10.222.0.50 "GET /compute/v2.1/servers/b2daebb8-dfea-4ab9-8253-008a21f906e1" status: 200 len: 1674 microversion: 2.1 time: 0.160203 Sep 24 05:10:01.863207 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 473/971] 10.222.0.50 () {58 vars in 1236 bytes} [Sat Sep 24 05:10:01 2022] GET /compute/v2.1/servers/b2daebb8-dfea-4ab9-8253-008a21f906e1 => generated 1674 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 24 05:10:02.642451 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [req-d626d599-9138-4e12-9074-aaa087f18c89 req-a16d437e-0976-41a2-a894-bdc316340a77 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b2daebb8-dfea-4ab9-8253-008a21f906e1", "name": "network-vif-deleted", "tag": "27e14393-9cd2-49fc-924d-ab63297b8de7"}]} {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 05:10:02.652936 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [req-d626d599-9138-4e12-9074-aaa087f18c89 req-a16d437e-0976-41a2-a894-bdc316340a77 service nova] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:10:02.653424 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [req-d626d599-9138-4e12-9074-aaa087f18c89 req-a16d437e-0976-41a2-a894-bdc316340a77 service nova] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:10:02.653845 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [req-d626d599-9138-4e12-9074-aaa087f18c89 req-a16d437e-0976-41a2-a894-bdc316340a77 service nova] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:10:02.677587 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: INFO nova.api.openstack.compute.server_external_events [req-d626d599-9138-4e12-9074-aaa087f18c89 req-a16d437e-0976-41a2-a894-bdc316340a77 service nova] Creating event network-vif-deleted:27e14393-9cd2-49fc-924d-ab63297b8de7 for instance b2daebb8-dfea-4ab9-8253-008a21f906e1 on hv-cinder-85918 Sep 24 05:10:02.683165 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [req-d626d599-9138-4e12-9074-aaa087f18c89 req-a16d437e-0976-41a2-a894-bdc316340a77 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044558 Sep 24 05:10:02.684018 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 499/972] 10.222.0.50 () {64 vars in 1317 bytes} [Sat Sep 24 05:10:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 05:10:02.887500 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-fb3c5ee7-509e-48e8-b9f8-b8349304e255 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Calling method '>' {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:10:02.888849 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.compute.api [None req-fb3c5ee7-509e-48e8-b9f8-b8349304e255 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] [instance: b2daebb8-dfea-4ab9-8253-008a21f906e1] Fetching instance by UUID {{(pid=120593) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:10:02.896964 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-fb3c5ee7-509e-48e8-b9f8-b8349304e255 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:10:02.897523 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-fb3c5ee7-509e-48e8-b9f8-b8349304e255 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:10:02.898057 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-fb3c5ee7-509e-48e8-b9f8-b8349304e255 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:10:02.899332 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-fb3c5ee7-509e-48e8-b9f8-b8349304e255 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:10:02.899940 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-fb3c5ee7-509e-48e8-b9f8-b8349304e255 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:10:02.900554 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-fb3c5ee7-509e-48e8-b9f8-b8349304e255 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:10:02.940631 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-fb3c5ee7-509e-48e8-b9f8-b8349304e255 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:10:02.941229 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-fb3c5ee7-509e-48e8-b9f8-b8349304e255 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:10:02.941661 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-fb3c5ee7-509e-48e8-b9f8-b8349304e255 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:10:02.942389 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.objects.instance [None req-fb3c5ee7-509e-48e8-b9f8-b8349304e255 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Lazy-loading 'fault' on Instance uuid b2daebb8-dfea-4ab9-8253-008a21f906e1 {{(pid=120593) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 24 05:10:02.988156 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-fb3c5ee7-509e-48e8-b9f8-b8349304e255 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b1b0448e7f54e3aaae49e411699269e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66ec8bde739145dda504995dbea0914a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:10:02.996503 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-fb3c5ee7-509e-48e8-b9f8-b8349304e255 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] 10.222.0.50 "GET /compute/v2.1/servers/b2daebb8-dfea-4ab9-8253-008a21f906e1" status: 200 len: 1327 microversion: 2.1 time: 0.113771 Sep 24 05:10:02.997076 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 474/973] 10.222.0.50 () {58 vars in 1236 bytes} [Sat Sep 24 05:10:02 2022] GET /compute/v2.1/servers/b2daebb8-dfea-4ab9-8253-008a21f906e1 => generated 1327 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 05:10:04.020900 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-a300fb83-56c9-4585-a3fc-f86f5d3328a7 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Calling method '>' {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:10:04.021591 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.compute.api [None req-a300fb83-56c9-4585-a3fc-f86f5d3328a7 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] [instance: b2daebb8-dfea-4ab9-8253-008a21f906e1] Fetching instance by UUID {{(pid=120594) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:10:04.028246 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-a300fb83-56c9-4585-a3fc-f86f5d3328a7 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:10:04.028749 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-a300fb83-56c9-4585-a3fc-f86f5d3328a7 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:10:04.029188 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-a300fb83-56c9-4585-a3fc-f86f5d3328a7 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:10:04.029873 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-a300fb83-56c9-4585-a3fc-f86f5d3328a7 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:10:04.030350 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-a300fb83-56c9-4585-a3fc-f86f5d3328a7 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:10:04.030828 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-a300fb83-56c9-4585-a3fc-f86f5d3328a7 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:10:04.044265 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: INFO nova.api.openstack.wsgi [None req-a300fb83-56c9-4585-a3fc-f86f5d3328a7 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] HTTP exception thrown: Instance b2daebb8-dfea-4ab9-8253-008a21f906e1 could not be found. Sep 24 05:10:04.045941 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-a300fb83-56c9-4585-a3fc-f86f5d3328a7 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Request method failure captured: Sep 24 05:10:04.045941 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: request: GET /compute/v2.1/servers/b2daebb8-dfea-4ab9-8253-008a21f906e1 HTTP/1.1 Sep 24 05:10:04.045941 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: Accept: application/json Sep 24 05:10:04.045941 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: Accept-Encoding: identity Sep 24 05:10:04.045941 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: Connection: close Sep 24 05:10:04.045941 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: Content-Length: 0 Sep 24 05:10:04.045941 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: Content-Type: application/json Sep 24 05:10:04.045941 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: Host: 10.222.0.50 Sep 24 05:10:04.045941 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: Openstack-System-Scope: None Sep 24 05:10:04.045941 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: User-Agent: python-urllib3/1.26.12 Sep 24 05:10:04.045941 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: X-Auth-Token: gAAAAABjLo8A_CV8_CcmOLJdbO1CHZ_VMsAEcpA541mM_Xx_bnEYb9KbQB8GkpDr_kW76CRgxi1HVxhwSWPV_l8j6w2MLcWnpsGWMgMDlRXPK4lnqHJLbW7N0ODeHl05uvEeeYUdVCWPx9rjn6MD1bgtDar8Ww4OaRkaEUlrdNMIOrO0dnM64TA Sep 24 05:10:04.045941 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: X-Domain-Id: None Sep 24 05:10:04.045941 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: X-Domain-Name: None Sep 24 05:10:04.045941 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: X-Identity-Status: Confirmed Sep 24 05:10:04.045941 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: X-Is-Admin-Project: True Sep 24 05:10:04.045941 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: X-Project-Domain-Id: default Sep 24 05:10:04.045941 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: X-Project-Domain-Name: Default Sep 24 05:10:04.045941 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: X-Project-Id: 66ec8bde739145dda504995dbea0914a Sep 24 05:10:04.045941 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: X-Project-Name: tempest-AttachVolumeTestJSON-1531469116 Sep 24 05:10:04.045941 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: X-Role: member,reader Sep 24 05:10:04.045941 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: X-Roles: member,reader Sep 24 05:10:04.047596 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/66ec8bde739145dda504995dbea0914a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/66ec8bde739145dda504995dbea0914a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/66ec8bde739145dda504995dbea0914a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.50:8080", "publicURL": "http://10.222.0.50:8080/v1/AUTH_66ec8bde739145dda504995dbea0914a"}]}] Sep 24 05:10:04.047596 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: X-Tenant: tempest-AttachVolumeTestJSON-1531469116 Sep 24 05:10:04.047596 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: X-Tenant-Id: 66ec8bde739145dda504995dbea0914a Sep 24 05:10:04.047596 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1531469116 Sep 24 05:10:04.047596 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: X-User: tempest-AttachVolumeTestJSON-1531469116-project Sep 24 05:10:04.047596 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: X-User-Domain-Id: default Sep 24 05:10:04.047596 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: X-User-Domain-Name: Default Sep 24 05:10:04.047596 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: X-User-Id: 4b1b0448e7f54e3aaae49e411699269e Sep 24 05:10:04.047596 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: X-User-Name: tempest-AttachVolumeTestJSON-1531469116-project Sep 24 05:10:04.047596 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: method: > Sep 24 05:10:04.047596 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: exception: Instance b2daebb8-dfea-4ab9-8253-008a21f906e1 could not be found. Sep 24 05:10:04.047596 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: action_args: {'id': 'b2daebb8-dfea-4ab9-8253-008a21f906e1'} Sep 24 05:10:04.048703 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 24 05:10:04.048703 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 05:10:04.048703 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 24 05:10:04.048703 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 24 05:10:04.048703 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 24 05:10:04.048703 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 24 05:10:04.048703 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 24 05:10:04.048703 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 24 05:10:04.048703 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 24 05:10:04.048703 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 24 05:10:04.048703 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b2daebb8-dfea-4ab9-8253-008a21f906e1 could not be found. Sep 24 05:10:04.048703 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi Sep 24 05:10:04.048703 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 05:10:04.048703 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi Sep 24 05:10:04.048703 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 05:10:04.048703 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 05:10:04.048703 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 05:10:04.048703 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 24 05:10:04.048703 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 24 05:10:04.048703 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 24 05:10:04.050342 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 24 05:10:04.050342 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 24 05:10:04.050342 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 24 05:10:04.050342 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 24 05:10:04.050342 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 24 05:10:04.050342 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 24 05:10:04.050342 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 24 05:10:04.050342 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b2daebb8-dfea-4ab9-8253-008a21f906e1 could not be found. Sep 24 05:10:04.050342 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi Sep 24 05:10:04.050342 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 05:10:04.050342 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi Sep 24 05:10:04.050342 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 05:10:04.050342 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 05:10:04.050342 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 05:10:04.050342 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 24 05:10:04.050342 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 24 05:10:04.050342 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b2daebb8-dfea-4ab9-8253-008a21f906e1 could not be found. Sep 24 05:10:04.050342 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi Sep 24 05:10:04.051879 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-a300fb83-56c9-4585-a3fc-f86f5d3328a7 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Returning 404 to user: Instance b2daebb8-dfea-4ab9-8253-008a21f906e1 could not be found. {{(pid=120594) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 24 05:10:04.051879 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [None req-a300fb83-56c9-4585-a3fc-f86f5d3328a7 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] 10.222.0.50 "GET /compute/v2.1/servers/b2daebb8-dfea-4ab9-8253-008a21f906e1" status: 404 len: 111 microversion: 2.1 time: 0.031592 Sep 24 05:10:04.051879 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 500/974] 10.222.0.50 () {58 vars in 1236 bytes} [Sat Sep 24 05:10:04 2022] GET /compute/v2.1/servers/b2daebb8-dfea-4ab9-8253-008a21f906e1 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 24 05:10:04.057145 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-3d3729f5-14de-4b1e-a914-480445845f3f tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Calling method '.version_select at 0x7f795055b820>' {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:10:04.076434 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-3d3729f5-14de-4b1e-a914-480445845f3f tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] 10.222.0.50 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2031057050" status: 202 len: 0 microversion: 2.1 time: 0.022964 Sep 24 05:10:04.077021 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 475/975] 10.222.0.50 () {58 vars in 1221 bytes} [Sat Sep 24 05:10:04 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2031057050 => generated 0 bytes in 24 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 24 05:10:04.706441 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-4c0d2cfa-3347-405b-b578-c3ac8d879d0e tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Action: 'create', calling method: .version_select at 0x7f795065a820>, body: {"keypair": {"name": "tempest-keypair-1053484567", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNorHXPzmdLpIMPeXcY0BOw8ghphFpwLsMgrqRlUzz3Dp7NDa724GXKzH5U89nnewmq2/rluyZ67lq82BsOc0wjbWQXdUKs/LVXI7zjrTmXRg2QdX4RX6rjVczKNRvhxeQ=="}} {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 05:10:04.721898 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.quota [None req-4c0d2cfa-3347-405b-b578-c3ac8d879d0e tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Getting quotas for project 66ec8bde739145dda504995dbea0914a. Resources: {'key_pairs'} {{(pid=120594) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 24 05:10:04.725597 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.quota [None req-4c0d2cfa-3347-405b-b578-c3ac8d879d0e tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Getting quotas for user 4b1b0448e7f54e3aaae49e411699269e and project 66ec8bde739145dda504995dbea0914a. Resources: {'key_pairs'} {{(pid=120594) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 24 05:10:04.746818 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [None req-4c0d2cfa-3347-405b-b578-c3ac8d879d0e tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] 10.222.0.50 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.044200 Sep 24 05:10:04.747391 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 501/976] 10.222.0.50 () {60 vars in 1159 bytes} [Sat Sep 24 05:10:04 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 05:10:06.175357 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-ccd6bec8-246d-4bd0-8370-7740eb5544ac tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-334997635", "imageRef": "75ab730a-d8cc-4ea2-b58f-0f3eb476c976", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "71010379-32a3-4ab2-bca2-8378eefa5ed7"}], "security_groups": [{"name": "tempest-securitygroup--332802625"}], "key_name": "tempest-keypair-1053484567", "user_data": "}} {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 05:10:06.306260 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.network.neutron [None req-ccd6bec8-246d-4bd0-8370-7740eb5544ac tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] validate_networks() for [('71010379-32a3-4ab2-bca2-8378eefa5ed7', None, None, None, None, None)] {{(pid=120593) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 24 05:10:06.709985 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.virt.hardware [None req-ccd6bec8-246d-4bd0-8370-7740eb5544ac tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Flavor limits 0:0:0 {{(pid=120593) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 24 05:10:06.710707 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.virt.hardware [None req-ccd6bec8-246d-4bd0-8370-7740eb5544ac tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Image limits 0:0:0 {{(pid=120593) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 24 05:10:06.711311 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.virt.hardware [None req-ccd6bec8-246d-4bd0-8370-7740eb5544ac tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Flavor pref 0:0:0 {{(pid=120593) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 24 05:10:06.712056 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.virt.hardware [None req-ccd6bec8-246d-4bd0-8370-7740eb5544ac tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Image pref 0:0:0 {{(pid=120593) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 24 05:10:06.712581 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.virt.hardware [None req-ccd6bec8-246d-4bd0-8370-7740eb5544ac tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120593) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 24 05:10:06.722030 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-ccd6bec8-246d-4bd0-8370-7740eb5544ac tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:10:06.722654 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-ccd6bec8-246d-4bd0-8370-7740eb5544ac tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:10:06.723196 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-ccd6bec8-246d-4bd0-8370-7740eb5544ac tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:10:06.724065 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-ccd6bec8-246d-4bd0-8370-7740eb5544ac tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:10:06.724635 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-ccd6bec8-246d-4bd0-8370-7740eb5544ac tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:10:06.725150 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-ccd6bec8-246d-4bd0-8370-7740eb5544ac tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:10:06.744835 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.quota [None req-ccd6bec8-246d-4bd0-8370-7740eb5544ac tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Getting quotas for project 66ec8bde739145dda504995dbea0914a. Resources: {'instances', 'ram', 'cores'} {{(pid=120593) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 24 05:10:06.748813 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.quota [None req-ccd6bec8-246d-4bd0-8370-7740eb5544ac tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Getting quotas for user 4b1b0448e7f54e3aaae49e411699269e and project 66ec8bde739145dda504995dbea0914a. Resources: {'instances', 'ram', 'cores'} {{(pid=120593) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 24 05:10:06.760244 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.compute.api [None req-ccd6bec8-246d-4bd0-8370-7740eb5544ac tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Going to run 1 instances... {{(pid=120593) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 24 05:10:06.762586 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.compute.api [None req-ccd6bec8-246d-4bd0-8370-7740eb5544ac tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] [instance: b551478f-d1dc-4ab3-9e44-4e78b785b21f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='75ab730a-d8cc-4ea2-b58f-0f3eb476c976',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120593) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 24 05:10:06.809113 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-ccd6bec8-246d-4bd0-8370-7740eb5544ac tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.639285 Sep 24 05:10:06.815854 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 476/977] 10.222.0.50 () {60 vars in 1147 bytes} [Sat Sep 24 05:10:06 2022] POST /compute/v2.1/servers => generated 401 bytes in 641 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 24 05:10:06.822545 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-15ca386e-b437-479d-8119-758bbeacbbb9 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Calling method '>' {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:10:06.823748 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.compute.api [None req-15ca386e-b437-479d-8119-758bbeacbbb9 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] [instance: b551478f-d1dc-4ab3-9e44-4e78b785b21f] Fetching instance by UUID {{(pid=120594) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:10:06.884062 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.policy [None req-15ca386e-b437-479d-8119-758bbeacbbb9 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b1b0448e7f54e3aaae49e411699269e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66ec8bde739145dda504995dbea0914a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:10:06.891095 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [None req-15ca386e-b437-479d-8119-758bbeacbbb9 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] 10.222.0.50 "GET /compute/v2.1/servers/b551478f-d1dc-4ab3-9e44-4e78b785b21f" status: 200 len: 1237 microversion: 2.1 time: 0.073961 Sep 24 05:10:06.891646 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 502/978] 10.222.0.50 () {58 vars in 1236 bytes} [Sat Sep 24 05:10:06 2022] GET /compute/v2.1/servers/b551478f-d1dc-4ab3-9e44-4e78b785b21f => generated 1237 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 05:10:07.915536 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-1754d8bd-b236-47f4-b01f-aaa66c13e6ea tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Calling method '>' {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:10:07.916131 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.compute.api [None req-1754d8bd-b236-47f4-b01f-aaa66c13e6ea tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] [instance: b551478f-d1dc-4ab3-9e44-4e78b785b21f] Fetching instance by UUID {{(pid=120593) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:10:07.922278 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-1754d8bd-b236-47f4-b01f-aaa66c13e6ea tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:10:07.922759 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-1754d8bd-b236-47f4-b01f-aaa66c13e6ea tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:10:07.923192 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-1754d8bd-b236-47f4-b01f-aaa66c13e6ea tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:10:07.923883 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-1754d8bd-b236-47f4-b01f-aaa66c13e6ea tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:10:07.924331 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-1754d8bd-b236-47f4-b01f-aaa66c13e6ea tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:10:07.924745 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-1754d8bd-b236-47f4-b01f-aaa66c13e6ea tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:10:07.994453 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-1754d8bd-b236-47f4-b01f-aaa66c13e6ea tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b1b0448e7f54e3aaae49e411699269e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66ec8bde739145dda504995dbea0914a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:10:08.012604 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-1754d8bd-b236-47f4-b01f-aaa66c13e6ea tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] 10.222.0.50 "GET /compute/v2.1/servers/b551478f-d1dc-4ab3-9e44-4e78b785b21f" status: 200 len: 1297 microversion: 2.1 time: 0.101811 Sep 24 05:10:08.018647 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 477/979] 10.222.0.50 () {58 vars in 1236 bytes} [Sat Sep 24 05:10:07 2022] GET /compute/v2.1/servers/b551478f-d1dc-4ab3-9e44-4e78b785b21f => generated 1297 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 05:10:09.038618 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-669dccdd-000f-4738-894b-ac530120f6f0 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Calling method '>' {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:10:09.039281 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.compute.api [None req-669dccdd-000f-4738-894b-ac530120f6f0 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] [instance: b551478f-d1dc-4ab3-9e44-4e78b785b21f] Fetching instance by UUID {{(pid=120594) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:10:09.045441 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-669dccdd-000f-4738-894b-ac530120f6f0 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:10:09.045928 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-669dccdd-000f-4738-894b-ac530120f6f0 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:10:09.046411 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-669dccdd-000f-4738-894b-ac530120f6f0 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:10:09.047117 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-669dccdd-000f-4738-894b-ac530120f6f0 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:10:09.047574 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-669dccdd-000f-4738-894b-ac530120f6f0 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:10:09.047999 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-669dccdd-000f-4738-894b-ac530120f6f0 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:10:09.184516 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.policy [None req-669dccdd-000f-4738-894b-ac530120f6f0 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b1b0448e7f54e3aaae49e411699269e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66ec8bde739145dda504995dbea0914a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:10:09.192349 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [None req-669dccdd-000f-4738-894b-ac530120f6f0 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] 10.222.0.50 "GET /compute/v2.1/servers/b551478f-d1dc-4ab3-9e44-4e78b785b21f" status: 200 len: 1362 microversion: 2.1 time: 0.157798 Sep 24 05:10:09.192922 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 503/980] 10.222.0.50 () {58 vars in 1236 bytes} [Sat Sep 24 05:10:09 2022] GET /compute/v2.1/servers/b551478f-d1dc-4ab3-9e44-4e78b785b21f => generated 1362 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 05:10:09.619256 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [req-0e150a1d-87d8-4eec-ac35-c0c202c7130a req-e2578f64-4129-4355-8f76-35f5d171f476 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b551478f-d1dc-4ab3-9e44-4e78b785b21f", "tag": "91027567-bf47-4165-9af7-f033dc54a3db"}]} {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 05:10:09.629775 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [req-0e150a1d-87d8-4eec-ac35-c0c202c7130a req-e2578f64-4129-4355-8f76-35f5d171f476 service nova] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:10:09.630566 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [req-0e150a1d-87d8-4eec-ac35-c0c202c7130a req-e2578f64-4129-4355-8f76-35f5d171f476 service nova] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:10:09.631070 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [req-0e150a1d-87d8-4eec-ac35-c0c202c7130a req-e2578f64-4129-4355-8f76-35f5d171f476 service nova] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:10:09.643687 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.compute.server_external_events [req-0e150a1d-87d8-4eec-ac35-c0c202c7130a req-e2578f64-4129-4355-8f76-35f5d171f476 service nova] Creating event network-changed:91027567-bf47-4165-9af7-f033dc54a3db for instance b551478f-d1dc-4ab3-9e44-4e78b785b21f on hv-cinder-85918 Sep 24 05:10:09.655253 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [req-0e150a1d-87d8-4eec-ac35-c0c202c7130a req-e2578f64-4129-4355-8f76-35f5d171f476 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038975 Sep 24 05:10:09.655882 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 478/981] 10.222.0.50 () {64 vars in 1317 bytes} [Sat Sep 24 05:10:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 05:10:10.216899 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-952ab433-9421-4cc6-a1c0-51371b4b3e8e tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Calling method '>' {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:10:10.217535 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.compute.api [None req-952ab433-9421-4cc6-a1c0-51371b4b3e8e tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] [instance: b551478f-d1dc-4ab3-9e44-4e78b785b21f] Fetching instance by UUID {{(pid=120594) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:10:10.223925 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-952ab433-9421-4cc6-a1c0-51371b4b3e8e tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:10:10.224407 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-952ab433-9421-4cc6-a1c0-51371b4b3e8e tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:10:10.224843 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-952ab433-9421-4cc6-a1c0-51371b4b3e8e tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:10:10.225528 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-952ab433-9421-4cc6-a1c0-51371b4b3e8e tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:10:10.225979 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-952ab433-9421-4cc6-a1c0-51371b4b3e8e tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:10:10.226429 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-952ab433-9421-4cc6-a1c0-51371b4b3e8e tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:10:10.352402 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.policy [None req-952ab433-9421-4cc6-a1c0-51371b4b3e8e tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b1b0448e7f54e3aaae49e411699269e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66ec8bde739145dda504995dbea0914a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:10:10.359965 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [None req-952ab433-9421-4cc6-a1c0-51371b4b3e8e tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] 10.222.0.50 "GET /compute/v2.1/servers/b551478f-d1dc-4ab3-9e44-4e78b785b21f" status: 200 len: 1362 microversion: 2.1 time: 0.146969 Sep 24 05:10:10.360519 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 504/982] 10.222.0.50 () {58 vars in 1236 bytes} [Sat Sep 24 05:10:10 2022] GET /compute/v2.1/servers/b551478f-d1dc-4ab3-9e44-4e78b785b21f => generated 1362 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 05:10:11.383810 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-306ee5df-2dd3-4f0f-a97f-2a26a3c1905f tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Calling method '>' {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:10:11.384498 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.compute.api [None req-306ee5df-2dd3-4f0f-a97f-2a26a3c1905f tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] [instance: b551478f-d1dc-4ab3-9e44-4e78b785b21f] Fetching instance by UUID {{(pid=120593) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:10:11.390583 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-306ee5df-2dd3-4f0f-a97f-2a26a3c1905f tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:10:11.391061 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-306ee5df-2dd3-4f0f-a97f-2a26a3c1905f tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:10:11.391498 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-306ee5df-2dd3-4f0f-a97f-2a26a3c1905f tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:10:11.392178 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-306ee5df-2dd3-4f0f-a97f-2a26a3c1905f tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:10:11.392621 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-306ee5df-2dd3-4f0f-a97f-2a26a3c1905f tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:10:11.393093 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-306ee5df-2dd3-4f0f-a97f-2a26a3c1905f tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:10:11.519899 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-306ee5df-2dd3-4f0f-a97f-2a26a3c1905f tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b1b0448e7f54e3aaae49e411699269e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66ec8bde739145dda504995dbea0914a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:10:11.527999 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-306ee5df-2dd3-4f0f-a97f-2a26a3c1905f tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] 10.222.0.50 "GET /compute/v2.1/servers/b551478f-d1dc-4ab3-9e44-4e78b785b21f" status: 200 len: 1362 microversion: 2.1 time: 0.148903 Sep 24 05:10:11.528557 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 479/983] 10.222.0.50 () {58 vars in 1236 bytes} [Sat Sep 24 05:10:11 2022] GET /compute/v2.1/servers/b551478f-d1dc-4ab3-9e44-4e78b785b21f => generated 1362 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 05:10:12.550607 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-cb5cdc3b-cfe2-4216-8ffb-bd0396ba2818 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Calling method '>' {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:10:12.551246 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.compute.api [None req-cb5cdc3b-cfe2-4216-8ffb-bd0396ba2818 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] [instance: b551478f-d1dc-4ab3-9e44-4e78b785b21f] Fetching instance by UUID {{(pid=120594) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:10:12.557672 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-cb5cdc3b-cfe2-4216-8ffb-bd0396ba2818 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:10:12.558183 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-cb5cdc3b-cfe2-4216-8ffb-bd0396ba2818 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:10:12.558621 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-cb5cdc3b-cfe2-4216-8ffb-bd0396ba2818 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:10:12.559307 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-cb5cdc3b-cfe2-4216-8ffb-bd0396ba2818 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:10:12.559761 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-cb5cdc3b-cfe2-4216-8ffb-bd0396ba2818 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:10:12.560182 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-cb5cdc3b-cfe2-4216-8ffb-bd0396ba2818 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:10:12.689477 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.policy [None req-cb5cdc3b-cfe2-4216-8ffb-bd0396ba2818 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b1b0448e7f54e3aaae49e411699269e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66ec8bde739145dda504995dbea0914a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:10:12.697047 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [None req-cb5cdc3b-cfe2-4216-8ffb-bd0396ba2818 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] 10.222.0.50 "GET /compute/v2.1/servers/b551478f-d1dc-4ab3-9e44-4e78b785b21f" status: 200 len: 1362 microversion: 2.1 time: 0.150331 Sep 24 05:10:12.697607 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 505/984] 10.222.0.50 () {58 vars in 1236 bytes} [Sat Sep 24 05:10:12 2022] GET /compute/v2.1/servers/b551478f-d1dc-4ab3-9e44-4e78b785b21f => generated 1362 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 05:10:13.719374 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-535afd87-d53d-4dd2-a0f5-ffff59ac8683 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Calling method '>' {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:10:13.720018 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.compute.api [None req-535afd87-d53d-4dd2-a0f5-ffff59ac8683 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] [instance: b551478f-d1dc-4ab3-9e44-4e78b785b21f] Fetching instance by UUID {{(pid=120593) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:10:13.726385 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-535afd87-d53d-4dd2-a0f5-ffff59ac8683 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:10:13.727361 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-535afd87-d53d-4dd2-a0f5-ffff59ac8683 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:10:13.727794 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-535afd87-d53d-4dd2-a0f5-ffff59ac8683 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:10:13.728480 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-535afd87-d53d-4dd2-a0f5-ffff59ac8683 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:10:13.728918 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-535afd87-d53d-4dd2-a0f5-ffff59ac8683 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:10:13.729344 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-535afd87-d53d-4dd2-a0f5-ffff59ac8683 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:10:13.864878 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-535afd87-d53d-4dd2-a0f5-ffff59ac8683 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b1b0448e7f54e3aaae49e411699269e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66ec8bde739145dda504995dbea0914a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:10:13.879657 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-535afd87-d53d-4dd2-a0f5-ffff59ac8683 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] 10.222.0.50 "GET /compute/v2.1/servers/b551478f-d1dc-4ab3-9e44-4e78b785b21f" status: 200 len: 1362 microversion: 2.1 time: 0.163857 Sep 24 05:10:13.880741 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 480/985] 10.222.0.50 () {58 vars in 1236 bytes} [Sat Sep 24 05:10:13 2022] GET /compute/v2.1/servers/b551478f-d1dc-4ab3-9e44-4e78b785b21f => generated 1362 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 05:10:14.903513 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-913bd765-08dd-434b-990a-2743da382d40 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Calling method '>' {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:10:14.904065 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.compute.api [None req-913bd765-08dd-434b-990a-2743da382d40 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] [instance: b551478f-d1dc-4ab3-9e44-4e78b785b21f] Fetching instance by UUID {{(pid=120594) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:10:14.910610 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-913bd765-08dd-434b-990a-2743da382d40 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:10:14.911080 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-913bd765-08dd-434b-990a-2743da382d40 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:10:14.911511 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-913bd765-08dd-434b-990a-2743da382d40 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:10:14.912224 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-913bd765-08dd-434b-990a-2743da382d40 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:10:14.912672 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-913bd765-08dd-434b-990a-2743da382d40 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:10:14.913097 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-913bd765-08dd-434b-990a-2743da382d40 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:10:15.041374 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.policy [None req-913bd765-08dd-434b-990a-2743da382d40 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b1b0448e7f54e3aaae49e411699269e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66ec8bde739145dda504995dbea0914a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:10:15.049090 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [None req-913bd765-08dd-434b-990a-2743da382d40 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] 10.222.0.50 "GET /compute/v2.1/servers/b551478f-d1dc-4ab3-9e44-4e78b785b21f" status: 200 len: 1362 microversion: 2.1 time: 0.150084 Sep 24 05:10:15.049655 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 506/986] 10.222.0.50 () {58 vars in 1236 bytes} [Sat Sep 24 05:10:14 2022] GET /compute/v2.1/servers/b551478f-d1dc-4ab3-9e44-4e78b785b21f => generated 1362 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 05:10:16.071899 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-acb0ce50-4a8f-4fdd-9cd6-f5621c0d77fe tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Calling method '>' {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:10:16.072469 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.compute.api [None req-acb0ce50-4a8f-4fdd-9cd6-f5621c0d77fe tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] [instance: b551478f-d1dc-4ab3-9e44-4e78b785b21f] Fetching instance by UUID {{(pid=120593) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:10:16.078772 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-acb0ce50-4a8f-4fdd-9cd6-f5621c0d77fe tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:10:16.079253 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-acb0ce50-4a8f-4fdd-9cd6-f5621c0d77fe tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:10:16.079719 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-acb0ce50-4a8f-4fdd-9cd6-f5621c0d77fe tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:10:16.080401 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-acb0ce50-4a8f-4fdd-9cd6-f5621c0d77fe tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:10:16.080852 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-acb0ce50-4a8f-4fdd-9cd6-f5621c0d77fe tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:10:16.081273 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-acb0ce50-4a8f-4fdd-9cd6-f5621c0d77fe tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:10:16.208772 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-acb0ce50-4a8f-4fdd-9cd6-f5621c0d77fe tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b1b0448e7f54e3aaae49e411699269e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66ec8bde739145dda504995dbea0914a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:10:16.217188 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-acb0ce50-4a8f-4fdd-9cd6-f5621c0d77fe tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] 10.222.0.50 "GET /compute/v2.1/servers/b551478f-d1dc-4ab3-9e44-4e78b785b21f" status: 200 len: 1362 microversion: 2.1 time: 0.149696 Sep 24 05:10:16.217756 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 481/987] 10.222.0.50 () {58 vars in 1236 bytes} [Sat Sep 24 05:10:16 2022] GET /compute/v2.1/servers/b551478f-d1dc-4ab3-9e44-4e78b785b21f => generated 1362 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 05:10:17.240376 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-47e5d0f1-495a-4231-870a-c9dc34797a22 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Calling method '>' {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:10:17.241455 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.compute.api [None req-47e5d0f1-495a-4231-870a-c9dc34797a22 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] [instance: b551478f-d1dc-4ab3-9e44-4e78b785b21f] Fetching instance by UUID {{(pid=120594) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:10:17.244403 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG dbcounter [-] [120594] Writing DB stats nova_cell0:SELECT=6 {{(pid=120594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 05:10:17.249588 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-47e5d0f1-495a-4231-870a-c9dc34797a22 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:10:17.250089 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-47e5d0f1-495a-4231-870a-c9dc34797a22 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:10:17.250531 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-47e5d0f1-495a-4231-870a-c9dc34797a22 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:10:17.251232 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-47e5d0f1-495a-4231-870a-c9dc34797a22 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:10:17.251683 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-47e5d0f1-495a-4231-870a-c9dc34797a22 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:10:17.252106 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-47e5d0f1-495a-4231-870a-c9dc34797a22 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:10:17.385645 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.policy [None req-47e5d0f1-495a-4231-870a-c9dc34797a22 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b1b0448e7f54e3aaae49e411699269e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66ec8bde739145dda504995dbea0914a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:10:17.393677 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [None req-47e5d0f1-495a-4231-870a-c9dc34797a22 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] 10.222.0.50 "GET /compute/v2.1/servers/b551478f-d1dc-4ab3-9e44-4e78b785b21f" status: 200 len: 1362 microversion: 2.1 time: 0.157474 Sep 24 05:10:17.394276 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 507/988] 10.222.0.50 () {58 vars in 1236 bytes} [Sat Sep 24 05:10:17 2022] GET /compute/v2.1/servers/b551478f-d1dc-4ab3-9e44-4e78b785b21f => generated 1362 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 05:10:18.416867 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-721bf0e0-7514-4435-8609-c8127c37f711 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Calling method '>' {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:10:18.417471 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.compute.api [None req-721bf0e0-7514-4435-8609-c8127c37f711 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] [instance: b551478f-d1dc-4ab3-9e44-4e78b785b21f] Fetching instance by UUID {{(pid=120593) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:10:18.419409 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG dbcounter [-] [120593] Writing DB stats nova_cell0:SELECT=2 {{(pid=120593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 05:10:18.420322 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG dbcounter [-] [120593] Writing DB stats nova_cell0:SELECT=6 {{(pid=120593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 05:10:18.426278 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-721bf0e0-7514-4435-8609-c8127c37f711 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:10:18.426754 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-721bf0e0-7514-4435-8609-c8127c37f711 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:10:18.427225 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-721bf0e0-7514-4435-8609-c8127c37f711 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:10:18.427964 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-721bf0e0-7514-4435-8609-c8127c37f711 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:10:18.428365 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-721bf0e0-7514-4435-8609-c8127c37f711 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:10:18.428782 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-721bf0e0-7514-4435-8609-c8127c37f711 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:10:18.559692 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-721bf0e0-7514-4435-8609-c8127c37f711 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b1b0448e7f54e3aaae49e411699269e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66ec8bde739145dda504995dbea0914a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:10:18.567406 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-721bf0e0-7514-4435-8609-c8127c37f711 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] 10.222.0.50 "GET /compute/v2.1/servers/b551478f-d1dc-4ab3-9e44-4e78b785b21f" status: 200 len: 1362 microversion: 2.1 time: 0.155108 Sep 24 05:10:18.568193 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 482/989] 10.222.0.50 () {58 vars in 1236 bytes} [Sat Sep 24 05:10:18 2022] GET /compute/v2.1/servers/b551478f-d1dc-4ab3-9e44-4e78b785b21f => generated 1362 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 05:10:19.520818 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [req-7a57a78e-bb8e-4186-962a-a60ac550cab2 req-e2837d82-da25-4535-84d9-f65681c26811 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b551478f-d1dc-4ab3-9e44-4e78b785b21f", "name": "network-vif-plugged", "status": "completed", "tag": "91027567-bf47-4165-9af7-f033dc54a3db"}]} {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 05:10:19.532948 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [req-7a57a78e-bb8e-4186-962a-a60ac550cab2 req-e2837d82-da25-4535-84d9-f65681c26811 service nova] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:10:19.533466 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [req-7a57a78e-bb8e-4186-962a-a60ac550cab2 req-e2837d82-da25-4535-84d9-f65681c26811 service nova] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:10:19.534330 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [req-7a57a78e-bb8e-4186-962a-a60ac550cab2 req-e2837d82-da25-4535-84d9-f65681c26811 service nova] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:10:19.547366 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: INFO nova.api.openstack.compute.server_external_events [req-7a57a78e-bb8e-4186-962a-a60ac550cab2 req-e2837d82-da25-4535-84d9-f65681c26811 service nova] Creating event network-vif-plugged:91027567-bf47-4165-9af7-f033dc54a3db for instance b551478f-d1dc-4ab3-9e44-4e78b785b21f on hv-cinder-85918 Sep 24 05:10:19.552393 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [req-7a57a78e-bb8e-4186-962a-a60ac550cab2 req-e2837d82-da25-4535-84d9-f65681c26811 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036041 Sep 24 05:10:19.553321 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 508/990] 10.222.0.50 () {64 vars in 1317 bytes} [Sat Sep 24 05:10:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 05:10:19.595355 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-9de95263-c6db-4132-9d27-06e30319f5cd tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Calling method '>' {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:10:19.595985 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.compute.api [None req-9de95263-c6db-4132-9d27-06e30319f5cd tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] [instance: b551478f-d1dc-4ab3-9e44-4e78b785b21f] Fetching instance by UUID {{(pid=120593) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:10:19.606325 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-9de95263-c6db-4132-9d27-06e30319f5cd tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:10:19.606841 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-9de95263-c6db-4132-9d27-06e30319f5cd tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:10:19.607494 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-9de95263-c6db-4132-9d27-06e30319f5cd tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:10:19.608202 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-9de95263-c6db-4132-9d27-06e30319f5cd tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:10:19.608825 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-9de95263-c6db-4132-9d27-06e30319f5cd tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:10:19.609252 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-9de95263-c6db-4132-9d27-06e30319f5cd tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:10:19.761009 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-9de95263-c6db-4132-9d27-06e30319f5cd tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b1b0448e7f54e3aaae49e411699269e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66ec8bde739145dda504995dbea0914a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:10:19.768610 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-9de95263-c6db-4132-9d27-06e30319f5cd tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] 10.222.0.50 "GET /compute/v2.1/servers/b551478f-d1dc-4ab3-9e44-4e78b785b21f" status: 200 len: 1362 microversion: 2.1 time: 0.183072 Sep 24 05:10:19.769346 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 483/991] 10.222.0.50 () {58 vars in 1236 bytes} [Sat Sep 24 05:10:19 2022] GET /compute/v2.1/servers/b551478f-d1dc-4ab3-9e44-4e78b785b21f => generated 1362 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 05:10:20.792567 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-d6a500e2-ee9d-4972-b70a-8bf99a149a2c tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Calling method '>' {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:10:20.793271 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.compute.api [None req-d6a500e2-ee9d-4972-b70a-8bf99a149a2c tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] [instance: b551478f-d1dc-4ab3-9e44-4e78b785b21f] Fetching instance by UUID {{(pid=120594) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:10:20.800254 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-d6a500e2-ee9d-4972-b70a-8bf99a149a2c tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:10:20.800738 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-d6a500e2-ee9d-4972-b70a-8bf99a149a2c tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:10:20.801174 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-d6a500e2-ee9d-4972-b70a-8bf99a149a2c tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:10:20.801862 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-d6a500e2-ee9d-4972-b70a-8bf99a149a2c tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:10:20.802360 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-d6a500e2-ee9d-4972-b70a-8bf99a149a2c tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:10:20.802786 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-d6a500e2-ee9d-4972-b70a-8bf99a149a2c tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:10:20.934467 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.policy [None req-d6a500e2-ee9d-4972-b70a-8bf99a149a2c tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b1b0448e7f54e3aaae49e411699269e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66ec8bde739145dda504995dbea0914a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:10:20.941968 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [None req-d6a500e2-ee9d-4972-b70a-8bf99a149a2c tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] 10.222.0.50 "GET /compute/v2.1/servers/b551478f-d1dc-4ab3-9e44-4e78b785b21f" status: 200 len: 1362 microversion: 2.1 time: 0.153646 Sep 24 05:10:20.942564 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 509/992] 10.222.0.50 () {58 vars in 1236 bytes} [Sat Sep 24 05:10:20 2022] GET /compute/v2.1/servers/b551478f-d1dc-4ab3-9e44-4e78b785b21f => generated 1362 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 05:10:21.965534 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-7822be94-4190-4002-a54f-9ee2595dd7cc tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Calling method '>' {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:10:21.966165 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.compute.api [None req-7822be94-4190-4002-a54f-9ee2595dd7cc tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] [instance: b551478f-d1dc-4ab3-9e44-4e78b785b21f] Fetching instance by UUID {{(pid=120593) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:10:21.972585 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-7822be94-4190-4002-a54f-9ee2595dd7cc tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:10:21.973061 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-7822be94-4190-4002-a54f-9ee2595dd7cc tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:10:21.973488 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-7822be94-4190-4002-a54f-9ee2595dd7cc tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:10:21.974206 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-7822be94-4190-4002-a54f-9ee2595dd7cc tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:10:21.974654 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-7822be94-4190-4002-a54f-9ee2595dd7cc tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:10:21.975073 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-7822be94-4190-4002-a54f-9ee2595dd7cc tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:10:22.098503 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-7822be94-4190-4002-a54f-9ee2595dd7cc tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b1b0448e7f54e3aaae49e411699269e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66ec8bde739145dda504995dbea0914a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:10:22.106020 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-7822be94-4190-4002-a54f-9ee2595dd7cc tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] 10.222.0.50 "GET /compute/v2.1/servers/b551478f-d1dc-4ab3-9e44-4e78b785b21f" status: 200 len: 1547 microversion: 2.1 time: 0.145000 Sep 24 05:10:22.106584 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 484/993] 10.222.0.50 () {58 vars in 1236 bytes} [Sat Sep 24 05:10:21 2022] GET /compute/v2.1/servers/b551478f-d1dc-4ab3-9e44-4e78b785b21f => generated 1547 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 05:10:22.127638 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-71eda0c5-d5a5-4a31-9327-fc039d9347c1 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Calling method '>' {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:10:22.128114 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.compute.api [None req-71eda0c5-d5a5-4a31-9327-fc039d9347c1 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] [instance: b551478f-d1dc-4ab3-9e44-4e78b785b21f] Fetching instance by UUID {{(pid=120594) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:10:22.134876 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-71eda0c5-d5a5-4a31-9327-fc039d9347c1 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:10:22.135356 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-71eda0c5-d5a5-4a31-9327-fc039d9347c1 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:10:22.135793 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-71eda0c5-d5a5-4a31-9327-fc039d9347c1 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:10:22.136480 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-71eda0c5-d5a5-4a31-9327-fc039d9347c1 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:10:22.136929 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-71eda0c5-d5a5-4a31-9327-fc039d9347c1 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:10:22.137354 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-71eda0c5-d5a5-4a31-9327-fc039d9347c1 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:10:22.214216 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [None req-71eda0c5-d5a5-4a31-9327-fc039d9347c1 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] 10.222.0.50 "GET /compute/v2.1/servers/b551478f-d1dc-4ab3-9e44-4e78b785b21f/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.090393 Sep 24 05:10:22.214809 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 510/994] 10.222.0.50 () {58 vars in 1275 bytes} [Sat Sep 24 05:10:22 2022] GET /compute/v2.1/servers/b551478f-d1dc-4ab3-9e44-4e78b785b21f/os-interface => generated 284 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 05:10:23.157605 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [req-2e2bd8f4-02f3-4d3d-84ba-7d84c603a806 req-190c9971-4504-45a1-89cf-0e9e4f44abfc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b551478f-d1dc-4ab3-9e44-4e78b785b21f", "tag": "91027567-bf47-4165-9af7-f033dc54a3db"}]} {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 05:10:23.172078 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [req-2e2bd8f4-02f3-4d3d-84ba-7d84c603a806 req-190c9971-4504-45a1-89cf-0e9e4f44abfc service nova] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:10:23.173228 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [req-2e2bd8f4-02f3-4d3d-84ba-7d84c603a806 req-190c9971-4504-45a1-89cf-0e9e4f44abfc service nova] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:10:23.174474 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [req-2e2bd8f4-02f3-4d3d-84ba-7d84c603a806 req-190c9971-4504-45a1-89cf-0e9e4f44abfc service nova] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:10:23.186630 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.compute.server_external_events [req-2e2bd8f4-02f3-4d3d-84ba-7d84c603a806 req-190c9971-4504-45a1-89cf-0e9e4f44abfc service nova] Creating event network-changed:91027567-bf47-4165-9af7-f033dc54a3db for instance b551478f-d1dc-4ab3-9e44-4e78b785b21f on hv-cinder-85918 Sep 24 05:10:23.191860 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [req-2e2bd8f4-02f3-4d3d-84ba-7d84c603a806 req-190c9971-4504-45a1-89cf-0e9e4f44abfc service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037687 Sep 24 05:10:23.193012 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 485/995] 10.222.0.50 () {64 vars in 1317 bytes} [Sat Sep 24 05:10:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 05:10:43.040335 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG dbcounter [-] [120594] Writing DB stats nova_api:SELECT=39,nova_api:INSERT=1 {{(pid=120594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 05:10:43.041147 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG dbcounter [-] [120594] Writing DB stats nova_cell1:SELECT=58 {{(pid=120594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 05:10:43.045560 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-e630aa35-32cc-4022-af05-c486cba61f34 tempest-TestMinimumBasicScenario-2093795776 tempest-TestMinimumBasicScenario-2093795776-project] Action: 'create', calling method: .version_select at 0x7f7950672dc0>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-1931805901", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMqwM85W0zclVLaVDCumfpX60MJ2OnM9hLthMiVinY9TaT+ksI2nMlrqATO7e/LhknRbex5jrvovH+qMYuJonfX8KacoTDWEONTbXAMvQlc1DPz2re2Fpkw74rsnePVuRQ=="}} {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 05:10:43.062085 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.quota [None req-e630aa35-32cc-4022-af05-c486cba61f34 tempest-TestMinimumBasicScenario-2093795776 tempest-TestMinimumBasicScenario-2093795776-project] Getting quotas for project 85c73f9a74da4079a54a503e0b42ca2e. Resources: {'key_pairs'} {{(pid=120594) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 24 05:10:43.065865 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.quota [None req-e630aa35-32cc-4022-af05-c486cba61f34 tempest-TestMinimumBasicScenario-2093795776 tempest-TestMinimumBasicScenario-2093795776-project] Getting quotas for user f67fe549bae6447f8b24219becb3bf97 and project 85c73f9a74da4079a54a503e0b42ca2e. Resources: {'key_pairs'} {{(pid=120594) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 24 05:10:43.087212 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [None req-e630aa35-32cc-4022-af05-c486cba61f34 tempest-TestMinimumBasicScenario-2093795776 tempest-TestMinimumBasicScenario-2093795776-project] 10.222.0.50 "POST /compute/v2.1/os-keypairs" status: 200 len: 403 microversion: 2.1 time: 0.048577 Sep 24 05:10:43.087797 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 511/996] 10.222.0.50 () {60 vars in 1159 bytes} [Sat Sep 24 05:10:43 2022] POST /compute/v2.1/os-keypairs => generated 403 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 05:10:43.135739 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG dbcounter [-] [120593] Writing DB stats nova_api:SELECT=49,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=120593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 05:10:43.136549 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG dbcounter [-] [120593] Writing DB stats nova_cell1:SELECT=76,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 05:10:43.141073 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-451612e1-6bec-431e-88df-890caab824fc tempest-TestMinimumBasicScenario-2093795776 tempest-TestMinimumBasicScenario-2093795776-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-1410956794", "imageRef": "cfb6ae67-7a42-45e1-8316-b63118a5aa48", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-1931805901", "networks": [{"uuid": "9c7e0f4c-425a-46df-96dd-7f26ab1e9fc1"}]}} {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 05:10:43.302309 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.network.neutron [None req-451612e1-6bec-431e-88df-890caab824fc tempest-TestMinimumBasicScenario-2093795776 tempest-TestMinimumBasicScenario-2093795776-project] validate_networks() for [('9c7e0f4c-425a-46df-96dd-7f26ab1e9fc1', None, None, None, None, None)] {{(pid=120593) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 24 05:10:43.673132 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.virt.hardware [None req-451612e1-6bec-431e-88df-890caab824fc tempest-TestMinimumBasicScenario-2093795776 tempest-TestMinimumBasicScenario-2093795776-project] Flavor limits 0:0:0 {{(pid=120593) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 24 05:10:43.673556 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.virt.hardware [None req-451612e1-6bec-431e-88df-890caab824fc tempest-TestMinimumBasicScenario-2093795776 tempest-TestMinimumBasicScenario-2093795776-project] Image limits 0:0:0 {{(pid=120593) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 24 05:10:43.674060 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.virt.hardware [None req-451612e1-6bec-431e-88df-890caab824fc tempest-TestMinimumBasicScenario-2093795776 tempest-TestMinimumBasicScenario-2093795776-project] Flavor pref 0:0:0 {{(pid=120593) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 24 05:10:43.674501 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.virt.hardware [None req-451612e1-6bec-431e-88df-890caab824fc tempest-TestMinimumBasicScenario-2093795776 tempest-TestMinimumBasicScenario-2093795776-project] Image pref 0:0:0 {{(pid=120593) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 24 05:10:43.674909 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.virt.hardware [None req-451612e1-6bec-431e-88df-890caab824fc tempest-TestMinimumBasicScenario-2093795776 tempest-TestMinimumBasicScenario-2093795776-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120593) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 24 05:10:43.684074 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-451612e1-6bec-431e-88df-890caab824fc tempest-TestMinimumBasicScenario-2093795776 tempest-TestMinimumBasicScenario-2093795776-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:10:43.684551 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-451612e1-6bec-431e-88df-890caab824fc tempest-TestMinimumBasicScenario-2093795776 tempest-TestMinimumBasicScenario-2093795776-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:10:43.684978 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-451612e1-6bec-431e-88df-890caab824fc tempest-TestMinimumBasicScenario-2093795776 tempest-TestMinimumBasicScenario-2093795776-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:10:43.685698 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-451612e1-6bec-431e-88df-890caab824fc tempest-TestMinimumBasicScenario-2093795776 tempest-TestMinimumBasicScenario-2093795776-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:10:43.686175 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-451612e1-6bec-431e-88df-890caab824fc tempest-TestMinimumBasicScenario-2093795776 tempest-TestMinimumBasicScenario-2093795776-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:10:43.686599 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-451612e1-6bec-431e-88df-890caab824fc tempest-TestMinimumBasicScenario-2093795776 tempest-TestMinimumBasicScenario-2093795776-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:10:43.702708 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.quota [None req-451612e1-6bec-431e-88df-890caab824fc tempest-TestMinimumBasicScenario-2093795776 tempest-TestMinimumBasicScenario-2093795776-project] Getting quotas for project 85c73f9a74da4079a54a503e0b42ca2e. Resources: {'instances', 'ram', 'cores'} {{(pid=120593) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 24 05:10:43.706615 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.quota [None req-451612e1-6bec-431e-88df-890caab824fc tempest-TestMinimumBasicScenario-2093795776 tempest-TestMinimumBasicScenario-2093795776-project] Getting quotas for user f67fe549bae6447f8b24219becb3bf97 and project 85c73f9a74da4079a54a503e0b42ca2e. Resources: {'instances', 'ram', 'cores'} {{(pid=120593) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 24 05:10:43.717681 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.compute.api [None req-451612e1-6bec-431e-88df-890caab824fc tempest-TestMinimumBasicScenario-2093795776 tempest-TestMinimumBasicScenario-2093795776-project] Going to run 1 instances... {{(pid=120593) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 24 05:10:43.720599 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.compute.api [None req-451612e1-6bec-431e-88df-890caab824fc tempest-TestMinimumBasicScenario-2093795776 tempest-TestMinimumBasicScenario-2093795776-project] [instance: c8dc693a-12ca-40a8-8ce8-4f5cb342fb8f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='cfb6ae67-7a42-45e1-8316-b63118a5aa48',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120593) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 24 05:10:43.772627 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-451612e1-6bec-431e-88df-890caab824fc tempest-TestMinimumBasicScenario-2093795776 tempest-TestMinimumBasicScenario-2093795776-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.638764 Sep 24 05:10:43.773200 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 486/997] 10.222.0.50 () {60 vars in 1147 bytes} [Sat Sep 24 05:10:43 2022] POST /compute/v2.1/servers => generated 380 bytes in 640 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 24 05:10:43.784018 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-16e9fc8a-f259-4f6f-8364-eb8b6f61edb7 tempest-TestMinimumBasicScenario-2093795776 tempest-TestMinimumBasicScenario-2093795776-project] Calling method '>' {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:10:43.784631 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.compute.api [None req-16e9fc8a-f259-4f6f-8364-eb8b6f61edb7 tempest-TestMinimumBasicScenario-2093795776 tempest-TestMinimumBasicScenario-2093795776-project] [instance: c8dc693a-12ca-40a8-8ce8-4f5cb342fb8f] Fetching instance by UUID {{(pid=120594) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:10:43.940312 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.policy [None req-16e9fc8a-f259-4f6f-8364-eb8b6f61edb7 tempest-TestMinimumBasicScenario-2093795776 tempest-TestMinimumBasicScenario-2093795776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f67fe549bae6447f8b24219becb3bf97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85c73f9a74da4079a54a503e0b42ca2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:10:43.949939 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [None req-16e9fc8a-f259-4f6f-8364-eb8b6f61edb7 tempest-TestMinimumBasicScenario-2093795776 tempest-TestMinimumBasicScenario-2093795776-project] 10.222.0.50 "GET /compute/v2.1/servers/c8dc693a-12ca-40a8-8ce8-4f5cb342fb8f" status: 200 len: 1259 microversion: 2.1 time: 0.169824 Sep 24 05:10:43.950518 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 512/998] 10.222.0.50 () {58 vars in 1236 bytes} [Sat Sep 24 05:10:43 2022] GET /compute/v2.1/servers/c8dc693a-12ca-40a8-8ce8-4f5cb342fb8f => generated 1259 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 05:10:44.973628 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-3388429f-a1d9-4d1f-b8ff-8aba0777ff43 tempest-TestMinimumBasicScenario-2093795776 tempest-TestMinimumBasicScenario-2093795776-project] Calling method '>' {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:10:44.975066 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.compute.api [None req-3388429f-a1d9-4d1f-b8ff-8aba0777ff43 tempest-TestMinimumBasicScenario-2093795776 tempest-TestMinimumBasicScenario-2093795776-project] [instance: c8dc693a-12ca-40a8-8ce8-4f5cb342fb8f] Fetching instance by UUID {{(pid=120593) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:10:44.982352 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-3388429f-a1d9-4d1f-b8ff-8aba0777ff43 tempest-TestMinimumBasicScenario-2093795776 tempest-TestMinimumBasicScenario-2093795776-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:10:44.982837 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-3388429f-a1d9-4d1f-b8ff-8aba0777ff43 tempest-TestMinimumBasicScenario-2093795776 tempest-TestMinimumBasicScenario-2093795776-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:10:44.983471 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-3388429f-a1d9-4d1f-b8ff-8aba0777ff43 tempest-TestMinimumBasicScenario-2093795776 tempest-TestMinimumBasicScenario-2093795776-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:10:44.984177 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-3388429f-a1d9-4d1f-b8ff-8aba0777ff43 tempest-TestMinimumBasicScenario-2093795776 tempest-TestMinimumBasicScenario-2093795776-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:10:44.984635 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-3388429f-a1d9-4d1f-b8ff-8aba0777ff43 tempest-TestMinimumBasicScenario-2093795776 tempest-TestMinimumBasicScenario-2093795776-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:10:44.985059 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-3388429f-a1d9-4d1f-b8ff-8aba0777ff43 tempest-TestMinimumBasicScenario-2093795776 tempest-TestMinimumBasicScenario-2093795776-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:10:45.057479 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-3388429f-a1d9-4d1f-b8ff-8aba0777ff43 tempest-TestMinimumBasicScenario-2093795776 tempest-TestMinimumBasicScenario-2093795776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f67fe549bae6447f8b24219becb3bf97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85c73f9a74da4079a54a503e0b42ca2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:10:45.067062 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-3388429f-a1d9-4d1f-b8ff-8aba0777ff43 tempest-TestMinimumBasicScenario-2093795776 tempest-TestMinimumBasicScenario-2093795776-project] 10.222.0.50 "GET /compute/v2.1/servers/c8dc693a-12ca-40a8-8ce8-4f5cb342fb8f" status: 200 len: 1329 microversion: 2.1 time: 0.098005 Sep 24 05:10:45.067654 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 487/999] 10.222.0.50 () {58 vars in 1236 bytes} [Sat Sep 24 05:10:44 2022] GET /compute/v2.1/servers/c8dc693a-12ca-40a8-8ce8-4f5cb342fb8f => generated 1329 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 05:10:46.090490 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-42ba5c20-e20e-4848-be06-0c7b5e98991b tempest-TestMinimumBasicScenario-2093795776 tempest-TestMinimumBasicScenario-2093795776-project] Calling method '>' {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:10:46.091034 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.compute.api [None req-42ba5c20-e20e-4848-be06-0c7b5e98991b tempest-TestMinimumBasicScenario-2093795776 tempest-TestMinimumBasicScenario-2093795776-project] [instance: c8dc693a-12ca-40a8-8ce8-4f5cb342fb8f] Fetching instance by UUID {{(pid=120594) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:10:46.097337 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-42ba5c20-e20e-4848-be06-0c7b5e98991b tempest-TestMinimumBasicScenario-2093795776 tempest-TestMinimumBasicScenario-2093795776-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:10:46.097816 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-42ba5c20-e20e-4848-be06-0c7b5e98991b tempest-TestMinimumBasicScenario-2093795776 tempest-TestMinimumBasicScenario-2093795776-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:10:46.098278 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-42ba5c20-e20e-4848-be06-0c7b5e98991b tempest-TestMinimumBasicScenario-2093795776 tempest-TestMinimumBasicScenario-2093795776-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:10:46.098968 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-42ba5c20-e20e-4848-be06-0c7b5e98991b tempest-TestMinimumBasicScenario-2093795776 tempest-TestMinimumBasicScenario-2093795776-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:10:46.099420 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-42ba5c20-e20e-4848-be06-0c7b5e98991b tempest-TestMinimumBasicScenario-2093795776 tempest-TestMinimumBasicScenario-2093795776-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:10:46.099840 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-42ba5c20-e20e-4848-be06-0c7b5e98991b tempest-TestMinimumBasicScenario-2093795776 tempest-TestMinimumBasicScenario-2093795776-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:10:46.233712 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.policy [None req-42ba5c20-e20e-4848-be06-0c7b5e98991b tempest-TestMinimumBasicScenario-2093795776 tempest-TestMinimumBasicScenario-2093795776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f67fe549bae6447f8b24219becb3bf97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85c73f9a74da4079a54a503e0b42ca2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:10:46.241467 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [None req-42ba5c20-e20e-4848-be06-0c7b5e98991b tempest-TestMinimumBasicScenario-2093795776 tempest-TestMinimumBasicScenario-2093795776-project] 10.222.0.50 "GET /compute/v2.1/servers/c8dc693a-12ca-40a8-8ce8-4f5cb342fb8f" status: 200 len: 1359 microversion: 2.1 time: 0.155573 Sep 24 05:10:46.242258 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 513/1000] 10.222.0.50 () {58 vars in 1236 bytes} [Sat Sep 24 05:10:46 2022] GET /compute/v2.1/servers/c8dc693a-12ca-40a8-8ce8-4f5cb342fb8f => generated 1359 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 05:10:47.266172 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-4081bc4e-8012-416f-840b-9da8682b7556 tempest-TestMinimumBasicScenario-2093795776 tempest-TestMinimumBasicScenario-2093795776-project] Calling method '>' {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:10:47.266879 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.compute.api [None req-4081bc4e-8012-416f-840b-9da8682b7556 tempest-TestMinimumBasicScenario-2093795776 tempest-TestMinimumBasicScenario-2093795776-project] [instance: c8dc693a-12ca-40a8-8ce8-4f5cb342fb8f] Fetching instance by UUID {{(pid=120593) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:10:47.273782 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-4081bc4e-8012-416f-840b-9da8682b7556 tempest-TestMinimumBasicScenario-2093795776 tempest-TestMinimumBasicScenario-2093795776-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:10:47.274308 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-4081bc4e-8012-416f-840b-9da8682b7556 tempest-TestMinimumBasicScenario-2093795776 tempest-TestMinimumBasicScenario-2093795776-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:10:47.274750 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-4081bc4e-8012-416f-840b-9da8682b7556 tempest-TestMinimumBasicScenario-2093795776 tempest-TestMinimumBasicScenario-2093795776-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:10:47.275453 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-4081bc4e-8012-416f-840b-9da8682b7556 tempest-TestMinimumBasicScenario-2093795776 tempest-TestMinimumBasicScenario-2093795776-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:10:47.276411 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-4081bc4e-8012-416f-840b-9da8682b7556 tempest-TestMinimumBasicScenario-2093795776 tempest-TestMinimumBasicScenario-2093795776-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:10:47.276839 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-4081bc4e-8012-416f-840b-9da8682b7556 tempest-TestMinimumBasicScenario-2093795776 tempest-TestMinimumBasicScenario-2093795776-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:10:47.415571 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-4081bc4e-8012-416f-840b-9da8682b7556 tempest-TestMinimumBasicScenario-2093795776 tempest-TestMinimumBasicScenario-2093795776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f67fe549bae6447f8b24219becb3bf97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85c73f9a74da4079a54a503e0b42ca2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:10:47.423447 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-4081bc4e-8012-416f-840b-9da8682b7556 tempest-TestMinimumBasicScenario-2093795776 tempest-TestMinimumBasicScenario-2093795776-project] 10.222.0.50 "GET /compute/v2.1/servers/c8dc693a-12ca-40a8-8ce8-4f5cb342fb8f" status: 200 len: 1359 microversion: 2.1 time: 0.161463 Sep 24 05:10:47.424019 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 488/1001] 10.222.0.50 () {58 vars in 1236 bytes} [Sat Sep 24 05:10:47 2022] GET /compute/v2.1/servers/c8dc693a-12ca-40a8-8ce8-4f5cb342fb8f => generated 1359 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 05:10:48.446274 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-806c1013-0f1c-4cb8-a2bd-c860171ea72b tempest-TestMinimumBasicScenario-2093795776 tempest-TestMinimumBasicScenario-2093795776-project] Calling method '>' {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:10:48.446880 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.compute.api [None req-806c1013-0f1c-4cb8-a2bd-c860171ea72b tempest-TestMinimumBasicScenario-2093795776 tempest-TestMinimumBasicScenario-2093795776-project] [instance: c8dc693a-12ca-40a8-8ce8-4f5cb342fb8f] Fetching instance by UUID {{(pid=120594) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:10:48.454986 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-806c1013-0f1c-4cb8-a2bd-c860171ea72b tempest-TestMinimumBasicScenario-2093795776 tempest-TestMinimumBasicScenario-2093795776-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:10:48.455469 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-806c1013-0f1c-4cb8-a2bd-c860171ea72b tempest-TestMinimumBasicScenario-2093795776 tempest-TestMinimumBasicScenario-2093795776-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:10:48.455903 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-806c1013-0f1c-4cb8-a2bd-c860171ea72b tempest-TestMinimumBasicScenario-2093795776 tempest-TestMinimumBasicScenario-2093795776-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:10:48.456595 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-806c1013-0f1c-4cb8-a2bd-c860171ea72b tempest-TestMinimumBasicScenario-2093795776 tempest-TestMinimumBasicScenario-2093795776-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:10:48.457044 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-806c1013-0f1c-4cb8-a2bd-c860171ea72b tempest-TestMinimumBasicScenario-2093795776 tempest-TestMinimumBasicScenario-2093795776-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:10:48.457469 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-806c1013-0f1c-4cb8-a2bd-c860171ea72b tempest-TestMinimumBasicScenario-2093795776 tempest-TestMinimumBasicScenario-2093795776-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:10:48.606684 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.policy [None req-806c1013-0f1c-4cb8-a2bd-c860171ea72b tempest-TestMinimumBasicScenario-2093795776 tempest-TestMinimumBasicScenario-2093795776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f67fe549bae6447f8b24219becb3bf97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85c73f9a74da4079a54a503e0b42ca2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:10:48.613669 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [None req-806c1013-0f1c-4cb8-a2bd-c860171ea72b tempest-TestMinimumBasicScenario-2093795776 tempest-TestMinimumBasicScenario-2093795776-project] 10.222.0.50 "GET /compute/v2.1/servers/c8dc693a-12ca-40a8-8ce8-4f5cb342fb8f" status: 200 len: 1359 microversion: 2.1 time: 0.171216 Sep 24 05:10:48.614288 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 514/1002] 10.222.0.50 () {58 vars in 1236 bytes} [Sat Sep 24 05:10:48 2022] GET /compute/v2.1/servers/c8dc693a-12ca-40a8-8ce8-4f5cb342fb8f => generated 1359 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 05:10:49.638667 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-33e0563c-2524-498b-8ad2-7dd7739d1085 tempest-TestMinimumBasicScenario-2093795776 tempest-TestMinimumBasicScenario-2093795776-project] Calling method '>' {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:10:49.639340 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.compute.api [None req-33e0563c-2524-498b-8ad2-7dd7739d1085 tempest-TestMinimumBasicScenario-2093795776 tempest-TestMinimumBasicScenario-2093795776-project] [instance: c8dc693a-12ca-40a8-8ce8-4f5cb342fb8f] Fetching instance by UUID {{(pid=120593) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:10:49.648948 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-33e0563c-2524-498b-8ad2-7dd7739d1085 tempest-TestMinimumBasicScenario-2093795776 tempest-TestMinimumBasicScenario-2093795776-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:10:49.648948 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-33e0563c-2524-498b-8ad2-7dd7739d1085 tempest-TestMinimumBasicScenario-2093795776 tempest-TestMinimumBasicScenario-2093795776-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:10:49.648948 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-33e0563c-2524-498b-8ad2-7dd7739d1085 tempest-TestMinimumBasicScenario-2093795776 tempest-TestMinimumBasicScenario-2093795776-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:10:49.648948 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-33e0563c-2524-498b-8ad2-7dd7739d1085 tempest-TestMinimumBasicScenario-2093795776 tempest-TestMinimumBasicScenario-2093795776-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:10:49.649421 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-33e0563c-2524-498b-8ad2-7dd7739d1085 tempest-TestMinimumBasicScenario-2093795776 tempest-TestMinimumBasicScenario-2093795776-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:10:49.649421 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-33e0563c-2524-498b-8ad2-7dd7739d1085 tempest-TestMinimumBasicScenario-2093795776 tempest-TestMinimumBasicScenario-2093795776-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:10:49.785111 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-33e0563c-2524-498b-8ad2-7dd7739d1085 tempest-TestMinimumBasicScenario-2093795776 tempest-TestMinimumBasicScenario-2093795776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f67fe549bae6447f8b24219becb3bf97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85c73f9a74da4079a54a503e0b42ca2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:10:49.794538 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-33e0563c-2524-498b-8ad2-7dd7739d1085 tempest-TestMinimumBasicScenario-2093795776 tempest-TestMinimumBasicScenario-2093795776-project] 10.222.0.50 "GET /compute/v2.1/servers/c8dc693a-12ca-40a8-8ce8-4f5cb342fb8f" status: 200 len: 1359 microversion: 2.1 time: 0.161059 Sep 24 05:10:49.795331 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 489/1003] 10.222.0.50 () {58 vars in 1236 bytes} [Sat Sep 24 05:10:49 2022] GET /compute/v2.1/servers/c8dc693a-12ca-40a8-8ce8-4f5cb342fb8f => generated 1359 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 05:10:50.817886 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-cc04fe5e-f3e4-495a-8a78-8d0c9676261e tempest-TestMinimumBasicScenario-2093795776 tempest-TestMinimumBasicScenario-2093795776-project] Calling method '>' {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:10:50.818587 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.compute.api [None req-cc04fe5e-f3e4-495a-8a78-8d0c9676261e tempest-TestMinimumBasicScenario-2093795776 tempest-TestMinimumBasicScenario-2093795776-project] [instance: c8dc693a-12ca-40a8-8ce8-4f5cb342fb8f] Fetching instance by UUID {{(pid=120594) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:10:50.826542 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-cc04fe5e-f3e4-495a-8a78-8d0c9676261e tempest-TestMinimumBasicScenario-2093795776 tempest-TestMinimumBasicScenario-2093795776-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:10:50.827146 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-cc04fe5e-f3e4-495a-8a78-8d0c9676261e tempest-TestMinimumBasicScenario-2093795776 tempest-TestMinimumBasicScenario-2093795776-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:10:50.827741 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-cc04fe5e-f3e4-495a-8a78-8d0c9676261e tempest-TestMinimumBasicScenario-2093795776 tempest-TestMinimumBasicScenario-2093795776-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:10:50.828593 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-cc04fe5e-f3e4-495a-8a78-8d0c9676261e tempest-TestMinimumBasicScenario-2093795776 tempest-TestMinimumBasicScenario-2093795776-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:10:50.829127 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-cc04fe5e-f3e4-495a-8a78-8d0c9676261e tempest-TestMinimumBasicScenario-2093795776 tempest-TestMinimumBasicScenario-2093795776-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:10:50.829648 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-cc04fe5e-f3e4-495a-8a78-8d0c9676261e tempest-TestMinimumBasicScenario-2093795776 tempest-TestMinimumBasicScenario-2093795776-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:10:50.977736 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.policy [None req-cc04fe5e-f3e4-495a-8a78-8d0c9676261e tempest-TestMinimumBasicScenario-2093795776 tempest-TestMinimumBasicScenario-2093795776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f67fe549bae6447f8b24219becb3bf97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85c73f9a74da4079a54a503e0b42ca2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:10:50.986060 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [None req-cc04fe5e-f3e4-495a-8a78-8d0c9676261e tempest-TestMinimumBasicScenario-2093795776 tempest-TestMinimumBasicScenario-2093795776-project] 10.222.0.50 "GET /compute/v2.1/servers/c8dc693a-12ca-40a8-8ce8-4f5cb342fb8f" status: 200 len: 1359 microversion: 2.1 time: 0.171981 Sep 24 05:10:50.986627 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 515/1004] 10.222.0.50 () {58 vars in 1236 bytes} [Sat Sep 24 05:10:50 2022] GET /compute/v2.1/servers/c8dc693a-12ca-40a8-8ce8-4f5cb342fb8f => generated 1359 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 05:10:52.012340 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-310ab954-0649-4722-a7ab-dafb1e009da8 tempest-TestMinimumBasicScenario-2093795776 tempest-TestMinimumBasicScenario-2093795776-project] Calling method '>' {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:10:52.013044 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.compute.api [None req-310ab954-0649-4722-a7ab-dafb1e009da8 tempest-TestMinimumBasicScenario-2093795776 tempest-TestMinimumBasicScenario-2093795776-project] [instance: c8dc693a-12ca-40a8-8ce8-4f5cb342fb8f] Fetching instance by UUID {{(pid=120593) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:10:52.020312 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-310ab954-0649-4722-a7ab-dafb1e009da8 tempest-TestMinimumBasicScenario-2093795776 tempest-TestMinimumBasicScenario-2093795776-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:10:52.020956 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-310ab954-0649-4722-a7ab-dafb1e009da8 tempest-TestMinimumBasicScenario-2093795776 tempest-TestMinimumBasicScenario-2093795776-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:10:52.021550 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-310ab954-0649-4722-a7ab-dafb1e009da8 tempest-TestMinimumBasicScenario-2093795776 tempest-TestMinimumBasicScenario-2093795776-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:10:52.022437 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-310ab954-0649-4722-a7ab-dafb1e009da8 tempest-TestMinimumBasicScenario-2093795776 tempest-TestMinimumBasicScenario-2093795776-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:10:52.023114 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-310ab954-0649-4722-a7ab-dafb1e009da8 tempest-TestMinimumBasicScenario-2093795776 tempest-TestMinimumBasicScenario-2093795776-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:10:52.023607 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-310ab954-0649-4722-a7ab-dafb1e009da8 tempest-TestMinimumBasicScenario-2093795776 tempest-TestMinimumBasicScenario-2093795776-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:10:52.159719 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-310ab954-0649-4722-a7ab-dafb1e009da8 tempest-TestMinimumBasicScenario-2093795776 tempest-TestMinimumBasicScenario-2093795776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f67fe549bae6447f8b24219becb3bf97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85c73f9a74da4079a54a503e0b42ca2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:10:52.167540 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-310ab954-0649-4722-a7ab-dafb1e009da8 tempest-TestMinimumBasicScenario-2093795776 tempest-TestMinimumBasicScenario-2093795776-project] 10.222.0.50 "GET /compute/v2.1/servers/c8dc693a-12ca-40a8-8ce8-4f5cb342fb8f" status: 200 len: 1359 microversion: 2.1 time: 0.159776 Sep 24 05:10:52.168096 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 490/1005] 10.222.0.50 () {58 vars in 1236 bytes} [Sat Sep 24 05:10:52 2022] GET /compute/v2.1/servers/c8dc693a-12ca-40a8-8ce8-4f5cb342fb8f => generated 1359 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 05:10:53.190703 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-e3d90c6b-f7da-4da8-9467-0134e7c4aa4c tempest-TestMinimumBasicScenario-2093795776 tempest-TestMinimumBasicScenario-2093795776-project] Calling method '>' {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:10:53.191767 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.compute.api [None req-e3d90c6b-f7da-4da8-9467-0134e7c4aa4c tempest-TestMinimumBasicScenario-2093795776 tempest-TestMinimumBasicScenario-2093795776-project] [instance: c8dc693a-12ca-40a8-8ce8-4f5cb342fb8f] Fetching instance by UUID {{(pid=120594) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:10:53.199229 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-e3d90c6b-f7da-4da8-9467-0134e7c4aa4c tempest-TestMinimumBasicScenario-2093795776 tempest-TestMinimumBasicScenario-2093795776-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:10:53.199808 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-e3d90c6b-f7da-4da8-9467-0134e7c4aa4c tempest-TestMinimumBasicScenario-2093795776 tempest-TestMinimumBasicScenario-2093795776-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:10:53.200318 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-e3d90c6b-f7da-4da8-9467-0134e7c4aa4c tempest-TestMinimumBasicScenario-2093795776 tempest-TestMinimumBasicScenario-2093795776-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:10:53.201083 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-e3d90c6b-f7da-4da8-9467-0134e7c4aa4c tempest-TestMinimumBasicScenario-2093795776 tempest-TestMinimumBasicScenario-2093795776-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:10:53.201606 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-e3d90c6b-f7da-4da8-9467-0134e7c4aa4c tempest-TestMinimumBasicScenario-2093795776 tempest-TestMinimumBasicScenario-2093795776-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:10:53.202142 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-e3d90c6b-f7da-4da8-9467-0134e7c4aa4c tempest-TestMinimumBasicScenario-2093795776 tempest-TestMinimumBasicScenario-2093795776-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:10:53.335891 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.policy [None req-e3d90c6b-f7da-4da8-9467-0134e7c4aa4c tempest-TestMinimumBasicScenario-2093795776 tempest-TestMinimumBasicScenario-2093795776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f67fe549bae6447f8b24219becb3bf97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85c73f9a74da4079a54a503e0b42ca2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:10:53.349337 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [None req-e3d90c6b-f7da-4da8-9467-0134e7c4aa4c tempest-TestMinimumBasicScenario-2093795776 tempest-TestMinimumBasicScenario-2093795776-project] 10.222.0.50 "GET /compute/v2.1/servers/c8dc693a-12ca-40a8-8ce8-4f5cb342fb8f" status: 200 len: 1359 microversion: 2.1 time: 0.162406 Sep 24 05:10:53.349915 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 516/1006] 10.222.0.50 () {58 vars in 1236 bytes} [Sat Sep 24 05:10:53 2022] GET /compute/v2.1/servers/c8dc693a-12ca-40a8-8ce8-4f5cb342fb8f => generated 1359 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 05:10:54.372683 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-eae28de2-0b7e-4497-9c6c-3054e5f622a9 tempest-TestMinimumBasicScenario-2093795776 tempest-TestMinimumBasicScenario-2093795776-project] Calling method '>' {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:10:54.373289 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.compute.api [None req-eae28de2-0b7e-4497-9c6c-3054e5f622a9 tempest-TestMinimumBasicScenario-2093795776 tempest-TestMinimumBasicScenario-2093795776-project] [instance: c8dc693a-12ca-40a8-8ce8-4f5cb342fb8f] Fetching instance by UUID {{(pid=120593) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:10:54.375478 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG dbcounter [-] [120593] Writing DB stats nova_cell0:SELECT=2 {{(pid=120593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 05:10:54.376132 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG dbcounter [-] [120593] Writing DB stats nova_cell0:SELECT=6 {{(pid=120593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 05:10:54.382046 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-eae28de2-0b7e-4497-9c6c-3054e5f622a9 tempest-TestMinimumBasicScenario-2093795776 tempest-TestMinimumBasicScenario-2093795776-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:10:54.382528 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-eae28de2-0b7e-4497-9c6c-3054e5f622a9 tempest-TestMinimumBasicScenario-2093795776 tempest-TestMinimumBasicScenario-2093795776-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:10:54.383012 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-eae28de2-0b7e-4497-9c6c-3054e5f622a9 tempest-TestMinimumBasicScenario-2093795776 tempest-TestMinimumBasicScenario-2093795776-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:10:54.383725 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-eae28de2-0b7e-4497-9c6c-3054e5f622a9 tempest-TestMinimumBasicScenario-2093795776 tempest-TestMinimumBasicScenario-2093795776-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:10:54.384211 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-eae28de2-0b7e-4497-9c6c-3054e5f622a9 tempest-TestMinimumBasicScenario-2093795776 tempest-TestMinimumBasicScenario-2093795776-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:10:54.384660 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-eae28de2-0b7e-4497-9c6c-3054e5f622a9 tempest-TestMinimumBasicScenario-2093795776 tempest-TestMinimumBasicScenario-2093795776-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:10:54.528701 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-eae28de2-0b7e-4497-9c6c-3054e5f622a9 tempest-TestMinimumBasicScenario-2093795776 tempest-TestMinimumBasicScenario-2093795776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f67fe549bae6447f8b24219becb3bf97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85c73f9a74da4079a54a503e0b42ca2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:10:54.537002 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-eae28de2-0b7e-4497-9c6c-3054e5f622a9 tempest-TestMinimumBasicScenario-2093795776 tempest-TestMinimumBasicScenario-2093795776-project] 10.222.0.50 "GET /compute/v2.1/servers/c8dc693a-12ca-40a8-8ce8-4f5cb342fb8f" status: 200 len: 1359 microversion: 2.1 time: 0.168289 Sep 24 05:10:54.537563 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 491/1007] 10.222.0.50 () {58 vars in 1236 bytes} [Sat Sep 24 05:10:54 2022] GET /compute/v2.1/servers/c8dc693a-12ca-40a8-8ce8-4f5cb342fb8f => generated 1359 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 05:10:55.558904 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-45547a6a-1ae9-4b2b-8941-7186c977048a tempest-TestMinimumBasicScenario-2093795776 tempest-TestMinimumBasicScenario-2093795776-project] Calling method '>' {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:10:55.559597 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.compute.api [None req-45547a6a-1ae9-4b2b-8941-7186c977048a tempest-TestMinimumBasicScenario-2093795776 tempest-TestMinimumBasicScenario-2093795776-project] [instance: c8dc693a-12ca-40a8-8ce8-4f5cb342fb8f] Fetching instance by UUID {{(pid=120594) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:10:55.561283 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG dbcounter [-] [120594] Writing DB stats nova_cell0:SELECT=6 {{(pid=120594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 05:10:55.566949 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-45547a6a-1ae9-4b2b-8941-7186c977048a tempest-TestMinimumBasicScenario-2093795776 tempest-TestMinimumBasicScenario-2093795776-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:10:55.567603 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-45547a6a-1ae9-4b2b-8941-7186c977048a tempest-TestMinimumBasicScenario-2093795776 tempest-TestMinimumBasicScenario-2093795776-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:10:55.568037 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-45547a6a-1ae9-4b2b-8941-7186c977048a tempest-TestMinimumBasicScenario-2093795776 tempest-TestMinimumBasicScenario-2093795776-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:10:55.568717 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-45547a6a-1ae9-4b2b-8941-7186c977048a tempest-TestMinimumBasicScenario-2093795776 tempest-TestMinimumBasicScenario-2093795776-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:10:55.569316 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-45547a6a-1ae9-4b2b-8941-7186c977048a tempest-TestMinimumBasicScenario-2093795776 tempest-TestMinimumBasicScenario-2093795776-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:10:55.569758 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-45547a6a-1ae9-4b2b-8941-7186c977048a tempest-TestMinimumBasicScenario-2093795776 tempest-TestMinimumBasicScenario-2093795776-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:10:55.717521 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.policy [None req-45547a6a-1ae9-4b2b-8941-7186c977048a tempest-TestMinimumBasicScenario-2093795776 tempest-TestMinimumBasicScenario-2093795776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f67fe549bae6447f8b24219becb3bf97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85c73f9a74da4079a54a503e0b42ca2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:10:55.726286 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [None req-45547a6a-1ae9-4b2b-8941-7186c977048a tempest-TestMinimumBasicScenario-2093795776 tempest-TestMinimumBasicScenario-2093795776-project] 10.222.0.50 "GET /compute/v2.1/servers/c8dc693a-12ca-40a8-8ce8-4f5cb342fb8f" status: 200 len: 1359 microversion: 2.1 time: 0.171164 Sep 24 05:10:55.728759 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 517/1008] 10.222.0.50 () {58 vars in 1236 bytes} [Sat Sep 24 05:10:55 2022] GET /compute/v2.1/servers/c8dc693a-12ca-40a8-8ce8-4f5cb342fb8f => generated 1359 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 05:10:56.748853 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-1a5ca117-8669-44e5-8965-515753aadba0 tempest-TestMinimumBasicScenario-2093795776 tempest-TestMinimumBasicScenario-2093795776-project] Calling method '>' {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:10:56.749719 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.compute.api [None req-1a5ca117-8669-44e5-8965-515753aadba0 tempest-TestMinimumBasicScenario-2093795776 tempest-TestMinimumBasicScenario-2093795776-project] [instance: c8dc693a-12ca-40a8-8ce8-4f5cb342fb8f] Fetching instance by UUID {{(pid=120593) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:10:56.757968 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-1a5ca117-8669-44e5-8965-515753aadba0 tempest-TestMinimumBasicScenario-2093795776 tempest-TestMinimumBasicScenario-2093795776-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:10:56.758429 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-1a5ca117-8669-44e5-8965-515753aadba0 tempest-TestMinimumBasicScenario-2093795776 tempest-TestMinimumBasicScenario-2093795776-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:10:56.758860 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-1a5ca117-8669-44e5-8965-515753aadba0 tempest-TestMinimumBasicScenario-2093795776 tempest-TestMinimumBasicScenario-2093795776-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:10:56.759563 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-1a5ca117-8669-44e5-8965-515753aadba0 tempest-TestMinimumBasicScenario-2093795776 tempest-TestMinimumBasicScenario-2093795776-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:10:56.760018 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-1a5ca117-8669-44e5-8965-515753aadba0 tempest-TestMinimumBasicScenario-2093795776 tempest-TestMinimumBasicScenario-2093795776-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:10:56.760509 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-1a5ca117-8669-44e5-8965-515753aadba0 tempest-TestMinimumBasicScenario-2093795776 tempest-TestMinimumBasicScenario-2093795776-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:10:56.884337 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-1a5ca117-8669-44e5-8965-515753aadba0 tempest-TestMinimumBasicScenario-2093795776 tempest-TestMinimumBasicScenario-2093795776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f67fe549bae6447f8b24219becb3bf97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85c73f9a74da4079a54a503e0b42ca2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:10:56.891913 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-1a5ca117-8669-44e5-8965-515753aadba0 tempest-TestMinimumBasicScenario-2093795776 tempest-TestMinimumBasicScenario-2093795776-project] 10.222.0.50 "GET /compute/v2.1/servers/c8dc693a-12ca-40a8-8ce8-4f5cb342fb8f" status: 200 len: 1359 microversion: 2.1 time: 0.147064 Sep 24 05:10:56.892483 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 492/1009] 10.222.0.50 () {58 vars in 1236 bytes} [Sat Sep 24 05:10:56 2022] GET /compute/v2.1/servers/c8dc693a-12ca-40a8-8ce8-4f5cb342fb8f => generated 1359 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 05:10:57.915122 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-98cb5d97-0c45-401a-b063-4eba2d818f09 tempest-TestMinimumBasicScenario-2093795776 tempest-TestMinimumBasicScenario-2093795776-project] Calling method '>' {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:10:57.915652 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.compute.api [None req-98cb5d97-0c45-401a-b063-4eba2d818f09 tempest-TestMinimumBasicScenario-2093795776 tempest-TestMinimumBasicScenario-2093795776-project] [instance: c8dc693a-12ca-40a8-8ce8-4f5cb342fb8f] Fetching instance by UUID {{(pid=120594) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:10:57.922501 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-98cb5d97-0c45-401a-b063-4eba2d818f09 tempest-TestMinimumBasicScenario-2093795776 tempest-TestMinimumBasicScenario-2093795776-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:10:57.922977 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-98cb5d97-0c45-401a-b063-4eba2d818f09 tempest-TestMinimumBasicScenario-2093795776 tempest-TestMinimumBasicScenario-2093795776-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:10:57.923403 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-98cb5d97-0c45-401a-b063-4eba2d818f09 tempest-TestMinimumBasicScenario-2093795776 tempest-TestMinimumBasicScenario-2093795776-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:10:57.924082 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-98cb5d97-0c45-401a-b063-4eba2d818f09 tempest-TestMinimumBasicScenario-2093795776 tempest-TestMinimumBasicScenario-2093795776-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:10:57.924524 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-98cb5d97-0c45-401a-b063-4eba2d818f09 tempest-TestMinimumBasicScenario-2093795776 tempest-TestMinimumBasicScenario-2093795776-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:10:57.924947 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-98cb5d97-0c45-401a-b063-4eba2d818f09 tempest-TestMinimumBasicScenario-2093795776 tempest-TestMinimumBasicScenario-2093795776-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:10:58.048744 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.policy [None req-98cb5d97-0c45-401a-b063-4eba2d818f09 tempest-TestMinimumBasicScenario-2093795776 tempest-TestMinimumBasicScenario-2093795776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f67fe549bae6447f8b24219becb3bf97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85c73f9a74da4079a54a503e0b42ca2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:10:58.056260 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [None req-98cb5d97-0c45-401a-b063-4eba2d818f09 tempest-TestMinimumBasicScenario-2093795776 tempest-TestMinimumBasicScenario-2093795776-project] 10.222.0.50 "GET /compute/v2.1/servers/c8dc693a-12ca-40a8-8ce8-4f5cb342fb8f" status: 200 len: 1359 microversion: 2.1 time: 0.145274 Sep 24 05:10:58.056810 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 518/1010] 10.222.0.50 () {58 vars in 1236 bytes} [Sat Sep 24 05:10:57 2022] GET /compute/v2.1/servers/c8dc693a-12ca-40a8-8ce8-4f5cb342fb8f => generated 1359 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 05:10:59.079291 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-99ea0a11-d421-495a-b4ea-8a590a8225e6 tempest-TestMinimumBasicScenario-2093795776 tempest-TestMinimumBasicScenario-2093795776-project] Calling method '>' {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:10:59.080054 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.compute.api [None req-99ea0a11-d421-495a-b4ea-8a590a8225e6 tempest-TestMinimumBasicScenario-2093795776 tempest-TestMinimumBasicScenario-2093795776-project] [instance: c8dc693a-12ca-40a8-8ce8-4f5cb342fb8f] Fetching instance by UUID {{(pid=120593) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:10:59.086554 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-99ea0a11-d421-495a-b4ea-8a590a8225e6 tempest-TestMinimumBasicScenario-2093795776 tempest-TestMinimumBasicScenario-2093795776-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:10:59.087054 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-99ea0a11-d421-495a-b4ea-8a590a8225e6 tempest-TestMinimumBasicScenario-2093795776 tempest-TestMinimumBasicScenario-2093795776-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:10:59.087462 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-99ea0a11-d421-495a-b4ea-8a590a8225e6 tempest-TestMinimumBasicScenario-2093795776 tempest-TestMinimumBasicScenario-2093795776-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:10:59.088693 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-99ea0a11-d421-495a-b4ea-8a590a8225e6 tempest-TestMinimumBasicScenario-2093795776 tempest-TestMinimumBasicScenario-2093795776-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:10:59.089149 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-99ea0a11-d421-495a-b4ea-8a590a8225e6 tempest-TestMinimumBasicScenario-2093795776 tempest-TestMinimumBasicScenario-2093795776-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:10:59.089574 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-99ea0a11-d421-495a-b4ea-8a590a8225e6 tempest-TestMinimumBasicScenario-2093795776 tempest-TestMinimumBasicScenario-2093795776-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:10:59.225228 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-99ea0a11-d421-495a-b4ea-8a590a8225e6 tempest-TestMinimumBasicScenario-2093795776 tempest-TestMinimumBasicScenario-2093795776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f67fe549bae6447f8b24219becb3bf97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85c73f9a74da4079a54a503e0b42ca2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:10:59.234730 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-99ea0a11-d421-495a-b4ea-8a590a8225e6 tempest-TestMinimumBasicScenario-2093795776 tempest-TestMinimumBasicScenario-2093795776-project] 10.222.0.50 "GET /compute/v2.1/servers/c8dc693a-12ca-40a8-8ce8-4f5cb342fb8f" status: 200 len: 1359 microversion: 2.1 time: 0.158307 Sep 24 05:10:59.234730 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 493/1011] 10.222.0.50 () {58 vars in 1236 bytes} [Sat Sep 24 05:10:59 2022] GET /compute/v2.1/servers/c8dc693a-12ca-40a8-8ce8-4f5cb342fb8f => generated 1359 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 05:10:59.409655 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-763fd69e-7a12-40ad-92c7-d40c7ce1b7da tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Calling method '>' {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:10:59.410180 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.compute.api [None req-763fd69e-7a12-40ad-92c7-d40c7ce1b7da tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] [instance: 36f8e098-a4b5-40a4-8f49-f341c5ad940c] Fetching instance by UUID {{(pid=120594) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:10:59.416375 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-763fd69e-7a12-40ad-92c7-d40c7ce1b7da tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:10:59.416849 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-763fd69e-7a12-40ad-92c7-d40c7ce1b7da tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:10:59.417280 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-763fd69e-7a12-40ad-92c7-d40c7ce1b7da tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:10:59.417954 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-763fd69e-7a12-40ad-92c7-d40c7ce1b7da tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:10:59.418424 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-763fd69e-7a12-40ad-92c7-d40c7ce1b7da tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:10:59.418845 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-763fd69e-7a12-40ad-92c7-d40c7ce1b7da tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:10:59.442723 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [None req-763fd69e-7a12-40ad-92c7-d40c7ce1b7da tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] 10.222.0.50 "GET /compute/v2.1/servers/36f8e098-a4b5-40a4-8f49-f341c5ad940c/ips" status: 200 len: 152 microversion: 2.20 time: 0.168578 Sep 24 05:10:59.443255 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 519/1012] 10.222.0.50 () {60 vars in 1289 bytes} [Sat Sep 24 05:10:59 2022] GET /compute/v2.1/servers/36f8e098-a4b5-40a4-8f49-f341c5ad940c/ips => generated 152 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 24 05:11:00.255954 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-7c248751-474d-4bcb-af0f-84c8f3b9f578 tempest-TestMinimumBasicScenario-2093795776 tempest-TestMinimumBasicScenario-2093795776-project] Calling method '>' {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:11:00.256560 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.compute.api [None req-7c248751-474d-4bcb-af0f-84c8f3b9f578 tempest-TestMinimumBasicScenario-2093795776 tempest-TestMinimumBasicScenario-2093795776-project] [instance: c8dc693a-12ca-40a8-8ce8-4f5cb342fb8f] Fetching instance by UUID {{(pid=120593) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:11:00.263388 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-7c248751-474d-4bcb-af0f-84c8f3b9f578 tempest-TestMinimumBasicScenario-2093795776 tempest-TestMinimumBasicScenario-2093795776-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:11:00.263864 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-7c248751-474d-4bcb-af0f-84c8f3b9f578 tempest-TestMinimumBasicScenario-2093795776 tempest-TestMinimumBasicScenario-2093795776-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:11:00.264326 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-7c248751-474d-4bcb-af0f-84c8f3b9f578 tempest-TestMinimumBasicScenario-2093795776 tempest-TestMinimumBasicScenario-2093795776-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:11:00.265025 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-7c248751-474d-4bcb-af0f-84c8f3b9f578 tempest-TestMinimumBasicScenario-2093795776 tempest-TestMinimumBasicScenario-2093795776-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:11:00.265453 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-7c248751-474d-4bcb-af0f-84c8f3b9f578 tempest-TestMinimumBasicScenario-2093795776 tempest-TestMinimumBasicScenario-2093795776-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:11:00.265875 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-7c248751-474d-4bcb-af0f-84c8f3b9f578 tempest-TestMinimumBasicScenario-2093795776 tempest-TestMinimumBasicScenario-2093795776-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:11:00.404710 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-7c248751-474d-4bcb-af0f-84c8f3b9f578 tempest-TestMinimumBasicScenario-2093795776 tempest-TestMinimumBasicScenario-2093795776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f67fe549bae6447f8b24219becb3bf97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85c73f9a74da4079a54a503e0b42ca2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:11:00.412546 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-7c248751-474d-4bcb-af0f-84c8f3b9f578 tempest-TestMinimumBasicScenario-2093795776 tempest-TestMinimumBasicScenario-2093795776-project] 10.222.0.50 "GET /compute/v2.1/servers/c8dc693a-12ca-40a8-8ce8-4f5cb342fb8f" status: 200 len: 1359 microversion: 2.1 time: 0.160466 Sep 24 05:11:00.413093 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 494/1013] 10.222.0.50 () {58 vars in 1236 bytes} [Sat Sep 24 05:11:00 2022] GET /compute/v2.1/servers/c8dc693a-12ca-40a8-8ce8-4f5cb342fb8f => generated 1359 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 05:11:00.460480 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [req-b27395a9-6930-412d-91dc-e6c7520fd0eb req-c07833fb-9c04-42c9-a2fd-b9a6c85007ab service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c8dc693a-12ca-40a8-8ce8-4f5cb342fb8f", "tag": "3c4098d3-98fe-49ac-9677-5b3632da2208"}]} {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 05:11:00.470970 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [req-b27395a9-6930-412d-91dc-e6c7520fd0eb req-c07833fb-9c04-42c9-a2fd-b9a6c85007ab service nova] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:11:00.471448 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [req-b27395a9-6930-412d-91dc-e6c7520fd0eb req-c07833fb-9c04-42c9-a2fd-b9a6c85007ab service nova] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:11:00.471875 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [req-b27395a9-6930-412d-91dc-e6c7520fd0eb req-c07833fb-9c04-42c9-a2fd-b9a6c85007ab service nova] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:11:00.487729 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: INFO nova.api.openstack.compute.server_external_events [req-b27395a9-6930-412d-91dc-e6c7520fd0eb req-c07833fb-9c04-42c9-a2fd-b9a6c85007ab service nova] Creating event network-changed:3c4098d3-98fe-49ac-9677-5b3632da2208 for instance c8dc693a-12ca-40a8-8ce8-4f5cb342fb8f on hv-cinder-85918 Sep 24 05:11:00.493644 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [req-b27395a9-6930-412d-91dc-e6c7520fd0eb req-c07833fb-9c04-42c9-a2fd-b9a6c85007ab service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036739 Sep 24 05:11:00.495912 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 520/1014] 10.222.0.50 () {64 vars in 1317 bytes} [Sat Sep 24 05:11:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 24 05:11:01.288728 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-07b8b7b2-cf34-4b80-847f-2e29d0fefe18 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 05:11:01.289223 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.compute.api [None req-07b8b7b2-cf34-4b80-847f-2e29d0fefe18 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] [instance: 36f8e098-a4b5-40a4-8f49-f341c5ad940c] Fetching instance by UUID {{(pid=120593) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:11:01.295509 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-07b8b7b2-cf34-4b80-847f-2e29d0fefe18 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:11:01.295986 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-07b8b7b2-cf34-4b80-847f-2e29d0fefe18 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:11:01.296423 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-07b8b7b2-cf34-4b80-847f-2e29d0fefe18 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:11:01.297100 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-07b8b7b2-cf34-4b80-847f-2e29d0fefe18 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:11:01.297546 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-07b8b7b2-cf34-4b80-847f-2e29d0fefe18 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:11:01.297966 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-07b8b7b2-cf34-4b80-847f-2e29d0fefe18 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:11:01.320844 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.objects.instance [None req-07b8b7b2-cf34-4b80-847f-2e29d0fefe18 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Lazy-loading 'flavor' on Instance uuid 36f8e098-a4b5-40a4-8f49-f341c5ad940c {{(pid=120593) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 24 05:11:01.436251 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-a60ad96b-e414-4ffc-9eb6-01a860fae758 tempest-TestMinimumBasicScenario-2093795776 tempest-TestMinimumBasicScenario-2093795776-project] Calling method '>' {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:11:01.436942 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.compute.api [None req-a60ad96b-e414-4ffc-9eb6-01a860fae758 tempest-TestMinimumBasicScenario-2093795776 tempest-TestMinimumBasicScenario-2093795776-project] [instance: c8dc693a-12ca-40a8-8ce8-4f5cb342fb8f] Fetching instance by UUID {{(pid=120594) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:11:01.443188 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-a60ad96b-e414-4ffc-9eb6-01a860fae758 tempest-TestMinimumBasicScenario-2093795776 tempest-TestMinimumBasicScenario-2093795776-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:11:01.443668 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-a60ad96b-e414-4ffc-9eb6-01a860fae758 tempest-TestMinimumBasicScenario-2093795776 tempest-TestMinimumBasicScenario-2093795776-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:11:01.444103 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-a60ad96b-e414-4ffc-9eb6-01a860fae758 tempest-TestMinimumBasicScenario-2093795776 tempest-TestMinimumBasicScenario-2093795776-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:11:01.444785 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-a60ad96b-e414-4ffc-9eb6-01a860fae758 tempest-TestMinimumBasicScenario-2093795776 tempest-TestMinimumBasicScenario-2093795776-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:11:01.445231 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-a60ad96b-e414-4ffc-9eb6-01a860fae758 tempest-TestMinimumBasicScenario-2093795776 tempest-TestMinimumBasicScenario-2093795776-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:11:01.445649 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-a60ad96b-e414-4ffc-9eb6-01a860fae758 tempest-TestMinimumBasicScenario-2093795776 tempest-TestMinimumBasicScenario-2093795776-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:11:01.504149 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-07b8b7b2-cf34-4b80-847f-2e29d0fefe18 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] 10.222.0.50 "POST /compute/v2.1/servers/36f8e098-a4b5-40a4-8f49-f341c5ad940c/action" status: 202 len: 0 microversion: 2.20 time: 0.219373 Sep 24 05:11:01.504736 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 495/1015] 10.222.0.50 () {62 vars in 1319 bytes} [Sat Sep 24 05:11:01 2022] POST /compute/v2.1/servers/36f8e098-a4b5-40a4-8f49-f341c5ad940c/action => generated 0 bytes in 221 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Sep 24 05:11:01.513799 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-b09488af-89cb-456a-a6d4-b42a33bfe299 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Calling method '>' {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:11:01.514529 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.compute.api [None req-b09488af-89cb-456a-a6d4-b42a33bfe299 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] [instance: 36f8e098-a4b5-40a4-8f49-f341c5ad940c] Fetching instance by UUID {{(pid=120593) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:11:01.520683 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-b09488af-89cb-456a-a6d4-b42a33bfe299 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:11:01.521194 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-b09488af-89cb-456a-a6d4-b42a33bfe299 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:11:01.521625 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-b09488af-89cb-456a-a6d4-b42a33bfe299 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:11:01.522331 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-b09488af-89cb-456a-a6d4-b42a33bfe299 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:11:01.522782 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-b09488af-89cb-456a-a6d4-b42a33bfe299 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:11:01.523198 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-b09488af-89cb-456a-a6d4-b42a33bfe299 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:11:01.614026 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.policy [None req-a60ad96b-e414-4ffc-9eb6-01a860fae758 tempest-TestMinimumBasicScenario-2093795776 tempest-TestMinimumBasicScenario-2093795776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f67fe549bae6447f8b24219becb3bf97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85c73f9a74da4079a54a503e0b42ca2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:11:01.623468 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [None req-a60ad96b-e414-4ffc-9eb6-01a860fae758 tempest-TestMinimumBasicScenario-2093795776 tempest-TestMinimumBasicScenario-2093795776-project] 10.222.0.50 "GET /compute/v2.1/servers/c8dc693a-12ca-40a8-8ce8-4f5cb342fb8f" status: 200 len: 1359 microversion: 2.1 time: 0.191912 Sep 24 05:11:01.626190 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 521/1016] 10.222.0.50 () {58 vars in 1236 bytes} [Sat Sep 24 05:11:01 2022] GET /compute/v2.1/servers/c8dc693a-12ca-40a8-8ce8-4f5cb342fb8f => generated 1359 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 24 05:11:01.675765 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-b09488af-89cb-456a-a6d4-b42a33bfe299 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0948754217fc4ff2ba0241fa35feaf90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1aaf20f480a423ea5feca81585aeeed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:11:01.684353 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-b09488af-89cb-456a-a6d4-b42a33bfe299 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0948754217fc4ff2ba0241fa35feaf90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1aaf20f480a423ea5feca81585aeeed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:11:01.685948 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-b09488af-89cb-456a-a6d4-b42a33bfe299 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0948754217fc4ff2ba0241fa35feaf90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1aaf20f480a423ea5feca81585aeeed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:11:01.687028 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-b09488af-89cb-456a-a6d4-b42a33bfe299 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] 10.222.0.50 "GET /compute/v2.1/servers/36f8e098-a4b5-40a4-8f49-f341c5ad940c" status: 200 len: 1724 microversion: 2.20 time: 0.178048 Sep 24 05:11:01.687585 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 496/1017] 10.222.0.50 () {60 vars in 1277 bytes} [Sat Sep 24 05:11:01 2022] GET /compute/v2.1/servers/36f8e098-a4b5-40a4-8f49-f341c5ad940c => generated 1724 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 24 05:11:02.516411 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [req-6814b4f8-1252-4dc8-b537-aeb1517450b2 req-3215ebe4-d0c9-47c0-bf7d-b04241c0669c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "60d69c7d-69e4-4b2a-b41c-692867a6e28d", "tag": "fab1bdaa-696a-4cf2-b4c6-ca1ee5692022"}]} {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 05:11:02.517082 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-e37a68c9-e873-4350-9288-6c637aab1798 tempest-TestShelveInstance-1085488420 tempest-TestShelveInstance-1085488420-project] Calling method '>' {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:11:02.517710 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.compute.api [None req-e37a68c9-e873-4350-9288-6c637aab1798 tempest-TestShelveInstance-1085488420 tempest-TestShelveInstance-1085488420-project] [instance: 60d69c7d-69e4-4b2a-b41c-692867a6e28d] Fetching instance by UUID {{(pid=120594) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:11:02.524040 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-e37a68c9-e873-4350-9288-6c637aab1798 tempest-TestShelveInstance-1085488420 tempest-TestShelveInstance-1085488420-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:11:02.524735 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-e37a68c9-e873-4350-9288-6c637aab1798 tempest-TestShelveInstance-1085488420 tempest-TestShelveInstance-1085488420-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:11:02.525270 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-e37a68c9-e873-4350-9288-6c637aab1798 tempest-TestShelveInstance-1085488420 tempest-TestShelveInstance-1085488420-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:11:02.526069 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-e37a68c9-e873-4350-9288-6c637aab1798 tempest-TestShelveInstance-1085488420 tempest-TestShelveInstance-1085488420-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:11:02.526742 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [req-6814b4f8-1252-4dc8-b537-aeb1517450b2 req-3215ebe4-d0c9-47c0-bf7d-b04241c0669c service nova] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:11:02.526896 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-e37a68c9-e873-4350-9288-6c637aab1798 tempest-TestShelveInstance-1085488420 tempest-TestShelveInstance-1085488420-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:11:02.527214 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [req-6814b4f8-1252-4dc8-b537-aeb1517450b2 req-3215ebe4-d0c9-47c0-bf7d-b04241c0669c service nova] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:11:02.527457 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-e37a68c9-e873-4350-9288-6c637aab1798 tempest-TestShelveInstance-1085488420 tempest-TestShelveInstance-1085488420-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:11:02.528009 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [req-6814b4f8-1252-4dc8-b537-aeb1517450b2 req-3215ebe4-d0c9-47c0-bf7d-b04241c0669c service nova] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:11:02.539508 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.compute.server_external_events [req-6814b4f8-1252-4dc8-b537-aeb1517450b2 req-3215ebe4-d0c9-47c0-bf7d-b04241c0669c service nova] Creating event network-changed:fab1bdaa-696a-4cf2-b4c6-ca1ee5692022 for instance 60d69c7d-69e4-4b2a-b41c-692867a6e28d on hv-cinder-85918 Sep 24 05:11:02.545157 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [req-6814b4f8-1252-4dc8-b537-aeb1517450b2 req-3215ebe4-d0c9-47c0-bf7d-b04241c0669c service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032624 Sep 24 05:11:02.545762 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 497/1018] 10.222.0.50 () {64 vars in 1317 bytes} [Sat Sep 24 05:11:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 05:11:02.556395 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.compute.api [None req-e37a68c9-e873-4350-9288-6c637aab1798 tempest-TestShelveInstance-1085488420 tempest-TestShelveInstance-1085488420-project] [instance: 60d69c7d-69e4-4b2a-b41c-692867a6e28d] Going to try to terminate instance {{(pid=120594) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 24 05:11:02.632553 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [None req-e37a68c9-e873-4350-9288-6c637aab1798 tempest-TestShelveInstance-1085488420 tempest-TestShelveInstance-1085488420-project] 10.222.0.50 "DELETE /compute/v2.1/servers/60d69c7d-69e4-4b2a-b41c-692867a6e28d" status: 204 len: 0 microversion: 2.1 time: 0.120161 Sep 24 05:11:02.633234 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 522/1019] 10.222.0.50 () {58 vars in 1239 bytes} [Sat Sep 24 05:11:02 2022] DELETE /compute/v2.1/servers/60d69c7d-69e4-4b2a-b41c-692867a6e28d => generated 0 bytes in 123 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Sep 24 05:11:02.642401 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-80735c08-ea38-43df-8683-c1e64534964b tempest-TestShelveInstance-1085488420 tempest-TestShelveInstance-1085488420-project] Calling method '>' {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:11:02.643097 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.compute.api [None req-80735c08-ea38-43df-8683-c1e64534964b tempest-TestShelveInstance-1085488420 tempest-TestShelveInstance-1085488420-project] [instance: 60d69c7d-69e4-4b2a-b41c-692867a6e28d] Fetching instance by UUID {{(pid=120593) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:11:02.646245 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-5d5ebff5-e35d-49d8-b74c-2df0ebbe8e2f tempest-TestMinimumBasicScenario-2093795776 tempest-TestMinimumBasicScenario-2093795776-project] Calling method '>' {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:11:02.646951 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.compute.api [None req-5d5ebff5-e35d-49d8-b74c-2df0ebbe8e2f tempest-TestMinimumBasicScenario-2093795776 tempest-TestMinimumBasicScenario-2093795776-project] [instance: c8dc693a-12ca-40a8-8ce8-4f5cb342fb8f] Fetching instance by UUID {{(pid=120594) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:11:02.649881 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-80735c08-ea38-43df-8683-c1e64534964b tempest-TestShelveInstance-1085488420 tempest-TestShelveInstance-1085488420-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:11:02.650588 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-80735c08-ea38-43df-8683-c1e64534964b tempest-TestShelveInstance-1085488420 tempest-TestShelveInstance-1085488420-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:11:02.651286 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-80735c08-ea38-43df-8683-c1e64534964b tempest-TestShelveInstance-1085488420 tempest-TestShelveInstance-1085488420-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:11:02.652203 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-80735c08-ea38-43df-8683-c1e64534964b tempest-TestShelveInstance-1085488420 tempest-TestShelveInstance-1085488420-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:11:02.652804 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-80735c08-ea38-43df-8683-c1e64534964b tempest-TestShelveInstance-1085488420 tempest-TestShelveInstance-1085488420-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:11:02.653684 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-80735c08-ea38-43df-8683-c1e64534964b tempest-TestShelveInstance-1085488420 tempest-TestShelveInstance-1085488420-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:11:02.653808 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-5d5ebff5-e35d-49d8-b74c-2df0ebbe8e2f tempest-TestMinimumBasicScenario-2093795776 tempest-TestMinimumBasicScenario-2093795776-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:11:02.654215 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-5d5ebff5-e35d-49d8-b74c-2df0ebbe8e2f tempest-TestMinimumBasicScenario-2093795776 tempest-TestMinimumBasicScenario-2093795776-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:11:02.654657 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-5d5ebff5-e35d-49d8-b74c-2df0ebbe8e2f tempest-TestMinimumBasicScenario-2093795776 tempest-TestMinimumBasicScenario-2093795776-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:11:02.655355 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-5d5ebff5-e35d-49d8-b74c-2df0ebbe8e2f tempest-TestMinimumBasicScenario-2093795776 tempest-TestMinimumBasicScenario-2093795776-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:11:02.655805 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-5d5ebff5-e35d-49d8-b74c-2df0ebbe8e2f tempest-TestMinimumBasicScenario-2093795776 tempest-TestMinimumBasicScenario-2093795776-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:11:02.656227 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-5d5ebff5-e35d-49d8-b74c-2df0ebbe8e2f tempest-TestMinimumBasicScenario-2093795776 tempest-TestMinimumBasicScenario-2093795776-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:11:02.851726 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.policy [None req-5d5ebff5-e35d-49d8-b74c-2df0ebbe8e2f tempest-TestMinimumBasicScenario-2093795776 tempest-TestMinimumBasicScenario-2093795776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f67fe549bae6447f8b24219becb3bf97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85c73f9a74da4079a54a503e0b42ca2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:11:02.860899 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [None req-5d5ebff5-e35d-49d8-b74c-2df0ebbe8e2f tempest-TestMinimumBasicScenario-2093795776 tempest-TestMinimumBasicScenario-2093795776-project] 10.222.0.50 "GET /compute/v2.1/servers/c8dc693a-12ca-40a8-8ce8-4f5cb342fb8f" status: 200 len: 1359 microversion: 2.1 time: 0.218810 Sep 24 05:11:02.861468 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 523/1020] 10.222.0.50 () {58 vars in 1236 bytes} [Sat Sep 24 05:11:02 2022] GET /compute/v2.1/servers/c8dc693a-12ca-40a8-8ce8-4f5cb342fb8f => generated 1359 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 24 05:11:02.865263 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-80735c08-ea38-43df-8683-c1e64534964b tempest-TestShelveInstance-1085488420 tempest-TestShelveInstance-1085488420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8fe3c5c28964b768b2c0023fc62f163', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd3d02b11bdf45fe99687fda3d1078cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:11:02.866391 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-cc740143-3e65-401f-8474-0b2d4f8eb508 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Calling method '>' {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:11:02.867163 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.compute.api [None req-cc740143-3e65-401f-8474-0b2d4f8eb508 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] [instance: 36f8e098-a4b5-40a4-8f49-f341c5ad940c] Fetching instance by UUID {{(pid=120594) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:11:02.873129 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-cc740143-3e65-401f-8474-0b2d4f8eb508 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:11:02.873309 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-80735c08-ea38-43df-8683-c1e64534964b tempest-TestShelveInstance-1085488420 tempest-TestShelveInstance-1085488420-project] 10.222.0.50 "GET /compute/v2.1/servers/60d69c7d-69e4-4b2a-b41c-692867a6e28d" status: 200 len: 1561 microversion: 2.1 time: 0.235410 Sep 24 05:11:02.873921 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-cc740143-3e65-401f-8474-0b2d4f8eb508 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:11:02.874613 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-cc740143-3e65-401f-8474-0b2d4f8eb508 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:11:02.875476 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-cc740143-3e65-401f-8474-0b2d4f8eb508 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:11:02.876080 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-cc740143-3e65-401f-8474-0b2d4f8eb508 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:11:02.876741 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-cc740143-3e65-401f-8474-0b2d4f8eb508 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:11:02.886379 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 498/1021] 10.222.0.50 () {58 vars in 1236 bytes} [Sat Sep 24 05:11:02 2022] GET /compute/v2.1/servers/60d69c7d-69e4-4b2a-b41c-692867a6e28d => generated 1561 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 05:11:03.010836 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.policy [None req-cc740143-3e65-401f-8474-0b2d4f8eb508 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0948754217fc4ff2ba0241fa35feaf90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1aaf20f480a423ea5feca81585aeeed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:11:03.019479 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.policy [None req-cc740143-3e65-401f-8474-0b2d4f8eb508 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0948754217fc4ff2ba0241fa35feaf90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1aaf20f480a423ea5feca81585aeeed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:11:03.020940 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.policy [None req-cc740143-3e65-401f-8474-0b2d4f8eb508 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0948754217fc4ff2ba0241fa35feaf90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1aaf20f480a423ea5feca81585aeeed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:11:03.022239 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [None req-cc740143-3e65-401f-8474-0b2d4f8eb508 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] 10.222.0.50 "GET /compute/v2.1/servers/36f8e098-a4b5-40a4-8f49-f341c5ad940c" status: 200 len: 1724 microversion: 2.20 time: 0.159573 Sep 24 05:11:03.022802 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 524/1022] 10.222.0.50 () {60 vars in 1277 bytes} [Sat Sep 24 05:11:02 2022] GET /compute/v2.1/servers/36f8e098-a4b5-40a4-8f49-f341c5ad940c => generated 1724 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 05:11:03.886965 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-50a26769-3bff-42d7-891d-11b7258adc7a tempest-TestMinimumBasicScenario-2093795776 tempest-TestMinimumBasicScenario-2093795776-project] Calling method '>' {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:11:03.887508 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.compute.api [None req-50a26769-3bff-42d7-891d-11b7258adc7a tempest-TestMinimumBasicScenario-2093795776 tempest-TestMinimumBasicScenario-2093795776-project] [instance: c8dc693a-12ca-40a8-8ce8-4f5cb342fb8f] Fetching instance by UUID {{(pid=120593) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:11:03.893881 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-50a26769-3bff-42d7-891d-11b7258adc7a tempest-TestMinimumBasicScenario-2093795776 tempest-TestMinimumBasicScenario-2093795776-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:11:03.894393 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-50a26769-3bff-42d7-891d-11b7258adc7a tempest-TestMinimumBasicScenario-2093795776 tempest-TestMinimumBasicScenario-2093795776-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:11:03.894824 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-50a26769-3bff-42d7-891d-11b7258adc7a tempest-TestMinimumBasicScenario-2093795776 tempest-TestMinimumBasicScenario-2093795776-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:11:03.895504 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-50a26769-3bff-42d7-891d-11b7258adc7a tempest-TestMinimumBasicScenario-2093795776 tempest-TestMinimumBasicScenario-2093795776-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:11:03.895949 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-50a26769-3bff-42d7-891d-11b7258adc7a tempest-TestMinimumBasicScenario-2093795776 tempest-TestMinimumBasicScenario-2093795776-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:11:03.896369 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-50a26769-3bff-42d7-891d-11b7258adc7a tempest-TestMinimumBasicScenario-2093795776 tempest-TestMinimumBasicScenario-2093795776-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:11:03.898326 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-10a3d4ff-f596-46d8-84c3-28eff4b63f13 tempest-TestShelveInstance-1085488420 tempest-TestShelveInstance-1085488420-project] Calling method '>' {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:11:03.898933 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.compute.api [None req-10a3d4ff-f596-46d8-84c3-28eff4b63f13 tempest-TestShelveInstance-1085488420 tempest-TestShelveInstance-1085488420-project] [instance: 60d69c7d-69e4-4b2a-b41c-692867a6e28d] Fetching instance by UUID {{(pid=120594) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:11:03.905862 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-10a3d4ff-f596-46d8-84c3-28eff4b63f13 tempest-TestShelveInstance-1085488420 tempest-TestShelveInstance-1085488420-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:11:03.906365 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-10a3d4ff-f596-46d8-84c3-28eff4b63f13 tempest-TestShelveInstance-1085488420 tempest-TestShelveInstance-1085488420-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:11:03.906792 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-10a3d4ff-f596-46d8-84c3-28eff4b63f13 tempest-TestShelveInstance-1085488420 tempest-TestShelveInstance-1085488420-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:11:03.907474 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-10a3d4ff-f596-46d8-84c3-28eff4b63f13 tempest-TestShelveInstance-1085488420 tempest-TestShelveInstance-1085488420-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:11:03.907914 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-10a3d4ff-f596-46d8-84c3-28eff4b63f13 tempest-TestShelveInstance-1085488420 tempest-TestShelveInstance-1085488420-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:11:03.908331 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-10a3d4ff-f596-46d8-84c3-28eff4b63f13 tempest-TestShelveInstance-1085488420 tempest-TestShelveInstance-1085488420-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:11:04.093611 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-50a26769-3bff-42d7-891d-11b7258adc7a tempest-TestMinimumBasicScenario-2093795776 tempest-TestMinimumBasicScenario-2093795776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f67fe549bae6447f8b24219becb3bf97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85c73f9a74da4079a54a503e0b42ca2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:11:04.097211 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.policy [None req-10a3d4ff-f596-46d8-84c3-28eff4b63f13 tempest-TestShelveInstance-1085488420 tempest-TestShelveInstance-1085488420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8fe3c5c28964b768b2c0023fc62f163', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd3d02b11bdf45fe99687fda3d1078cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:11:04.101577 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-50a26769-3bff-42d7-891d-11b7258adc7a tempest-TestMinimumBasicScenario-2093795776 tempest-TestMinimumBasicScenario-2093795776-project] 10.222.0.50 "GET /compute/v2.1/servers/c8dc693a-12ca-40a8-8ce8-4f5cb342fb8f" status: 200 len: 1359 microversion: 2.1 time: 0.219050 Sep 24 05:11:04.102182 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 499/1023] 10.222.0.50 () {58 vars in 1236 bytes} [Sat Sep 24 05:11:03 2022] GET /compute/v2.1/servers/c8dc693a-12ca-40a8-8ce8-4f5cb342fb8f => generated 1359 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 05:11:04.105303 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [None req-10a3d4ff-f596-46d8-84c3-28eff4b63f13 tempest-TestShelveInstance-1085488420 tempest-TestShelveInstance-1085488420-project] 10.222.0.50 "GET /compute/v2.1/servers/60d69c7d-69e4-4b2a-b41c-692867a6e28d" status: 200 len: 1561 microversion: 2.1 time: 0.210760 Sep 24 05:11:04.105853 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 525/1024] 10.222.0.50 () {58 vars in 1236 bytes} [Sat Sep 24 05:11:03 2022] GET /compute/v2.1/servers/60d69c7d-69e4-4b2a-b41c-692867a6e28d => generated 1561 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 24 05:11:04.108096 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-3d5135f8-e2c9-4e58-884d-2a9a578db738 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Calling method '>' {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:11:04.108896 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.compute.api [None req-3d5135f8-e2c9-4e58-884d-2a9a578db738 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] [instance: 36f8e098-a4b5-40a4-8f49-f341c5ad940c] Fetching instance by UUID {{(pid=120593) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:11:04.114819 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-3d5135f8-e2c9-4e58-884d-2a9a578db738 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:11:04.115530 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-3d5135f8-e2c9-4e58-884d-2a9a578db738 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:11:04.115971 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-3d5135f8-e2c9-4e58-884d-2a9a578db738 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:11:04.116664 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-3d5135f8-e2c9-4e58-884d-2a9a578db738 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:11:04.117114 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-3d5135f8-e2c9-4e58-884d-2a9a578db738 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:11:04.117532 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-3d5135f8-e2c9-4e58-884d-2a9a578db738 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:11:04.250126 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-3d5135f8-e2c9-4e58-884d-2a9a578db738 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0948754217fc4ff2ba0241fa35feaf90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1aaf20f480a423ea5feca81585aeeed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:11:04.258121 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-3d5135f8-e2c9-4e58-884d-2a9a578db738 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0948754217fc4ff2ba0241fa35feaf90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1aaf20f480a423ea5feca81585aeeed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:11:04.259560 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-3d5135f8-e2c9-4e58-884d-2a9a578db738 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0948754217fc4ff2ba0241fa35feaf90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1aaf20f480a423ea5feca81585aeeed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:11:04.261335 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-3d5135f8-e2c9-4e58-884d-2a9a578db738 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] 10.222.0.50 "GET /compute/v2.1/servers/36f8e098-a4b5-40a4-8f49-f341c5ad940c" status: 200 len: 1724 microversion: 2.20 time: 0.157366 Sep 24 05:11:04.261973 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 500/1025] 10.222.0.50 () {60 vars in 1277 bytes} [Sat Sep 24 05:11:04 2022] GET /compute/v2.1/servers/36f8e098-a4b5-40a4-8f49-f341c5ad940c => generated 1724 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 05:11:05.124329 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-b208c4c1-0912-4c43-804b-ef5ed89d8ee6 tempest-TestMinimumBasicScenario-2093795776 tempest-TestMinimumBasicScenario-2093795776-project] Calling method '>' {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:11:05.125101 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.compute.api [None req-b208c4c1-0912-4c43-804b-ef5ed89d8ee6 tempest-TestMinimumBasicScenario-2093795776 tempest-TestMinimumBasicScenario-2093795776-project] [instance: c8dc693a-12ca-40a8-8ce8-4f5cb342fb8f] Fetching instance by UUID {{(pid=120594) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:11:05.128062 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-94ab6682-99d4-4d8e-8642-53abfe138e4a tempest-TestShelveInstance-1085488420 tempest-TestShelveInstance-1085488420-project] Calling method '>' {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:11:05.128669 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.compute.api [None req-94ab6682-99d4-4d8e-8642-53abfe138e4a tempest-TestShelveInstance-1085488420 tempest-TestShelveInstance-1085488420-project] [instance: 60d69c7d-69e4-4b2a-b41c-692867a6e28d] Fetching instance by UUID {{(pid=120593) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:11:05.131591 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-b208c4c1-0912-4c43-804b-ef5ed89d8ee6 tempest-TestMinimumBasicScenario-2093795776 tempest-TestMinimumBasicScenario-2093795776-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:11:05.131992 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-b208c4c1-0912-4c43-804b-ef5ed89d8ee6 tempest-TestMinimumBasicScenario-2093795776 tempest-TestMinimumBasicScenario-2093795776-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:11:05.132436 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-b208c4c1-0912-4c43-804b-ef5ed89d8ee6 tempest-TestMinimumBasicScenario-2093795776 tempest-TestMinimumBasicScenario-2093795776-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:11:05.133181 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-b208c4c1-0912-4c43-804b-ef5ed89d8ee6 tempest-TestMinimumBasicScenario-2093795776 tempest-TestMinimumBasicScenario-2093795776-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:11:05.133572 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-b208c4c1-0912-4c43-804b-ef5ed89d8ee6 tempest-TestMinimumBasicScenario-2093795776 tempest-TestMinimumBasicScenario-2093795776-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:11:05.133989 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-b208c4c1-0912-4c43-804b-ef5ed89d8ee6 tempest-TestMinimumBasicScenario-2093795776 tempest-TestMinimumBasicScenario-2093795776-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:11:05.136852 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-94ab6682-99d4-4d8e-8642-53abfe138e4a tempest-TestShelveInstance-1085488420 tempest-TestShelveInstance-1085488420-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:11:05.137516 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-94ab6682-99d4-4d8e-8642-53abfe138e4a tempest-TestShelveInstance-1085488420 tempest-TestShelveInstance-1085488420-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:11:05.137959 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-94ab6682-99d4-4d8e-8642-53abfe138e4a tempest-TestShelveInstance-1085488420 tempest-TestShelveInstance-1085488420-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:11:05.138686 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-94ab6682-99d4-4d8e-8642-53abfe138e4a tempest-TestShelveInstance-1085488420 tempest-TestShelveInstance-1085488420-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:11:05.139146 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-94ab6682-99d4-4d8e-8642-53abfe138e4a tempest-TestShelveInstance-1085488420 tempest-TestShelveInstance-1085488420-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:11:05.139571 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-94ab6682-99d4-4d8e-8642-53abfe138e4a tempest-TestShelveInstance-1085488420 tempest-TestShelveInstance-1085488420-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:11:05.332124 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.policy [None req-b208c4c1-0912-4c43-804b-ef5ed89d8ee6 tempest-TestMinimumBasicScenario-2093795776 tempest-TestMinimumBasicScenario-2093795776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f67fe549bae6447f8b24219becb3bf97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85c73f9a74da4079a54a503e0b42ca2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:11:05.336629 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-94ab6682-99d4-4d8e-8642-53abfe138e4a tempest-TestShelveInstance-1085488420 tempest-TestShelveInstance-1085488420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8fe3c5c28964b768b2c0023fc62f163', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd3d02b11bdf45fe99687fda3d1078cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:11:05.339860 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [None req-b208c4c1-0912-4c43-804b-ef5ed89d8ee6 tempest-TestMinimumBasicScenario-2093795776 tempest-TestMinimumBasicScenario-2093795776-project] 10.222.0.50 "GET /compute/v2.1/servers/c8dc693a-12ca-40a8-8ce8-4f5cb342fb8f" status: 200 len: 1359 microversion: 2.1 time: 0.219382 Sep 24 05:11:05.340247 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG dbcounter [-] [120593] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 05:11:05.340427 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 526/1026] 10.222.0.50 () {58 vars in 1236 bytes} [Sat Sep 24 05:11:05 2022] GET /compute/v2.1/servers/c8dc693a-12ca-40a8-8ce8-4f5cb342fb8f => generated 1359 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 05:11:05.345043 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-78c796d0-f600-4029-99a1-341ea9381448 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Calling method '>' {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:11:05.345497 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-94ab6682-99d4-4d8e-8642-53abfe138e4a tempest-TestShelveInstance-1085488420 tempest-TestShelveInstance-1085488420-project] 10.222.0.50 "GET /compute/v2.1/servers/60d69c7d-69e4-4b2a-b41c-692867a6e28d" status: 200 len: 1561 microversion: 2.1 time: 0.221073 Sep 24 05:11:05.345623 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.compute.api [None req-78c796d0-f600-4029-99a1-341ea9381448 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] [instance: 36f8e098-a4b5-40a4-8f49-f341c5ad940c] Fetching instance by UUID {{(pid=120594) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:11:05.346272 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 501/1027] 10.222.0.50 () {58 vars in 1236 bytes} [Sat Sep 24 05:11:05 2022] GET /compute/v2.1/servers/60d69c7d-69e4-4b2a-b41c-692867a6e28d => generated 1561 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 24 05:11:05.351329 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-78c796d0-f600-4029-99a1-341ea9381448 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:11:05.351878 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-78c796d0-f600-4029-99a1-341ea9381448 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:11:05.352310 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-78c796d0-f600-4029-99a1-341ea9381448 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:11:05.352986 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-78c796d0-f600-4029-99a1-341ea9381448 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:11:05.353968 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-78c796d0-f600-4029-99a1-341ea9381448 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:11:05.354407 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-78c796d0-f600-4029-99a1-341ea9381448 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:11:05.480784 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.policy [None req-78c796d0-f600-4029-99a1-341ea9381448 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0948754217fc4ff2ba0241fa35feaf90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1aaf20f480a423ea5feca81585aeeed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:11:05.488627 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.policy [None req-78c796d0-f600-4029-99a1-341ea9381448 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0948754217fc4ff2ba0241fa35feaf90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1aaf20f480a423ea5feca81585aeeed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:11:05.490089 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.policy [None req-78c796d0-f600-4029-99a1-341ea9381448 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0948754217fc4ff2ba0241fa35feaf90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1aaf20f480a423ea5feca81585aeeed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:11:05.491228 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [None req-78c796d0-f600-4029-99a1-341ea9381448 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] 10.222.0.50 "GET /compute/v2.1/servers/36f8e098-a4b5-40a4-8f49-f341c5ad940c" status: 200 len: 1724 microversion: 2.20 time: 0.149717 Sep 24 05:11:05.491781 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 527/1028] 10.222.0.50 () {60 vars in 1277 bytes} [Sat Sep 24 05:11:05 2022] GET /compute/v2.1/servers/36f8e098-a4b5-40a4-8f49-f341c5ad940c => generated 1724 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 05:11:05.774313 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-dfe18f29-ff1b-4c82-980e-d56d70214203 tempest-TestVolumeBootPattern-1339481357 tempest-TestVolumeBootPattern-1339481357-project] Calling method '>' {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:11:05.774815 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.compute.api [None req-dfe18f29-ff1b-4c82-980e-d56d70214203 tempest-TestVolumeBootPattern-1339481357 tempest-TestVolumeBootPattern-1339481357-project] [instance: dd7d8b54-2d8e-4a74-912f-4eab2ccf2125] Fetching instance by UUID {{(pid=120593) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:11:05.782398 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-dfe18f29-ff1b-4c82-980e-d56d70214203 tempest-TestVolumeBootPattern-1339481357 tempest-TestVolumeBootPattern-1339481357-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:11:05.782976 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-dfe18f29-ff1b-4c82-980e-d56d70214203 tempest-TestVolumeBootPattern-1339481357 tempest-TestVolumeBootPattern-1339481357-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:11:05.783416 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-dfe18f29-ff1b-4c82-980e-d56d70214203 tempest-TestVolumeBootPattern-1339481357 tempest-TestVolumeBootPattern-1339481357-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:11:05.784166 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-dfe18f29-ff1b-4c82-980e-d56d70214203 tempest-TestVolumeBootPattern-1339481357 tempest-TestVolumeBootPattern-1339481357-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:11:05.784728 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-dfe18f29-ff1b-4c82-980e-d56d70214203 tempest-TestVolumeBootPattern-1339481357 tempest-TestVolumeBootPattern-1339481357-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:11:05.785157 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-dfe18f29-ff1b-4c82-980e-d56d70214203 tempest-TestVolumeBootPattern-1339481357 tempest-TestVolumeBootPattern-1339481357-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:11:05.811805 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.compute.api [None req-dfe18f29-ff1b-4c82-980e-d56d70214203 tempest-TestVolumeBootPattern-1339481357 tempest-TestVolumeBootPattern-1339481357-project] [instance: dd7d8b54-2d8e-4a74-912f-4eab2ccf2125] Going to try to terminate instance {{(pid=120593) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 24 05:11:05.891455 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-dfe18f29-ff1b-4c82-980e-d56d70214203 tempest-TestVolumeBootPattern-1339481357 tempest-TestVolumeBootPattern-1339481357-project] 10.222.0.50 "DELETE /compute/v2.1/servers/dd7d8b54-2d8e-4a74-912f-4eab2ccf2125" status: 204 len: 0 microversion: 2.1 time: 0.120848 Sep 24 05:11:05.892041 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 502/1029] 10.222.0.50 () {58 vars in 1239 bytes} [Sat Sep 24 05:11:05 2022] DELETE /compute/v2.1/servers/dd7d8b54-2d8e-4a74-912f-4eab2ccf2125 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 24 05:11:05.900058 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-ff8c1afa-9480-431a-9be3-9df133994dae tempest-TestVolumeBootPattern-1339481357 tempest-TestVolumeBootPattern-1339481357-project] Calling method '>' {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:11:05.901179 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.compute.api [None req-ff8c1afa-9480-431a-9be3-9df133994dae tempest-TestVolumeBootPattern-1339481357 tempest-TestVolumeBootPattern-1339481357-project] [instance: dd7d8b54-2d8e-4a74-912f-4eab2ccf2125] Fetching instance by UUID {{(pid=120594) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:11:05.907182 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-ff8c1afa-9480-431a-9be3-9df133994dae tempest-TestVolumeBootPattern-1339481357 tempest-TestVolumeBootPattern-1339481357-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:11:05.907658 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-ff8c1afa-9480-431a-9be3-9df133994dae tempest-TestVolumeBootPattern-1339481357 tempest-TestVolumeBootPattern-1339481357-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:11:05.908090 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-ff8c1afa-9480-431a-9be3-9df133994dae tempest-TestVolumeBootPattern-1339481357 tempest-TestVolumeBootPattern-1339481357-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:11:05.908772 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-ff8c1afa-9480-431a-9be3-9df133994dae tempest-TestVolumeBootPattern-1339481357 tempest-TestVolumeBootPattern-1339481357-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:11:05.909221 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-ff8c1afa-9480-431a-9be3-9df133994dae tempest-TestVolumeBootPattern-1339481357 tempest-TestVolumeBootPattern-1339481357-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:11:05.909637 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-ff8c1afa-9480-431a-9be3-9df133994dae tempest-TestVolumeBootPattern-1339481357 tempest-TestVolumeBootPattern-1339481357-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:11:06.038948 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.policy [None req-ff8c1afa-9480-431a-9be3-9df133994dae tempest-TestVolumeBootPattern-1339481357 tempest-TestVolumeBootPattern-1339481357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60edcebcccaa4da99ffddadd3e27c1c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fef19544ec414094953daea6d545a361', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:11:06.042433 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG dbcounter [-] [120594] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 05:11:06.047482 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [None req-ff8c1afa-9480-431a-9be3-9df133994dae tempest-TestVolumeBootPattern-1339481357 tempest-TestVolumeBootPattern-1339481357-project] 10.222.0.50 "GET /compute/v2.1/servers/dd7d8b54-2d8e-4a74-912f-4eab2ccf2125" status: 200 len: 1575 microversion: 2.1 time: 0.151281 Sep 24 05:11:06.048042 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 528/1030] 10.222.0.50 () {58 vars in 1236 bytes} [Sat Sep 24 05:11:05 2022] GET /compute/v2.1/servers/dd7d8b54-2d8e-4a74-912f-4eab2ccf2125 => generated 1575 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 05:11:06.366155 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-b6645006-a561-4886-b207-b08f1e7c9c84 tempest-TestMinimumBasicScenario-2093795776 tempest-TestMinimumBasicScenario-2093795776-project] Calling method '>' {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:11:06.366948 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.compute.api [None req-b6645006-a561-4886-b207-b08f1e7c9c84 tempest-TestMinimumBasicScenario-2093795776 tempest-TestMinimumBasicScenario-2093795776-project] [instance: c8dc693a-12ca-40a8-8ce8-4f5cb342fb8f] Fetching instance by UUID {{(pid=120593) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:11:06.368653 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-400d9232-20ee-472f-8980-11dd5455874d tempest-TestShelveInstance-1085488420 tempest-TestShelveInstance-1085488420-project] Calling method '>' {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:11:06.370358 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.compute.api [None req-400d9232-20ee-472f-8980-11dd5455874d tempest-TestShelveInstance-1085488420 tempest-TestShelveInstance-1085488420-project] [instance: 60d69c7d-69e4-4b2a-b41c-692867a6e28d] Fetching instance by UUID {{(pid=120594) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:11:06.374583 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-b6645006-a561-4886-b207-b08f1e7c9c84 tempest-TestMinimumBasicScenario-2093795776 tempest-TestMinimumBasicScenario-2093795776-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:11:06.375076 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-b6645006-a561-4886-b207-b08f1e7c9c84 tempest-TestMinimumBasicScenario-2093795776 tempest-TestMinimumBasicScenario-2093795776-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:11:06.375510 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-b6645006-a561-4886-b207-b08f1e7c9c84 tempest-TestMinimumBasicScenario-2093795776 tempest-TestMinimumBasicScenario-2093795776-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:11:06.376425 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-b6645006-a561-4886-b207-b08f1e7c9c84 tempest-TestMinimumBasicScenario-2093795776 tempest-TestMinimumBasicScenario-2093795776-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:11:06.376880 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-b6645006-a561-4886-b207-b08f1e7c9c84 tempest-TestMinimumBasicScenario-2093795776 tempest-TestMinimumBasicScenario-2093795776-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:11:06.377469 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-b6645006-a561-4886-b207-b08f1e7c9c84 tempest-TestMinimumBasicScenario-2093795776 tempest-TestMinimumBasicScenario-2093795776-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:11:06.381605 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-400d9232-20ee-472f-8980-11dd5455874d tempest-TestShelveInstance-1085488420 tempest-TestShelveInstance-1085488420-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:11:06.382554 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-400d9232-20ee-472f-8980-11dd5455874d tempest-TestShelveInstance-1085488420 tempest-TestShelveInstance-1085488420-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:11:06.383429 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-400d9232-20ee-472f-8980-11dd5455874d tempest-TestShelveInstance-1085488420 tempest-TestShelveInstance-1085488420-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:11:06.384366 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-400d9232-20ee-472f-8980-11dd5455874d tempest-TestShelveInstance-1085488420 tempest-TestShelveInstance-1085488420-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:11:06.385501 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-400d9232-20ee-472f-8980-11dd5455874d tempest-TestShelveInstance-1085488420 tempest-TestShelveInstance-1085488420-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:11:06.386262 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-400d9232-20ee-472f-8980-11dd5455874d tempest-TestShelveInstance-1085488420 tempest-TestShelveInstance-1085488420-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:11:06.611216 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-b6645006-a561-4886-b207-b08f1e7c9c84 tempest-TestMinimumBasicScenario-2093795776 tempest-TestMinimumBasicScenario-2093795776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f67fe549bae6447f8b24219becb3bf97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85c73f9a74da4079a54a503e0b42ca2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:11:06.614479 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.policy [None req-400d9232-20ee-472f-8980-11dd5455874d tempest-TestShelveInstance-1085488420 tempest-TestShelveInstance-1085488420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8fe3c5c28964b768b2c0023fc62f163', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd3d02b11bdf45fe99687fda3d1078cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:11:06.619256 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-b6645006-a561-4886-b207-b08f1e7c9c84 tempest-TestMinimumBasicScenario-2093795776 tempest-TestMinimumBasicScenario-2093795776-project] 10.222.0.50 "GET /compute/v2.1/servers/c8dc693a-12ca-40a8-8ce8-4f5cb342fb8f" status: 200 len: 1359 microversion: 2.1 time: 0.259842 Sep 24 05:11:06.630667 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 503/1031] 10.222.0.50 () {58 vars in 1236 bytes} [Sat Sep 24 05:11:06 2022] GET /compute/v2.1/servers/c8dc693a-12ca-40a8-8ce8-4f5cb342fb8f => generated 1359 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 05:11:06.630667 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-2ad7cb35-54c7-4801-886c-e28dd83b0ec5 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Calling method '>' {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:11:06.630667 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.compute.api [None req-2ad7cb35-54c7-4801-886c-e28dd83b0ec5 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] [instance: 36f8e098-a4b5-40a4-8f49-f341c5ad940c] Fetching instance by UUID {{(pid=120593) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:11:06.630667 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-2ad7cb35-54c7-4801-886c-e28dd83b0ec5 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:11:06.631401 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-2ad7cb35-54c7-4801-886c-e28dd83b0ec5 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:11:06.631401 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-2ad7cb35-54c7-4801-886c-e28dd83b0ec5 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:11:06.632172 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-2ad7cb35-54c7-4801-886c-e28dd83b0ec5 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:11:06.632516 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-2ad7cb35-54c7-4801-886c-e28dd83b0ec5 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:11:06.632940 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-2ad7cb35-54c7-4801-886c-e28dd83b0ec5 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:11:06.634296 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [None req-400d9232-20ee-472f-8980-11dd5455874d tempest-TestShelveInstance-1085488420 tempest-TestShelveInstance-1085488420-project] 10.222.0.50 "GET /compute/v2.1/servers/60d69c7d-69e4-4b2a-b41c-692867a6e28d" status: 200 len: 1561 microversion: 2.1 time: 0.269403 Sep 24 05:11:06.634941 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 529/1032] 10.222.0.50 () {58 vars in 1236 bytes} [Sat Sep 24 05:11:06 2022] GET /compute/v2.1/servers/60d69c7d-69e4-4b2a-b41c-692867a6e28d => generated 1561 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 05:11:06.763052 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-2ad7cb35-54c7-4801-886c-e28dd83b0ec5 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0948754217fc4ff2ba0241fa35feaf90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1aaf20f480a423ea5feca81585aeeed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:11:06.771158 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-2ad7cb35-54c7-4801-886c-e28dd83b0ec5 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0948754217fc4ff2ba0241fa35feaf90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1aaf20f480a423ea5feca81585aeeed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:11:06.772580 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-2ad7cb35-54c7-4801-886c-e28dd83b0ec5 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0948754217fc4ff2ba0241fa35feaf90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1aaf20f480a423ea5feca81585aeeed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:11:06.773777 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-2ad7cb35-54c7-4801-886c-e28dd83b0ec5 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] 10.222.0.50 "GET /compute/v2.1/servers/36f8e098-a4b5-40a4-8f49-f341c5ad940c" status: 200 len: 1724 microversion: 2.20 time: 0.153038 Sep 24 05:11:06.774370 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 504/1033] 10.222.0.50 () {60 vars in 1277 bytes} [Sat Sep 24 05:11:06 2022] GET /compute/v2.1/servers/36f8e098-a4b5-40a4-8f49-f341c5ad940c => generated 1724 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 05:11:07.071332 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-4a12dff9-ad01-4364-ad82-19dae669b355 tempest-TestVolumeBootPattern-1339481357 tempest-TestVolumeBootPattern-1339481357-project] Calling method '>' {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:11:07.071859 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.compute.api [None req-4a12dff9-ad01-4364-ad82-19dae669b355 tempest-TestVolumeBootPattern-1339481357 tempest-TestVolumeBootPattern-1339481357-project] [instance: dd7d8b54-2d8e-4a74-912f-4eab2ccf2125] Fetching instance by UUID {{(pid=120594) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:11:07.078448 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-4a12dff9-ad01-4364-ad82-19dae669b355 tempest-TestVolumeBootPattern-1339481357 tempest-TestVolumeBootPattern-1339481357-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:11:07.078925 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-4a12dff9-ad01-4364-ad82-19dae669b355 tempest-TestVolumeBootPattern-1339481357 tempest-TestVolumeBootPattern-1339481357-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:11:07.079396 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-4a12dff9-ad01-4364-ad82-19dae669b355 tempest-TestVolumeBootPattern-1339481357 tempest-TestVolumeBootPattern-1339481357-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:11:07.080088 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-4a12dff9-ad01-4364-ad82-19dae669b355 tempest-TestVolumeBootPattern-1339481357 tempest-TestVolumeBootPattern-1339481357-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:11:07.080538 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-4a12dff9-ad01-4364-ad82-19dae669b355 tempest-TestVolumeBootPattern-1339481357 tempest-TestVolumeBootPattern-1339481357-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:11:07.080959 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-4a12dff9-ad01-4364-ad82-19dae669b355 tempest-TestVolumeBootPattern-1339481357 tempest-TestVolumeBootPattern-1339481357-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:11:07.208086 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.policy [None req-4a12dff9-ad01-4364-ad82-19dae669b355 tempest-TestVolumeBootPattern-1339481357 tempest-TestVolumeBootPattern-1339481357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60edcebcccaa4da99ffddadd3e27c1c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fef19544ec414094953daea6d545a361', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:11:07.216188 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [None req-4a12dff9-ad01-4364-ad82-19dae669b355 tempest-TestVolumeBootPattern-1339481357 tempest-TestVolumeBootPattern-1339481357-project] 10.222.0.50 "GET /compute/v2.1/servers/dd7d8b54-2d8e-4a74-912f-4eab2ccf2125" status: 200 len: 1575 microversion: 2.1 time: 0.148793 Sep 24 05:11:07.216747 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 530/1034] 10.222.0.50 () {58 vars in 1236 bytes} [Sat Sep 24 05:11:07 2022] GET /compute/v2.1/servers/dd7d8b54-2d8e-4a74-912f-4eab2ccf2125 => generated 1575 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 05:11:07.641487 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-7d452afd-cdd4-4e1c-ac06-a3ebc24fd717 tempest-TestMinimumBasicScenario-2093795776 tempest-TestMinimumBasicScenario-2093795776-project] Calling method '>' {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:11:07.642366 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.compute.api [None req-7d452afd-cdd4-4e1c-ac06-a3ebc24fd717 tempest-TestMinimumBasicScenario-2093795776 tempest-TestMinimumBasicScenario-2093795776-project] [instance: c8dc693a-12ca-40a8-8ce8-4f5cb342fb8f] Fetching instance by UUID {{(pid=120593) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:11:07.661504 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-7d452afd-cdd4-4e1c-ac06-a3ebc24fd717 tempest-TestMinimumBasicScenario-2093795776 tempest-TestMinimumBasicScenario-2093795776-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:11:07.665501 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-7d452afd-cdd4-4e1c-ac06-a3ebc24fd717 tempest-TestMinimumBasicScenario-2093795776 tempest-TestMinimumBasicScenario-2093795776-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:11:07.665850 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-7d452afd-cdd4-4e1c-ac06-a3ebc24fd717 tempest-TestMinimumBasicScenario-2093795776 tempest-TestMinimumBasicScenario-2093795776-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:11:07.667265 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-375b6979-d2ef-43ed-b794-20d0abcb55b9 tempest-TestShelveInstance-1085488420 tempest-TestShelveInstance-1085488420-project] Calling method '>' {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:11:07.668619 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-7d452afd-cdd4-4e1c-ac06-a3ebc24fd717 tempest-TestMinimumBasicScenario-2093795776 tempest-TestMinimumBasicScenario-2093795776-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:11:07.669158 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-7d452afd-cdd4-4e1c-ac06-a3ebc24fd717 tempest-TestMinimumBasicScenario-2093795776 tempest-TestMinimumBasicScenario-2093795776-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:11:07.669543 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.compute.api [None req-375b6979-d2ef-43ed-b794-20d0abcb55b9 tempest-TestShelveInstance-1085488420 tempest-TestShelveInstance-1085488420-project] [instance: 60d69c7d-69e4-4b2a-b41c-692867a6e28d] Fetching instance by UUID {{(pid=120594) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:11:07.670081 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-7d452afd-cdd4-4e1c-ac06-a3ebc24fd717 tempest-TestMinimumBasicScenario-2093795776 tempest-TestMinimumBasicScenario-2093795776-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:11:07.686607 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-375b6979-d2ef-43ed-b794-20d0abcb55b9 tempest-TestShelveInstance-1085488420 tempest-TestShelveInstance-1085488420-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:11:07.695594 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-375b6979-d2ef-43ed-b794-20d0abcb55b9 tempest-TestShelveInstance-1085488420 tempest-TestShelveInstance-1085488420-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:11:07.696624 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-375b6979-d2ef-43ed-b794-20d0abcb55b9 tempest-TestShelveInstance-1085488420 tempest-TestShelveInstance-1085488420-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:11:07.698045 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-375b6979-d2ef-43ed-b794-20d0abcb55b9 tempest-TestShelveInstance-1085488420 tempest-TestShelveInstance-1085488420-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:11:07.699224 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-375b6979-d2ef-43ed-b794-20d0abcb55b9 tempest-TestShelveInstance-1085488420 tempest-TestShelveInstance-1085488420-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:11:07.699745 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-375b6979-d2ef-43ed-b794-20d0abcb55b9 tempest-TestShelveInstance-1085488420 tempest-TestShelveInstance-1085488420-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:11:08.054228 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.policy [None req-375b6979-d2ef-43ed-b794-20d0abcb55b9 tempest-TestShelveInstance-1085488420 tempest-TestShelveInstance-1085488420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8fe3c5c28964b768b2c0023fc62f163', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd3d02b11bdf45fe99687fda3d1078cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:11:08.059669 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-7d452afd-cdd4-4e1c-ac06-a3ebc24fd717 tempest-TestMinimumBasicScenario-2093795776 tempest-TestMinimumBasicScenario-2093795776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f67fe549bae6447f8b24219becb3bf97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85c73f9a74da4079a54a503e0b42ca2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:11:08.064700 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [None req-375b6979-d2ef-43ed-b794-20d0abcb55b9 tempest-TestShelveInstance-1085488420 tempest-TestShelveInstance-1085488420-project] 10.222.0.50 "GET /compute/v2.1/servers/60d69c7d-69e4-4b2a-b41c-692867a6e28d" status: 200 len: 1561 microversion: 2.1 time: 0.408882 Sep 24 05:11:08.065284 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 531/1035] 10.222.0.50 () {58 vars in 1236 bytes} [Sat Sep 24 05:11:07 2022] GET /compute/v2.1/servers/60d69c7d-69e4-4b2a-b41c-692867a6e28d => generated 1561 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 05:11:08.070155 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-f2245b5c-8c40-4c82-948e-efe88d603abc tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Calling method '>' {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:11:08.070978 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.compute.api [None req-f2245b5c-8c40-4c82-948e-efe88d603abc tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] [instance: 36f8e098-a4b5-40a4-8f49-f341c5ad940c] Fetching instance by UUID {{(pid=120594) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:11:08.077483 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-f2245b5c-8c40-4c82-948e-efe88d603abc tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:11:08.077965 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-f2245b5c-8c40-4c82-948e-efe88d603abc tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:11:08.078422 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-f2245b5c-8c40-4c82-948e-efe88d603abc tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:11:08.079214 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-f2245b5c-8c40-4c82-948e-efe88d603abc tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:11:08.079688 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-f2245b5c-8c40-4c82-948e-efe88d603abc tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:11:08.080280 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-f2245b5c-8c40-4c82-948e-efe88d603abc tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:11:08.084147 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-7d452afd-cdd4-4e1c-ac06-a3ebc24fd717 tempest-TestMinimumBasicScenario-2093795776 tempest-TestMinimumBasicScenario-2093795776-project] 10.222.0.50 "GET /compute/v2.1/servers/c8dc693a-12ca-40a8-8ce8-4f5cb342fb8f" status: 200 len: 1359 microversion: 2.1 time: 0.446555 Sep 24 05:11:08.084978 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 505/1036] 10.222.0.50 () {58 vars in 1236 bytes} [Sat Sep 24 05:11:07 2022] GET /compute/v2.1/servers/c8dc693a-12ca-40a8-8ce8-4f5cb342fb8f => generated 1359 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 05:11:08.089969 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [req-7a05ce12-4cb0-4662-8d43-1ef0cea4615c req-dd9a1abd-2b89-4913-86a7-e369511cf46f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c8dc693a-12ca-40a8-8ce8-4f5cb342fb8f", "name": "network-vif-plugged", "status": "completed", "tag": "3c4098d3-98fe-49ac-9677-5b3632da2208"}]} {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 05:11:08.099671 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [req-7a05ce12-4cb0-4662-8d43-1ef0cea4615c req-dd9a1abd-2b89-4913-86a7-e369511cf46f service nova] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:11:08.100388 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [req-7a05ce12-4cb0-4662-8d43-1ef0cea4615c req-dd9a1abd-2b89-4913-86a7-e369511cf46f service nova] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:11:08.101032 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [req-7a05ce12-4cb0-4662-8d43-1ef0cea4615c req-dd9a1abd-2b89-4913-86a7-e369511cf46f service nova] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:11:08.113825 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.compute.server_external_events [req-7a05ce12-4cb0-4662-8d43-1ef0cea4615c req-dd9a1abd-2b89-4913-86a7-e369511cf46f service nova] Creating event network-vif-plugged:3c4098d3-98fe-49ac-9677-5b3632da2208 for instance c8dc693a-12ca-40a8-8ce8-4f5cb342fb8f on hv-cinder-85918 Sep 24 05:11:08.119878 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [req-7a05ce12-4cb0-4662-8d43-1ef0cea4615c req-dd9a1abd-2b89-4913-86a7-e369511cf46f service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033375 Sep 24 05:11:08.121104 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 506/1037] 10.222.0.50 () {64 vars in 1317 bytes} [Sat Sep 24 05:11:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 05:11:08.240739 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-f354f557-da48-4db0-9c98-9a8822213a23 tempest-TestVolumeBootPattern-1339481357 tempest-TestVolumeBootPattern-1339481357-project] Calling method '>' {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:11:08.241748 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.compute.api [None req-f354f557-da48-4db0-9c98-9a8822213a23 tempest-TestVolumeBootPattern-1339481357 tempest-TestVolumeBootPattern-1339481357-project] [instance: dd7d8b54-2d8e-4a74-912f-4eab2ccf2125] Fetching instance by UUID {{(pid=120593) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:11:08.249381 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-f354f557-da48-4db0-9c98-9a8822213a23 tempest-TestVolumeBootPattern-1339481357 tempest-TestVolumeBootPattern-1339481357-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:11:08.250277 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-f354f557-da48-4db0-9c98-9a8822213a23 tempest-TestVolumeBootPattern-1339481357 tempest-TestVolumeBootPattern-1339481357-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:11:08.250858 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-f354f557-da48-4db0-9c98-9a8822213a23 tempest-TestVolumeBootPattern-1339481357 tempest-TestVolumeBootPattern-1339481357-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:11:08.251797 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-f354f557-da48-4db0-9c98-9a8822213a23 tempest-TestVolumeBootPattern-1339481357 tempest-TestVolumeBootPattern-1339481357-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:11:08.252460 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-f354f557-da48-4db0-9c98-9a8822213a23 tempest-TestVolumeBootPattern-1339481357 tempest-TestVolumeBootPattern-1339481357-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:11:08.253114 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-f354f557-da48-4db0-9c98-9a8822213a23 tempest-TestVolumeBootPattern-1339481357 tempest-TestVolumeBootPattern-1339481357-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:11:08.319632 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.policy [None req-f2245b5c-8c40-4c82-948e-efe88d603abc tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0948754217fc4ff2ba0241fa35feaf90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1aaf20f480a423ea5feca81585aeeed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:11:08.328618 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.policy [None req-f2245b5c-8c40-4c82-948e-efe88d603abc tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0948754217fc4ff2ba0241fa35feaf90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1aaf20f480a423ea5feca81585aeeed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:11:08.330229 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.policy [None req-f2245b5c-8c40-4c82-948e-efe88d603abc tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0948754217fc4ff2ba0241fa35feaf90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1aaf20f480a423ea5feca81585aeeed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:11:08.331400 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [None req-f2245b5c-8c40-4c82-948e-efe88d603abc tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] 10.222.0.50 "GET /compute/v2.1/servers/36f8e098-a4b5-40a4-8f49-f341c5ad940c" status: 200 len: 1724 microversion: 2.20 time: 0.265036 Sep 24 05:11:08.331964 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 532/1038] 10.222.0.50 () {60 vars in 1277 bytes} [Sat Sep 24 05:11:08 2022] GET /compute/v2.1/servers/36f8e098-a4b5-40a4-8f49-f341c5ad940c => generated 1724 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 05:11:08.606883 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [req-45530b08-2196-4b18-9184-87c3bc46f577 req-e3781453-ed7e-4048-a89d-6730f6513483 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "60d69c7d-69e4-4b2a-b41c-692867a6e28d", "name": "network-vif-deleted", "tag": "fab1bdaa-696a-4cf2-b4c6-ca1ee5692022"}]} {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 05:11:08.620596 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [req-45530b08-2196-4b18-9184-87c3bc46f577 req-e3781453-ed7e-4048-a89d-6730f6513483 service nova] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:11:08.621177 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [req-45530b08-2196-4b18-9184-87c3bc46f577 req-e3781453-ed7e-4048-a89d-6730f6513483 service nova] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:11:08.621306 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [req-45530b08-2196-4b18-9184-87c3bc46f577 req-e3781453-ed7e-4048-a89d-6730f6513483 service nova] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:11:08.636929 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: INFO nova.api.openstack.compute.server_external_events [req-45530b08-2196-4b18-9184-87c3bc46f577 req-e3781453-ed7e-4048-a89d-6730f6513483 service nova] Creating event network-vif-deleted:fab1bdaa-696a-4cf2-b4c6-ca1ee5692022 for instance 60d69c7d-69e4-4b2a-b41c-692867a6e28d on hv-cinder-85918 Sep 24 05:11:08.642824 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [req-45530b08-2196-4b18-9184-87c3bc46f577 req-e3781453-ed7e-4048-a89d-6730f6513483 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041517 Sep 24 05:11:08.643423 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 533/1039] 10.222.0.50 () {64 vars in 1317 bytes} [Sat Sep 24 05:11:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 24 05:11:08.935860 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-f354f557-da48-4db0-9c98-9a8822213a23 tempest-TestVolumeBootPattern-1339481357 tempest-TestVolumeBootPattern-1339481357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60edcebcccaa4da99ffddadd3e27c1c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fef19544ec414094953daea6d545a361', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:11:08.945332 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-f354f557-da48-4db0-9c98-9a8822213a23 tempest-TestVolumeBootPattern-1339481357 tempest-TestVolumeBootPattern-1339481357-project] 10.222.0.50 "GET /compute/v2.1/servers/dd7d8b54-2d8e-4a74-912f-4eab2ccf2125" status: 200 len: 1575 microversion: 2.1 time: 0.708652 Sep 24 05:11:08.945896 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 507/1040] 10.222.0.50 () {58 vars in 1236 bytes} [Sat Sep 24 05:11:08 2022] GET /compute/v2.1/servers/dd7d8b54-2d8e-4a74-912f-4eab2ccf2125 => generated 1575 bytes in 710 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 24 05:11:09.089664 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-1bd2de3f-a04e-4b7c-aca2-de710812fbd4 tempest-TestShelveInstance-1085488420 tempest-TestShelveInstance-1085488420-project] Calling method '>' {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:11:09.090306 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.compute.api [None req-1bd2de3f-a04e-4b7c-aca2-de710812fbd4 tempest-TestShelveInstance-1085488420 tempest-TestShelveInstance-1085488420-project] [instance: 60d69c7d-69e4-4b2a-b41c-692867a6e28d] Fetching instance by UUID {{(pid=120594) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:11:09.096587 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-1bd2de3f-a04e-4b7c-aca2-de710812fbd4 tempest-TestShelveInstance-1085488420 tempest-TestShelveInstance-1085488420-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:11:09.097066 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-1bd2de3f-a04e-4b7c-aca2-de710812fbd4 tempest-TestShelveInstance-1085488420 tempest-TestShelveInstance-1085488420-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:11:09.097500 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-1bd2de3f-a04e-4b7c-aca2-de710812fbd4 tempest-TestShelveInstance-1085488420 tempest-TestShelveInstance-1085488420-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:11:09.098216 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-1bd2de3f-a04e-4b7c-aca2-de710812fbd4 tempest-TestShelveInstance-1085488420 tempest-TestShelveInstance-1085488420-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:11:09.098667 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-1bd2de3f-a04e-4b7c-aca2-de710812fbd4 tempest-TestShelveInstance-1085488420 tempest-TestShelveInstance-1085488420-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:11:09.099079 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-1bd2de3f-a04e-4b7c-aca2-de710812fbd4 tempest-TestShelveInstance-1085488420 tempest-TestShelveInstance-1085488420-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:11:09.106751 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-87333bb0-8a8b-4416-9add-f7e72c8c810a tempest-TestMinimumBasicScenario-2093795776 tempest-TestMinimumBasicScenario-2093795776-project] Calling method '>' {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:11:09.107372 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.compute.api [None req-87333bb0-8a8b-4416-9add-f7e72c8c810a tempest-TestMinimumBasicScenario-2093795776 tempest-TestMinimumBasicScenario-2093795776-project] [instance: c8dc693a-12ca-40a8-8ce8-4f5cb342fb8f] Fetching instance by UUID {{(pid=120593) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:11:09.113494 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-87333bb0-8a8b-4416-9add-f7e72c8c810a tempest-TestMinimumBasicScenario-2093795776 tempest-TestMinimumBasicScenario-2093795776-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:11:09.113985 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-87333bb0-8a8b-4416-9add-f7e72c8c810a tempest-TestMinimumBasicScenario-2093795776 tempest-TestMinimumBasicScenario-2093795776-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:11:09.114663 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-87333bb0-8a8b-4416-9add-f7e72c8c810a tempest-TestMinimumBasicScenario-2093795776 tempest-TestMinimumBasicScenario-2093795776-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:11:09.115573 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-87333bb0-8a8b-4416-9add-f7e72c8c810a tempest-TestMinimumBasicScenario-2093795776 tempest-TestMinimumBasicScenario-2093795776-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:11:09.116063 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-87333bb0-8a8b-4416-9add-f7e72c8c810a tempest-TestMinimumBasicScenario-2093795776 tempest-TestMinimumBasicScenario-2093795776-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:11:09.116496 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-87333bb0-8a8b-4416-9add-f7e72c8c810a tempest-TestMinimumBasicScenario-2093795776 tempest-TestMinimumBasicScenario-2093795776-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:11:09.130422 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-1bd2de3f-a04e-4b7c-aca2-de710812fbd4 tempest-TestShelveInstance-1085488420 tempest-TestShelveInstance-1085488420-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:11:09.130897 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-1bd2de3f-a04e-4b7c-aca2-de710812fbd4 tempest-TestShelveInstance-1085488420 tempest-TestShelveInstance-1085488420-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:11:09.131327 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-1bd2de3f-a04e-4b7c-aca2-de710812fbd4 tempest-TestShelveInstance-1085488420 tempest-TestShelveInstance-1085488420-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:11:09.131768 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.objects.instance [None req-1bd2de3f-a04e-4b7c-aca2-de710812fbd4 tempest-TestShelveInstance-1085488420 tempest-TestShelveInstance-1085488420-project] Lazy-loading 'fault' on Instance uuid 60d69c7d-69e4-4b2a-b41c-692867a6e28d {{(pid=120594) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 24 05:11:09.221290 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.policy [None req-1bd2de3f-a04e-4b7c-aca2-de710812fbd4 tempest-TestShelveInstance-1085488420 tempest-TestShelveInstance-1085488420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8fe3c5c28964b768b2c0023fc62f163', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd3d02b11bdf45fe99687fda3d1078cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:11:09.229072 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [None req-1bd2de3f-a04e-4b7c-aca2-de710812fbd4 tempest-TestShelveInstance-1085488420 tempest-TestShelveInstance-1085488420-project] 10.222.0.50 "GET /compute/v2.1/servers/60d69c7d-69e4-4b2a-b41c-692867a6e28d" status: 200 len: 1220 microversion: 2.1 time: 0.144324 Sep 24 05:11:09.229712 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 534/1041] 10.222.0.50 () {58 vars in 1236 bytes} [Sat Sep 24 05:11:09 2022] GET /compute/v2.1/servers/60d69c7d-69e4-4b2a-b41c-692867a6e28d => generated 1220 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 05:11:09.358441 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-e817b515-839c-4a39-aa2b-52d702732fec tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Calling method '>' {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:11:09.359204 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.compute.api [None req-e817b515-839c-4a39-aa2b-52d702732fec tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] [instance: 36f8e098-a4b5-40a4-8f49-f341c5ad940c] Fetching instance by UUID {{(pid=120594) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:11:09.366136 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-e817b515-839c-4a39-aa2b-52d702732fec tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:11:09.366630 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-e817b515-839c-4a39-aa2b-52d702732fec tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:11:09.367065 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-e817b515-839c-4a39-aa2b-52d702732fec tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:11:09.367766 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-e817b515-839c-4a39-aa2b-52d702732fec tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:11:09.368220 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-e817b515-839c-4a39-aa2b-52d702732fec tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:11:09.368641 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-e817b515-839c-4a39-aa2b-52d702732fec tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:11:09.369017 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-87333bb0-8a8b-4416-9add-f7e72c8c810a tempest-TestMinimumBasicScenario-2093795776 tempest-TestMinimumBasicScenario-2093795776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f67fe549bae6447f8b24219becb3bf97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85c73f9a74da4079a54a503e0b42ca2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:11:09.388141 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-87333bb0-8a8b-4416-9add-f7e72c8c810a tempest-TestMinimumBasicScenario-2093795776 tempest-TestMinimumBasicScenario-2093795776-project] 10.222.0.50 "GET /compute/v2.1/servers/c8dc693a-12ca-40a8-8ce8-4f5cb342fb8f" status: 200 len: 1359 microversion: 2.1 time: 0.285187 Sep 24 05:11:09.388726 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 508/1042] 10.222.0.50 () {58 vars in 1236 bytes} [Sat Sep 24 05:11:09 2022] GET /compute/v2.1/servers/c8dc693a-12ca-40a8-8ce8-4f5cb342fb8f => generated 1359 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 24 05:11:09.605742 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.policy [None req-e817b515-839c-4a39-aa2b-52d702732fec tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0948754217fc4ff2ba0241fa35feaf90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1aaf20f480a423ea5feca81585aeeed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:11:09.614249 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.policy [None req-e817b515-839c-4a39-aa2b-52d702732fec tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0948754217fc4ff2ba0241fa35feaf90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1aaf20f480a423ea5feca81585aeeed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:11:09.615733 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.policy [None req-e817b515-839c-4a39-aa2b-52d702732fec tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0948754217fc4ff2ba0241fa35feaf90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1aaf20f480a423ea5feca81585aeeed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:11:09.616898 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [None req-e817b515-839c-4a39-aa2b-52d702732fec tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] 10.222.0.50 "GET /compute/v2.1/servers/36f8e098-a4b5-40a4-8f49-f341c5ad940c" status: 200 len: 1724 microversion: 2.20 time: 0.263937 Sep 24 05:11:09.617461 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 535/1043] 10.222.0.50 () {60 vars in 1277 bytes} [Sat Sep 24 05:11:09 2022] GET /compute/v2.1/servers/36f8e098-a4b5-40a4-8f49-f341c5ad940c => generated 1724 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 24 05:11:09.973415 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-f2484cf9-6847-4f38-b572-5ae1428e233e tempest-TestVolumeBootPattern-1339481357 tempest-TestVolumeBootPattern-1339481357-project] Calling method '>' {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:11:09.976521 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.compute.api [None req-f2484cf9-6847-4f38-b572-5ae1428e233e tempest-TestVolumeBootPattern-1339481357 tempest-TestVolumeBootPattern-1339481357-project] [instance: dd7d8b54-2d8e-4a74-912f-4eab2ccf2125] Fetching instance by UUID {{(pid=120593) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:11:09.986458 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-f2484cf9-6847-4f38-b572-5ae1428e233e tempest-TestVolumeBootPattern-1339481357 tempest-TestVolumeBootPattern-1339481357-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:11:09.987072 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-f2484cf9-6847-4f38-b572-5ae1428e233e tempest-TestVolumeBootPattern-1339481357 tempest-TestVolumeBootPattern-1339481357-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:11:09.987572 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-f2484cf9-6847-4f38-b572-5ae1428e233e tempest-TestVolumeBootPattern-1339481357 tempest-TestVolumeBootPattern-1339481357-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:11:09.988470 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-f2484cf9-6847-4f38-b572-5ae1428e233e tempest-TestVolumeBootPattern-1339481357 tempest-TestVolumeBootPattern-1339481357-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:11:09.989031 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-f2484cf9-6847-4f38-b572-5ae1428e233e tempest-TestVolumeBootPattern-1339481357 tempest-TestVolumeBootPattern-1339481357-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:11:09.989554 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-f2484cf9-6847-4f38-b572-5ae1428e233e tempest-TestVolumeBootPattern-1339481357 tempest-TestVolumeBootPattern-1339481357-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:11:10.062822 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-f2484cf9-6847-4f38-b572-5ae1428e233e tempest-TestVolumeBootPattern-1339481357 tempest-TestVolumeBootPattern-1339481357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60edcebcccaa4da99ffddadd3e27c1c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fef19544ec414094953daea6d545a361', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:11:10.070455 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-f2484cf9-6847-4f38-b572-5ae1428e233e tempest-TestVolumeBootPattern-1339481357 tempest-TestVolumeBootPattern-1339481357-project] 10.222.0.50 "GET /compute/v2.1/servers/dd7d8b54-2d8e-4a74-912f-4eab2ccf2125" status: 200 len: 1224 microversion: 2.1 time: 0.102674 Sep 24 05:11:10.071059 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 509/1044] 10.222.0.50 () {58 vars in 1236 bytes} [Sat Sep 24 05:11:09 2022] GET /compute/v2.1/servers/dd7d8b54-2d8e-4a74-912f-4eab2ccf2125 => generated 1224 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 05:11:10.252937 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-44f990d8-078c-4c93-a46d-5e69b9354143 tempest-TestShelveInstance-1085488420 tempest-TestShelveInstance-1085488420-project] Calling method '>' {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:11:10.253559 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.compute.api [None req-44f990d8-078c-4c93-a46d-5e69b9354143 tempest-TestShelveInstance-1085488420 tempest-TestShelveInstance-1085488420-project] [instance: 60d69c7d-69e4-4b2a-b41c-692867a6e28d] Fetching instance by UUID {{(pid=120594) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:11:10.260016 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-44f990d8-078c-4c93-a46d-5e69b9354143 tempest-TestShelveInstance-1085488420 tempest-TestShelveInstance-1085488420-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:11:10.260504 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-44f990d8-078c-4c93-a46d-5e69b9354143 tempest-TestShelveInstance-1085488420 tempest-TestShelveInstance-1085488420-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:11:10.260942 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-44f990d8-078c-4c93-a46d-5e69b9354143 tempest-TestShelveInstance-1085488420 tempest-TestShelveInstance-1085488420-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:11:10.261670 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-44f990d8-078c-4c93-a46d-5e69b9354143 tempest-TestShelveInstance-1085488420 tempest-TestShelveInstance-1085488420-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:11:10.262222 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-44f990d8-078c-4c93-a46d-5e69b9354143 tempest-TestShelveInstance-1085488420 tempest-TestShelveInstance-1085488420-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:11:10.262654 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-44f990d8-078c-4c93-a46d-5e69b9354143 tempest-TestShelveInstance-1085488420 tempest-TestShelveInstance-1085488420-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:11:10.297294 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-44f990d8-078c-4c93-a46d-5e69b9354143 tempest-TestShelveInstance-1085488420 tempest-TestShelveInstance-1085488420-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:11:10.297691 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-44f990d8-078c-4c93-a46d-5e69b9354143 tempest-TestShelveInstance-1085488420 tempest-TestShelveInstance-1085488420-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:11:10.298156 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-44f990d8-078c-4c93-a46d-5e69b9354143 tempest-TestShelveInstance-1085488420 tempest-TestShelveInstance-1085488420-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:11:10.298607 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.objects.instance [None req-44f990d8-078c-4c93-a46d-5e69b9354143 tempest-TestShelveInstance-1085488420 tempest-TestShelveInstance-1085488420-project] Lazy-loading 'fault' on Instance uuid 60d69c7d-69e4-4b2a-b41c-692867a6e28d {{(pid=120594) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 24 05:11:10.341857 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.policy [None req-44f990d8-078c-4c93-a46d-5e69b9354143 tempest-TestShelveInstance-1085488420 tempest-TestShelveInstance-1085488420-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c8fe3c5c28964b768b2c0023fc62f163', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd3d02b11bdf45fe99687fda3d1078cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:11:10.350089 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [None req-44f990d8-078c-4c93-a46d-5e69b9354143 tempest-TestShelveInstance-1085488420 tempest-TestShelveInstance-1085488420-project] 10.222.0.50 "GET /compute/v2.1/servers/60d69c7d-69e4-4b2a-b41c-692867a6e28d" status: 200 len: 1220 microversion: 2.1 time: 0.101221 Sep 24 05:11:10.350654 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 536/1045] 10.222.0.50 () {58 vars in 1236 bytes} [Sat Sep 24 05:11:10 2022] GET /compute/v2.1/servers/60d69c7d-69e4-4b2a-b41c-692867a6e28d => generated 1220 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 05:11:10.413225 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-79176a06-69a7-4ff7-963e-bb7e4b2643a5 tempest-TestMinimumBasicScenario-2093795776 tempest-TestMinimumBasicScenario-2093795776-project] Calling method '>' {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:11:10.414310 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.compute.api [None req-79176a06-69a7-4ff7-963e-bb7e4b2643a5 tempest-TestMinimumBasicScenario-2093795776 tempest-TestMinimumBasicScenario-2093795776-project] [instance: c8dc693a-12ca-40a8-8ce8-4f5cb342fb8f] Fetching instance by UUID {{(pid=120593) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:11:10.426604 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-79176a06-69a7-4ff7-963e-bb7e4b2643a5 tempest-TestMinimumBasicScenario-2093795776 tempest-TestMinimumBasicScenario-2093795776-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:11:10.430355 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-79176a06-69a7-4ff7-963e-bb7e4b2643a5 tempest-TestMinimumBasicScenario-2093795776 tempest-TestMinimumBasicScenario-2093795776-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:11:10.430988 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-79176a06-69a7-4ff7-963e-bb7e4b2643a5 tempest-TestMinimumBasicScenario-2093795776 tempest-TestMinimumBasicScenario-2093795776-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:11:10.435858 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-79176a06-69a7-4ff7-963e-bb7e4b2643a5 tempest-TestMinimumBasicScenario-2093795776 tempest-TestMinimumBasicScenario-2093795776-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:11:10.436581 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-79176a06-69a7-4ff7-963e-bb7e4b2643a5 tempest-TestMinimumBasicScenario-2093795776 tempest-TestMinimumBasicScenario-2093795776-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:11:10.437224 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-79176a06-69a7-4ff7-963e-bb7e4b2643a5 tempest-TestMinimumBasicScenario-2093795776 tempest-TestMinimumBasicScenario-2093795776-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:11:10.576438 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-79176a06-69a7-4ff7-963e-bb7e4b2643a5 tempest-TestMinimumBasicScenario-2093795776 tempest-TestMinimumBasicScenario-2093795776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f67fe549bae6447f8b24219becb3bf97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85c73f9a74da4079a54a503e0b42ca2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:11:10.584587 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-79176a06-69a7-4ff7-963e-bb7e4b2643a5 tempest-TestMinimumBasicScenario-2093795776 tempest-TestMinimumBasicScenario-2093795776-project] 10.222.0.50 "GET /compute/v2.1/servers/c8dc693a-12ca-40a8-8ce8-4f5cb342fb8f" status: 200 len: 1359 microversion: 2.1 time: 0.176278 Sep 24 05:11:10.585226 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 510/1046] 10.222.0.50 () {58 vars in 1236 bytes} [Sat Sep 24 05:11:10 2022] GET /compute/v2.1/servers/c8dc693a-12ca-40a8-8ce8-4f5cb342fb8f => generated 1359 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 05:11:10.644143 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-af333d8e-84ce-4ca1-af5f-bc1f72ba699f tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Calling method '>' {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:11:10.644746 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.compute.api [None req-af333d8e-84ce-4ca1-af5f-bc1f72ba699f tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] [instance: 36f8e098-a4b5-40a4-8f49-f341c5ad940c] Fetching instance by UUID {{(pid=120594) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:11:10.652808 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-af333d8e-84ce-4ca1-af5f-bc1f72ba699f tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:11:10.653286 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-af333d8e-84ce-4ca1-af5f-bc1f72ba699f tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:11:10.653686 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-af333d8e-84ce-4ca1-af5f-bc1f72ba699f tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:11:10.654416 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-af333d8e-84ce-4ca1-af5f-bc1f72ba699f tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:11:10.654874 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-af333d8e-84ce-4ca1-af5f-bc1f72ba699f tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:11:10.655296 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-af333d8e-84ce-4ca1-af5f-bc1f72ba699f tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:11:10.803062 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.policy [None req-af333d8e-84ce-4ca1-af5f-bc1f72ba699f tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0948754217fc4ff2ba0241fa35feaf90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1aaf20f480a423ea5feca81585aeeed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:11:10.813171 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.policy [None req-af333d8e-84ce-4ca1-af5f-bc1f72ba699f tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0948754217fc4ff2ba0241fa35feaf90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1aaf20f480a423ea5feca81585aeeed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:11:10.814723 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.policy [None req-af333d8e-84ce-4ca1-af5f-bc1f72ba699f tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0948754217fc4ff2ba0241fa35feaf90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1aaf20f480a423ea5feca81585aeeed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:11:10.815932 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [None req-af333d8e-84ce-4ca1-af5f-bc1f72ba699f tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] 10.222.0.50 "GET /compute/v2.1/servers/36f8e098-a4b5-40a4-8f49-f341c5ad940c" status: 200 len: 1724 microversion: 2.20 time: 0.175718 Sep 24 05:11:10.816501 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 537/1047] 10.222.0.50 () {60 vars in 1277 bytes} [Sat Sep 24 05:11:10 2022] GET /compute/v2.1/servers/36f8e098-a4b5-40a4-8f49-f341c5ad940c => generated 1724 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 05:11:10.892185 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [req-88144fe0-8768-4ef1-b8ba-f140a6ccff05 req-53a3412e-cb90-445d-b4c5-11cf923be43e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dd7d8b54-2d8e-4a74-912f-4eab2ccf2125", "name": "network-vif-deleted", "tag": "fa86687e-cf6d-40ae-a41d-fc0072b18085"}]} {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 05:11:10.903225 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [req-88144fe0-8768-4ef1-b8ba-f140a6ccff05 req-53a3412e-cb90-445d-b4c5-11cf923be43e service nova] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:11:10.903733 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [req-88144fe0-8768-4ef1-b8ba-f140a6ccff05 req-53a3412e-cb90-445d-b4c5-11cf923be43e service nova] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:11:10.904163 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [req-88144fe0-8768-4ef1-b8ba-f140a6ccff05 req-53a3412e-cb90-445d-b4c5-11cf923be43e service nova] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:11:10.916025 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.compute.server_external_events [req-88144fe0-8768-4ef1-b8ba-f140a6ccff05 req-53a3412e-cb90-445d-b4c5-11cf923be43e service nova] Creating event network-vif-deleted:fa86687e-cf6d-40ae-a41d-fc0072b18085 for instance dd7d8b54-2d8e-4a74-912f-4eab2ccf2125 on hv-cinder-85918 Sep 24 05:11:10.920693 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [req-88144fe0-8768-4ef1-b8ba-f140a6ccff05 req-53a3412e-cb90-445d-b4c5-11cf923be43e service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032222 Sep 24 05:11:10.921286 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 511/1048] 10.222.0.50 () {64 vars in 1317 bytes} [Sat Sep 24 05:11:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 05:11:11.093171 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-4d7db686-ea4b-4113-acdd-8f92d75ff517 tempest-TestVolumeBootPattern-1339481357 tempest-TestVolumeBootPattern-1339481357-project] Calling method '>' {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:11:11.093782 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.compute.api [None req-4d7db686-ea4b-4113-acdd-8f92d75ff517 tempest-TestVolumeBootPattern-1339481357 tempest-TestVolumeBootPattern-1339481357-project] [instance: dd7d8b54-2d8e-4a74-912f-4eab2ccf2125] Fetching instance by UUID {{(pid=120594) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:11:11.099653 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-4d7db686-ea4b-4113-acdd-8f92d75ff517 tempest-TestVolumeBootPattern-1339481357 tempest-TestVolumeBootPattern-1339481357-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:11:11.100131 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-4d7db686-ea4b-4113-acdd-8f92d75ff517 tempest-TestVolumeBootPattern-1339481357 tempest-TestVolumeBootPattern-1339481357-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:11:11.100567 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-4d7db686-ea4b-4113-acdd-8f92d75ff517 tempest-TestVolumeBootPattern-1339481357 tempest-TestVolumeBootPattern-1339481357-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:11:11.101249 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-4d7db686-ea4b-4113-acdd-8f92d75ff517 tempest-TestVolumeBootPattern-1339481357 tempest-TestVolumeBootPattern-1339481357-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:11:11.101698 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-4d7db686-ea4b-4113-acdd-8f92d75ff517 tempest-TestVolumeBootPattern-1339481357 tempest-TestVolumeBootPattern-1339481357-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:11:11.102146 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-4d7db686-ea4b-4113-acdd-8f92d75ff517 tempest-TestVolumeBootPattern-1339481357 tempest-TestVolumeBootPattern-1339481357-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:11:11.132184 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-4d7db686-ea4b-4113-acdd-8f92d75ff517 tempest-TestVolumeBootPattern-1339481357 tempest-TestVolumeBootPattern-1339481357-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:11:11.132664 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-4d7db686-ea4b-4113-acdd-8f92d75ff517 tempest-TestVolumeBootPattern-1339481357 tempest-TestVolumeBootPattern-1339481357-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:11:11.133110 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-4d7db686-ea4b-4113-acdd-8f92d75ff517 tempest-TestVolumeBootPattern-1339481357 tempest-TestVolumeBootPattern-1339481357-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:11:11.133553 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.objects.instance [None req-4d7db686-ea4b-4113-acdd-8f92d75ff517 tempest-TestVolumeBootPattern-1339481357 tempest-TestVolumeBootPattern-1339481357-project] Lazy-loading 'fault' on Instance uuid dd7d8b54-2d8e-4a74-912f-4eab2ccf2125 {{(pid=120594) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 24 05:11:11.173220 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.policy [None req-4d7db686-ea4b-4113-acdd-8f92d75ff517 tempest-TestVolumeBootPattern-1339481357 tempest-TestVolumeBootPattern-1339481357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60edcebcccaa4da99ffddadd3e27c1c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fef19544ec414094953daea6d545a361', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:11:11.180864 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [None req-4d7db686-ea4b-4113-acdd-8f92d75ff517 tempest-TestVolumeBootPattern-1339481357 tempest-TestVolumeBootPattern-1339481357-project] 10.222.0.50 "GET /compute/v2.1/servers/dd7d8b54-2d8e-4a74-912f-4eab2ccf2125" status: 200 len: 1229 microversion: 2.1 time: 0.091520 Sep 24 05:11:11.181961 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 538/1049] 10.222.0.50 () {58 vars in 1236 bytes} [Sat Sep 24 05:11:11 2022] GET /compute/v2.1/servers/dd7d8b54-2d8e-4a74-912f-4eab2ccf2125 => generated 1229 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 05:11:11.374329 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-20652625-0d12-47f8-bc3d-ccf7e4a8cb95 tempest-TestShelveInstance-1085488420 tempest-TestShelveInstance-1085488420-project] Calling method '>' {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:11:11.375165 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.compute.api [None req-20652625-0d12-47f8-bc3d-ccf7e4a8cb95 tempest-TestShelveInstance-1085488420 tempest-TestShelveInstance-1085488420-project] [instance: 60d69c7d-69e4-4b2a-b41c-692867a6e28d] Fetching instance by UUID {{(pid=120593) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:11:11.381656 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-20652625-0d12-47f8-bc3d-ccf7e4a8cb95 tempest-TestShelveInstance-1085488420 tempest-TestShelveInstance-1085488420-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:11:11.382181 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-20652625-0d12-47f8-bc3d-ccf7e4a8cb95 tempest-TestShelveInstance-1085488420 tempest-TestShelveInstance-1085488420-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:11:11.382763 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-20652625-0d12-47f8-bc3d-ccf7e4a8cb95 tempest-TestShelveInstance-1085488420 tempest-TestShelveInstance-1085488420-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:11:11.383607 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-20652625-0d12-47f8-bc3d-ccf7e4a8cb95 tempest-TestShelveInstance-1085488420 tempest-TestShelveInstance-1085488420-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:11:11.384185 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-20652625-0d12-47f8-bc3d-ccf7e4a8cb95 tempest-TestShelveInstance-1085488420 tempest-TestShelveInstance-1085488420-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:11:11.384721 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-20652625-0d12-47f8-bc3d-ccf7e4a8cb95 tempest-TestShelveInstance-1085488420 tempest-TestShelveInstance-1085488420-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:11:11.398738 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.wsgi [None req-20652625-0d12-47f8-bc3d-ccf7e4a8cb95 tempest-TestShelveInstance-1085488420 tempest-TestShelveInstance-1085488420-project] HTTP exception thrown: Instance 60d69c7d-69e4-4b2a-b41c-692867a6e28d could not be found. Sep 24 05:11:11.400390 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-20652625-0d12-47f8-bc3d-ccf7e4a8cb95 tempest-TestShelveInstance-1085488420 tempest-TestShelveInstance-1085488420-project] Request method failure captured: Sep 24 05:11:11.400390 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: request: GET /compute/v2.1/servers/60d69c7d-69e4-4b2a-b41c-692867a6e28d HTTP/1.1 Sep 24 05:11:11.400390 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: Accept: application/json Sep 24 05:11:11.400390 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: Accept-Encoding: identity Sep 24 05:11:11.400390 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: Connection: close Sep 24 05:11:11.400390 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: Content-Length: 0 Sep 24 05:11:11.400390 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: Content-Type: application/json Sep 24 05:11:11.400390 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: Host: 10.222.0.50 Sep 24 05:11:11.400390 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: Openstack-System-Scope: None Sep 24 05:11:11.400390 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: User-Agent: python-urllib3/1.26.12 Sep 24 05:11:11.400390 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: X-Auth-Token: gAAAAABjLo_Nma7GfD4GQkBmt68GxaBKyjVvocz_v4epEtyCKP9nA3lHjPneeS-iwzuOqoH7Rk4t2Y-9CGApVoiwvUJW4hRwopvZlCcwORc4awKsH0C_pu2DPt6PhPBKcLt8PslQbK-we-4QgmAjVMT2dm3uso2vV4ULNdSiJpioM13bRJqhHpw Sep 24 05:11:11.400390 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: X-Domain-Id: None Sep 24 05:11:11.400390 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: X-Domain-Name: None Sep 24 05:11:11.400390 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: X-Identity-Status: Confirmed Sep 24 05:11:11.400390 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: X-Is-Admin-Project: True Sep 24 05:11:11.400390 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: X-Project-Domain-Id: default Sep 24 05:11:11.400390 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: X-Project-Domain-Name: Default Sep 24 05:11:11.400390 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: X-Project-Id: cd3d02b11bdf45fe99687fda3d1078cd Sep 24 05:11:11.400390 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: X-Project-Name: tempest-TestShelveInstance-1085488420 Sep 24 05:11:11.400390 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: X-Role: member,reader Sep 24 05:11:11.400390 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: X-Roles: member,reader Sep 24 05:11:11.401877 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/cd3d02b11bdf45fe99687fda3d1078cd"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/cd3d02b11bdf45fe99687fda3d1078cd"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/cd3d02b11bdf45fe99687fda3d1078cd"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.50:8080", "publicURL": "http://10.222.0.50:8080/v1/AUTH_cd3d02b11bdf45fe99687fda3d1078cd"}]}] Sep 24 05:11:11.401877 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: X-Tenant: tempest-TestShelveInstance-1085488420 Sep 24 05:11:11.401877 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: X-Tenant-Id: cd3d02b11bdf45fe99687fda3d1078cd Sep 24 05:11:11.401877 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: X-Tenant-Name: tempest-TestShelveInstance-1085488420 Sep 24 05:11:11.401877 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: X-User: tempest-TestShelveInstance-1085488420-project Sep 24 05:11:11.401877 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: X-User-Domain-Id: default Sep 24 05:11:11.401877 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: X-User-Domain-Name: Default Sep 24 05:11:11.401877 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: X-User-Id: c8fe3c5c28964b768b2c0023fc62f163 Sep 24 05:11:11.401877 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: X-User-Name: tempest-TestShelveInstance-1085488420-project Sep 24 05:11:11.401877 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: method: > Sep 24 05:11:11.401877 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: exception: Instance 60d69c7d-69e4-4b2a-b41c-692867a6e28d could not be found. Sep 24 05:11:11.401877 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: action_args: {'id': '60d69c7d-69e4-4b2a-b41c-692867a6e28d'} Sep 24 05:11:11.403072 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 24 05:11:11.403072 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 05:11:11.403072 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 24 05:11:11.403072 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 24 05:11:11.403072 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 24 05:11:11.403072 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 24 05:11:11.403072 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 24 05:11:11.403072 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 24 05:11:11.403072 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 24 05:11:11.403072 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 24 05:11:11.403072 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 60d69c7d-69e4-4b2a-b41c-692867a6e28d could not be found. Sep 24 05:11:11.403072 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi Sep 24 05:11:11.403072 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 05:11:11.403072 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi Sep 24 05:11:11.403072 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 05:11:11.403072 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 05:11:11.403072 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 05:11:11.403072 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 24 05:11:11.403072 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 24 05:11:11.403072 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 24 05:11:11.404481 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 24 05:11:11.404481 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 24 05:11:11.404481 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 24 05:11:11.404481 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 24 05:11:11.404481 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 24 05:11:11.404481 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 24 05:11:11.404481 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 24 05:11:11.404481 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 60d69c7d-69e4-4b2a-b41c-692867a6e28d could not be found. Sep 24 05:11:11.404481 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi Sep 24 05:11:11.404481 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 05:11:11.404481 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi Sep 24 05:11:11.404481 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 05:11:11.404481 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 05:11:11.404481 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 05:11:11.404481 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 24 05:11:11.404481 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 24 05:11:11.404481 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 60d69c7d-69e4-4b2a-b41c-692867a6e28d could not be found. Sep 24 05:11:11.404481 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi Sep 24 05:11:11.406294 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-20652625-0d12-47f8-bc3d-ccf7e4a8cb95 tempest-TestShelveInstance-1085488420 tempest-TestShelveInstance-1085488420-project] Returning 404 to user: Instance 60d69c7d-69e4-4b2a-b41c-692867a6e28d could not be found. {{(pid=120593) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 24 05:11:11.406294 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-20652625-0d12-47f8-bc3d-ccf7e4a8cb95 tempest-TestShelveInstance-1085488420 tempest-TestShelveInstance-1085488420-project] 10.222.0.50 "GET /compute/v2.1/servers/60d69c7d-69e4-4b2a-b41c-692867a6e28d" status: 404 len: 111 microversion: 2.1 time: 0.032172 Sep 24 05:11:11.406294 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 512/1050] 10.222.0.50 () {58 vars in 1236 bytes} [Sat Sep 24 05:11:11 2022] GET /compute/v2.1/servers/60d69c7d-69e4-4b2a-b41c-692867a6e28d => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 24 05:11:11.582825 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-226e5430-d253-4a47-ac09-0ee769fc9b45 tempest-TestShelveInstance-1085488420 tempest-TestShelveInstance-1085488420-project] Calling method '.version_select at 0x7f79505545e0>' {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:11:11.601187 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [None req-226e5430-d253-4a47-ac09-0ee769fc9b45 tempest-TestShelveInstance-1085488420 tempest-TestShelveInstance-1085488420-project] 10.222.0.50 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-906986219" status: 202 len: 0 microversion: 2.1 time: 0.022230 Sep 24 05:11:11.601757 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 539/1051] 10.222.0.50 () {58 vars in 1251 bytes} [Sat Sep 24 05:11:11 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-906986219 => generated 0 bytes in 24 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 24 05:11:11.609027 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-9926781d-1fa9-444a-aeb5-f331410866d0 tempest-TestMinimumBasicScenario-2093795776 tempest-TestMinimumBasicScenario-2093795776-project] Calling method '>' {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:11:11.609722 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.compute.api [None req-9926781d-1fa9-444a-aeb5-f331410866d0 tempest-TestMinimumBasicScenario-2093795776 tempest-TestMinimumBasicScenario-2093795776-project] [instance: c8dc693a-12ca-40a8-8ce8-4f5cb342fb8f] Fetching instance by UUID {{(pid=120593) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:11:11.619807 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-9926781d-1fa9-444a-aeb5-f331410866d0 tempest-TestMinimumBasicScenario-2093795776 tempest-TestMinimumBasicScenario-2093795776-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:11:11.620342 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-9926781d-1fa9-444a-aeb5-f331410866d0 tempest-TestMinimumBasicScenario-2093795776 tempest-TestMinimumBasicScenario-2093795776-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:11:11.621400 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-9926781d-1fa9-444a-aeb5-f331410866d0 tempest-TestMinimumBasicScenario-2093795776 tempest-TestMinimumBasicScenario-2093795776-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:11:11.621926 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-9926781d-1fa9-444a-aeb5-f331410866d0 tempest-TestMinimumBasicScenario-2093795776 tempest-TestMinimumBasicScenario-2093795776-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:11:11.622400 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-9926781d-1fa9-444a-aeb5-f331410866d0 tempest-TestMinimumBasicScenario-2093795776 tempest-TestMinimumBasicScenario-2093795776-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:11:11.628988 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-9926781d-1fa9-444a-aeb5-f331410866d0 tempest-TestMinimumBasicScenario-2093795776 tempest-TestMinimumBasicScenario-2093795776-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:11:11.761528 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-9926781d-1fa9-444a-aeb5-f331410866d0 tempest-TestMinimumBasicScenario-2093795776 tempest-TestMinimumBasicScenario-2093795776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f67fe549bae6447f8b24219becb3bf97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85c73f9a74da4079a54a503e0b42ca2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:11:11.769474 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-9926781d-1fa9-444a-aeb5-f331410866d0 tempest-TestMinimumBasicScenario-2093795776 tempest-TestMinimumBasicScenario-2093795776-project] 10.222.0.50 "GET /compute/v2.1/servers/c8dc693a-12ca-40a8-8ce8-4f5cb342fb8f" status: 200 len: 1549 microversion: 2.1 time: 0.165133 Sep 24 05:11:11.770022 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 513/1052] 10.222.0.50 () {58 vars in 1236 bytes} [Sat Sep 24 05:11:11 2022] GET /compute/v2.1/servers/c8dc693a-12ca-40a8-8ce8-4f5cb342fb8f => generated 1549 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 05:11:11.792902 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-a7ebf904-8146-4967-b3e6-b9880b259e1d tempest-TestMinimumBasicScenario-2093795776 tempest-TestMinimumBasicScenario-2093795776-project] Calling method '>' {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:11:11.793510 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.compute.api [None req-a7ebf904-8146-4967-b3e6-b9880b259e1d tempest-TestMinimumBasicScenario-2093795776 tempest-TestMinimumBasicScenario-2093795776-project] [instance: c8dc693a-12ca-40a8-8ce8-4f5cb342fb8f] Fetching instance by UUID {{(pid=120594) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:11:11.799702 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-a7ebf904-8146-4967-b3e6-b9880b259e1d tempest-TestMinimumBasicScenario-2093795776 tempest-TestMinimumBasicScenario-2093795776-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:11:11.800218 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-a7ebf904-8146-4967-b3e6-b9880b259e1d tempest-TestMinimumBasicScenario-2093795776 tempest-TestMinimumBasicScenario-2093795776-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:11:11.800656 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-a7ebf904-8146-4967-b3e6-b9880b259e1d tempest-TestMinimumBasicScenario-2093795776 tempest-TestMinimumBasicScenario-2093795776-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:11:11.801357 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-a7ebf904-8146-4967-b3e6-b9880b259e1d tempest-TestMinimumBasicScenario-2093795776 tempest-TestMinimumBasicScenario-2093795776-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:11:11.801805 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-a7ebf904-8146-4967-b3e6-b9880b259e1d tempest-TestMinimumBasicScenario-2093795776 tempest-TestMinimumBasicScenario-2093795776-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:11:11.802272 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-a7ebf904-8146-4967-b3e6-b9880b259e1d tempest-TestMinimumBasicScenario-2093795776 tempest-TestMinimumBasicScenario-2093795776-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:11:11.841140 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-9aa7b4b3-c1e8-47fd-bb16-69547137f8b2 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Calling method '>' {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:11:11.842034 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.compute.api [None req-9aa7b4b3-c1e8-47fd-bb16-69547137f8b2 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] [instance: 36f8e098-a4b5-40a4-8f49-f341c5ad940c] Fetching instance by UUID {{(pid=120593) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:11:11.848650 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-9aa7b4b3-c1e8-47fd-bb16-69547137f8b2 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:11:11.849418 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-9aa7b4b3-c1e8-47fd-bb16-69547137f8b2 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:11:11.850087 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-9aa7b4b3-c1e8-47fd-bb16-69547137f8b2 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:11:11.850967 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-9aa7b4b3-c1e8-47fd-bb16-69547137f8b2 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:11:11.851431 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-9aa7b4b3-c1e8-47fd-bb16-69547137f8b2 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:11:11.851859 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-9aa7b4b3-c1e8-47fd-bb16-69547137f8b2 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:11:11.986817 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.policy [None req-a7ebf904-8146-4967-b3e6-b9880b259e1d tempest-TestMinimumBasicScenario-2093795776 tempest-TestMinimumBasicScenario-2093795776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f67fe549bae6447f8b24219becb3bf97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85c73f9a74da4079a54a503e0b42ca2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:11:11.996632 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [None req-a7ebf904-8146-4967-b3e6-b9880b259e1d tempest-TestMinimumBasicScenario-2093795776 tempest-TestMinimumBasicScenario-2093795776-project] 10.222.0.50 "GET /compute/v2.1/servers/c8dc693a-12ca-40a8-8ce8-4f5cb342fb8f" status: 200 len: 1549 microversion: 2.1 time: 0.208734 Sep 24 05:11:11.997450 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 540/1053] 10.222.0.50 () {58 vars in 1236 bytes} [Sat Sep 24 05:11:11 2022] GET /compute/v2.1/servers/c8dc693a-12ca-40a8-8ce8-4f5cb342fb8f => generated 1549 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 05:11:12.018305 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-9aa7b4b3-c1e8-47fd-bb16-69547137f8b2 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0948754217fc4ff2ba0241fa35feaf90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1aaf20f480a423ea5feca81585aeeed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:11:12.018982 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-51930225-0fda-4a2c-81ea-cd11f7503966 tempest-TestMinimumBasicScenario-2093795776 tempest-TestMinimumBasicScenario-2093795776-project] Calling method '>' {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:11:12.023900 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.policy [None req-51930225-0fda-4a2c-81ea-cd11f7503966 tempest-TestMinimumBasicScenario-2093795776 tempest-TestMinimumBasicScenario-2093795776-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'f67fe549bae6447f8b24219becb3bf97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85c73f9a74da4079a54a503e0b42ca2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:11:12.025195 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.compute.api [None req-51930225-0fda-4a2c-81ea-cd11f7503966 tempest-TestMinimumBasicScenario-2093795776 tempest-TestMinimumBasicScenario-2093795776-project] Searching by: {'deleted': False, 'project_id': '85c73f9a74da4079a54a503e0b42ca2e'} {{(pid=120594) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 24 05:11:12.027745 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-9aa7b4b3-c1e8-47fd-bb16-69547137f8b2 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0948754217fc4ff2ba0241fa35feaf90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1aaf20f480a423ea5feca81585aeeed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:11:12.029466 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-9aa7b4b3-c1e8-47fd-bb16-69547137f8b2 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0948754217fc4ff2ba0241fa35feaf90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1aaf20f480a423ea5feca81585aeeed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:11:12.030647 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-9aa7b4b3-c1e8-47fd-bb16-69547137f8b2 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] 10.222.0.50 "GET /compute/v2.1/servers/36f8e098-a4b5-40a4-8f49-f341c5ad940c" status: 200 len: 1724 microversion: 2.20 time: 0.193921 Sep 24 05:11:12.031202 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 514/1054] 10.222.0.50 () {60 vars in 1277 bytes} [Sat Sep 24 05:11:11 2022] GET /compute/v2.1/servers/36f8e098-a4b5-40a4-8f49-f341c5ad940c => generated 1724 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 24 05:11:12.032848 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-51930225-0fda-4a2c-81ea-cd11f7503966 tempest-TestMinimumBasicScenario-2093795776 tempest-TestMinimumBasicScenario-2093795776-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:11:12.033326 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-51930225-0fda-4a2c-81ea-cd11f7503966 tempest-TestMinimumBasicScenario-2093795776 tempest-TestMinimumBasicScenario-2093795776-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:11:12.034053 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-51930225-0fda-4a2c-81ea-cd11f7503966 tempest-TestMinimumBasicScenario-2093795776 tempest-TestMinimumBasicScenario-2093795776-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:11:12.034990 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-51930225-0fda-4a2c-81ea-cd11f7503966 tempest-TestMinimumBasicScenario-2093795776 tempest-TestMinimumBasicScenario-2093795776-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:11:12.035698 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-51930225-0fda-4a2c-81ea-cd11f7503966 tempest-TestMinimumBasicScenario-2093795776 tempest-TestMinimumBasicScenario-2093795776-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:11:12.036510 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-51930225-0fda-4a2c-81ea-cd11f7503966 tempest-TestMinimumBasicScenario-2093795776 tempest-TestMinimumBasicScenario-2093795776-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:11:12.132212 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.compute.multi_cell_list [None req-51930225-0fda-4a2c-81ea-cd11f7503966 tempest-TestMinimumBasicScenario-2093795776 tempest-TestMinimumBasicScenario-2093795776-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=120594) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Sep 24 05:11:12.204507 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-af8932fd-546a-4f35-8c1b-cb69f8ce0ca1 tempest-TestVolumeBootPattern-1339481357 tempest-TestVolumeBootPattern-1339481357-project] Calling method '>' {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:11:12.205192 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.compute.api [None req-af8932fd-546a-4f35-8c1b-cb69f8ce0ca1 tempest-TestVolumeBootPattern-1339481357 tempest-TestVolumeBootPattern-1339481357-project] [instance: dd7d8b54-2d8e-4a74-912f-4eab2ccf2125] Fetching instance by UUID {{(pid=120593) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:11:12.211577 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-af8932fd-546a-4f35-8c1b-cb69f8ce0ca1 tempest-TestVolumeBootPattern-1339481357 tempest-TestVolumeBootPattern-1339481357-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:11:12.212205 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-af8932fd-546a-4f35-8c1b-cb69f8ce0ca1 tempest-TestVolumeBootPattern-1339481357 tempest-TestVolumeBootPattern-1339481357-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:11:12.213220 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-af8932fd-546a-4f35-8c1b-cb69f8ce0ca1 tempest-TestVolumeBootPattern-1339481357 tempest-TestVolumeBootPattern-1339481357-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:11:12.214230 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-af8932fd-546a-4f35-8c1b-cb69f8ce0ca1 tempest-TestVolumeBootPattern-1339481357 tempest-TestVolumeBootPattern-1339481357-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:11:12.215031 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-af8932fd-546a-4f35-8c1b-cb69f8ce0ca1 tempest-TestVolumeBootPattern-1339481357 tempest-TestVolumeBootPattern-1339481357-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:11:12.215661 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-af8932fd-546a-4f35-8c1b-cb69f8ce0ca1 tempest-TestVolumeBootPattern-1339481357 tempest-TestVolumeBootPattern-1339481357-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:11:12.228417 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [None req-51930225-0fda-4a2c-81ea-cd11f7503966 tempest-TestMinimumBasicScenario-2093795776 tempest-TestMinimumBasicScenario-2093795776-project] 10.222.0.50 "GET /compute/v2.1/servers" status: 200 len: 343 microversion: 2.1 time: 0.213006 Sep 24 05:11:12.230653 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.wsgi [None req-af8932fd-546a-4f35-8c1b-cb69f8ce0ca1 tempest-TestVolumeBootPattern-1339481357 tempest-TestVolumeBootPattern-1339481357-project] HTTP exception thrown: Instance dd7d8b54-2d8e-4a74-912f-4eab2ccf2125 could not be found. Sep 24 05:11:12.232273 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-af8932fd-546a-4f35-8c1b-cb69f8ce0ca1 tempest-TestVolumeBootPattern-1339481357 tempest-TestVolumeBootPattern-1339481357-project] Request method failure captured: Sep 24 05:11:12.232273 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: request: GET /compute/v2.1/servers/dd7d8b54-2d8e-4a74-912f-4eab2ccf2125 HTTP/1.1 Sep 24 05:11:12.232273 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: Accept: application/json Sep 24 05:11:12.232273 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: Accept-Encoding: identity Sep 24 05:11:12.232273 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: Connection: close Sep 24 05:11:12.232273 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: Content-Length: 0 Sep 24 05:11:12.232273 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: Content-Type: application/json Sep 24 05:11:12.232273 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: Host: 10.222.0.50 Sep 24 05:11:12.232273 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: Openstack-System-Scope: None Sep 24 05:11:12.232273 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: User-Agent: python-urllib3/1.26.12 Sep 24 05:11:12.232273 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: X-Auth-Token: gAAAAABjLpCeE6D8vgXPZLE3UBn0EhNuNAYlX4X3foH_VqnJAbIepC8Hc1OmT41Tw45wEmDv7hYnAhqK7ORd7IXvHMNstcXMw_K7lenr8Yq0POwG1OxUbYSMAfzKDSF3S9nluknty2XjO7EseuzEnqkeZNGMERgJ_Hq7ozqEKQYIgCWBxUwAM1U Sep 24 05:11:12.232273 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: X-Domain-Id: None Sep 24 05:11:12.232273 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: X-Domain-Name: None Sep 24 05:11:12.232273 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: X-Identity-Status: Confirmed Sep 24 05:11:12.232273 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: X-Is-Admin-Project: True Sep 24 05:11:12.232273 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: X-Project-Domain-Id: default Sep 24 05:11:12.232273 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: X-Project-Domain-Name: Default Sep 24 05:11:12.232273 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: X-Project-Id: fef19544ec414094953daea6d545a361 Sep 24 05:11:12.232273 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: X-Project-Name: tempest-TestVolumeBootPattern-1339481357 Sep 24 05:11:12.232273 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: X-Role: member,reader Sep 24 05:11:12.232273 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: X-Roles: member,reader Sep 24 05:11:12.233937 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/fef19544ec414094953daea6d545a361"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/fef19544ec414094953daea6d545a361"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/fef19544ec414094953daea6d545a361"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.50:8080", "publicURL": "http://10.222.0.50:8080/v1/AUTH_fef19544ec414094953daea6d545a361"}]}] Sep 24 05:11:12.233937 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: X-Tenant: tempest-TestVolumeBootPattern-1339481357 Sep 24 05:11:12.233937 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: X-Tenant-Id: fef19544ec414094953daea6d545a361 Sep 24 05:11:12.233937 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: X-Tenant-Name: tempest-TestVolumeBootPattern-1339481357 Sep 24 05:11:12.233937 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: X-User: tempest-TestVolumeBootPattern-1339481357-project Sep 24 05:11:12.233937 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: X-User-Domain-Id: default Sep 24 05:11:12.233937 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: X-User-Domain-Name: Default Sep 24 05:11:12.233937 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: X-User-Id: 60edcebcccaa4da99ffddadd3e27c1c0 Sep 24 05:11:12.233937 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: X-User-Name: tempest-TestVolumeBootPattern-1339481357-project Sep 24 05:11:12.233937 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: method: > Sep 24 05:11:12.233937 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: exception: Instance dd7d8b54-2d8e-4a74-912f-4eab2ccf2125 could not be found. Sep 24 05:11:12.233937 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: action_args: {'id': 'dd7d8b54-2d8e-4a74-912f-4eab2ccf2125'} Sep 24 05:11:12.234988 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 24 05:11:12.234988 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 05:11:12.234988 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 24 05:11:12.234988 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 24 05:11:12.234988 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 24 05:11:12.234988 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 24 05:11:12.234988 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 24 05:11:12.234988 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 24 05:11:12.234988 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 24 05:11:12.234988 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 24 05:11:12.234988 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dd7d8b54-2d8e-4a74-912f-4eab2ccf2125 could not be found. Sep 24 05:11:12.234988 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi Sep 24 05:11:12.234988 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 05:11:12.234988 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi Sep 24 05:11:12.234988 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 05:11:12.234988 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 05:11:12.234988 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 05:11:12.234988 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 24 05:11:12.234988 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 24 05:11:12.234988 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 24 05:11:12.236854 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 24 05:11:12.236854 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 24 05:11:12.236854 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 24 05:11:12.236854 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 24 05:11:12.236854 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 24 05:11:12.236854 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 24 05:11:12.236854 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 24 05:11:12.236854 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dd7d8b54-2d8e-4a74-912f-4eab2ccf2125 could not be found. Sep 24 05:11:12.236854 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi Sep 24 05:11:12.236854 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 05:11:12.236854 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi Sep 24 05:11:12.236854 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 05:11:12.236854 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 05:11:12.236854 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 05:11:12.236854 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 24 05:11:12.236854 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 24 05:11:12.236854 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dd7d8b54-2d8e-4a74-912f-4eab2ccf2125 could not be found. Sep 24 05:11:12.236854 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi Sep 24 05:11:12.237961 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-af8932fd-546a-4f35-8c1b-cb69f8ce0ca1 tempest-TestVolumeBootPattern-1339481357 tempest-TestVolumeBootPattern-1339481357-project] Returning 404 to user: Instance dd7d8b54-2d8e-4a74-912f-4eab2ccf2125 could not be found. {{(pid=120593) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 24 05:11:12.237961 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-af8932fd-546a-4f35-8c1b-cb69f8ce0ca1 tempest-TestVolumeBootPattern-1339481357 tempest-TestVolumeBootPattern-1339481357-project] 10.222.0.50 "GET /compute/v2.1/servers/dd7d8b54-2d8e-4a74-912f-4eab2ccf2125" status: 404 len: 111 microversion: 2.1 time: 0.034486 Sep 24 05:11:12.238170 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 541/1055] 10.222.0.50 () {58 vars in 1125 bytes} [Sat Sep 24 05:11:12 2022] GET /compute/v2.1/servers => generated 343 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 24 05:11:12.239269 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 515/1056] 10.222.0.50 () {58 vars in 1236 bytes} [Sat Sep 24 05:11:12 2022] GET /compute/v2.1/servers/dd7d8b54-2d8e-4a74-912f-4eab2ccf2125 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 24 05:11:12.240766 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-6995af4d-c8ef-4fb0-8113-57a988dad904 tempest-TestMinimumBasicScenario-2093795776 tempest-TestMinimumBasicScenario-2093795776-project] Calling method '>' {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:11:12.241375 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.compute.api [None req-6995af4d-c8ef-4fb0-8113-57a988dad904 tempest-TestMinimumBasicScenario-2093795776 tempest-TestMinimumBasicScenario-2093795776-project] [instance: c8dc693a-12ca-40a8-8ce8-4f5cb342fb8f] Fetching instance by UUID {{(pid=120594) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:11:12.248436 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-6995af4d-c8ef-4fb0-8113-57a988dad904 tempest-TestMinimumBasicScenario-2093795776 tempest-TestMinimumBasicScenario-2093795776-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:11:12.248913 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-6995af4d-c8ef-4fb0-8113-57a988dad904 tempest-TestMinimumBasicScenario-2093795776 tempest-TestMinimumBasicScenario-2093795776-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:11:12.249345 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-6995af4d-c8ef-4fb0-8113-57a988dad904 tempest-TestMinimumBasicScenario-2093795776 tempest-TestMinimumBasicScenario-2093795776-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:11:12.250068 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-6995af4d-c8ef-4fb0-8113-57a988dad904 tempest-TestMinimumBasicScenario-2093795776 tempest-TestMinimumBasicScenario-2093795776-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:11:12.250512 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-6995af4d-c8ef-4fb0-8113-57a988dad904 tempest-TestMinimumBasicScenario-2093795776 tempest-TestMinimumBasicScenario-2093795776-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:11:12.251139 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-6995af4d-c8ef-4fb0-8113-57a988dad904 tempest-TestMinimumBasicScenario-2093795776 tempest-TestMinimumBasicScenario-2093795776-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:11:12.345339 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-44583087-6486-4281-b0ad-ffedaed28565 tempest-TestVolumeBootPattern-1339481357 tempest-TestVolumeBootPattern-1339481357-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-853066750", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-418909133", "security_groups": [{"name": "tempest-secgroup-smoke-1562507068"}], "block_device_mapping_v2": [{"uuid": "7bf50ac5-4831-47b0-a1e0-02a155eaedde", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "fcf1ce32-3017-4bcb-b05f-9527ef64d665"}]}} {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 05:11:12.394363 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.policy [None req-6995af4d-c8ef-4fb0-8113-57a988dad904 tempest-TestMinimumBasicScenario-2093795776 tempest-TestMinimumBasicScenario-2093795776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f67fe549bae6447f8b24219becb3bf97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85c73f9a74da4079a54a503e0b42ca2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:11:12.403647 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [None req-6995af4d-c8ef-4fb0-8113-57a988dad904 tempest-TestMinimumBasicScenario-2093795776 tempest-TestMinimumBasicScenario-2093795776-project] 10.222.0.50 "GET /compute/v2.1/servers/c8dc693a-12ca-40a8-8ce8-4f5cb342fb8f" status: 200 len: 1549 microversion: 2.1 time: 0.166645 Sep 24 05:11:12.404616 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 542/1057] 10.222.0.50 () {58 vars in 1236 bytes} [Sat Sep 24 05:11:12 2022] GET /compute/v2.1/servers/c8dc693a-12ca-40a8-8ce8-4f5cb342fb8f => generated 1549 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 05:11:12.476686 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.network.neutron [None req-44583087-6486-4281-b0ad-ffedaed28565 tempest-TestVolumeBootPattern-1339481357 tempest-TestVolumeBootPattern-1339481357-project] validate_networks() for [('fcf1ce32-3017-4bcb-b05f-9527ef64d665', None, None, None, None, None)] {{(pid=120593) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 24 05:11:12.902575 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.virt.hardware [None req-44583087-6486-4281-b0ad-ffedaed28565 tempest-TestVolumeBootPattern-1339481357 tempest-TestVolumeBootPattern-1339481357-project] Flavor limits 0:0:0 {{(pid=120593) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 24 05:11:12.902993 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.virt.hardware [None req-44583087-6486-4281-b0ad-ffedaed28565 tempest-TestVolumeBootPattern-1339481357 tempest-TestVolumeBootPattern-1339481357-project] Image limits 0:0:0 {{(pid=120593) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 24 05:11:12.903459 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.virt.hardware [None req-44583087-6486-4281-b0ad-ffedaed28565 tempest-TestVolumeBootPattern-1339481357 tempest-TestVolumeBootPattern-1339481357-project] Flavor pref 0:0:0 {{(pid=120593) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 24 05:11:12.903861 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.virt.hardware [None req-44583087-6486-4281-b0ad-ffedaed28565 tempest-TestVolumeBootPattern-1339481357 tempest-TestVolumeBootPattern-1339481357-project] Image pref 0:0:0 {{(pid=120593) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 24 05:11:12.904267 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.virt.hardware [None req-44583087-6486-4281-b0ad-ffedaed28565 tempest-TestVolumeBootPattern-1339481357 tempest-TestVolumeBootPattern-1339481357-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120593) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 24 05:11:12.935304 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-44583087-6486-4281-b0ad-ffedaed28565 tempest-TestVolumeBootPattern-1339481357 tempest-TestVolumeBootPattern-1339481357-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:11:12.936010 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-44583087-6486-4281-b0ad-ffedaed28565 tempest-TestVolumeBootPattern-1339481357 tempest-TestVolumeBootPattern-1339481357-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:11:12.936584 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-44583087-6486-4281-b0ad-ffedaed28565 tempest-TestVolumeBootPattern-1339481357 tempest-TestVolumeBootPattern-1339481357-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:11:12.937465 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-44583087-6486-4281-b0ad-ffedaed28565 tempest-TestVolumeBootPattern-1339481357 tempest-TestVolumeBootPattern-1339481357-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:11:12.938054 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-44583087-6486-4281-b0ad-ffedaed28565 tempest-TestVolumeBootPattern-1339481357 tempest-TestVolumeBootPattern-1339481357-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:11:12.938566 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-44583087-6486-4281-b0ad-ffedaed28565 tempest-TestVolumeBootPattern-1339481357 tempest-TestVolumeBootPattern-1339481357-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:11:12.958172 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.quota [None req-44583087-6486-4281-b0ad-ffedaed28565 tempest-TestVolumeBootPattern-1339481357 tempest-TestVolumeBootPattern-1339481357-project] Getting quotas for project fef19544ec414094953daea6d545a361. Resources: {'instances', 'ram', 'cores'} {{(pid=120593) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 24 05:11:12.963360 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.quota [None req-44583087-6486-4281-b0ad-ffedaed28565 tempest-TestVolumeBootPattern-1339481357 tempest-TestVolumeBootPattern-1339481357-project] Getting quotas for user 60edcebcccaa4da99ffddadd3e27c1c0 and project fef19544ec414094953daea6d545a361. Resources: {'instances', 'ram', 'cores'} {{(pid=120593) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 24 05:11:13.028181 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.compute.api [None req-44583087-6486-4281-b0ad-ffedaed28565 tempest-TestVolumeBootPattern-1339481357 tempest-TestVolumeBootPattern-1339481357-project] Going to run 1 instances... {{(pid=120593) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 24 05:11:13.030321 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.compute.api [None req-44583087-6486-4281-b0ad-ffedaed28565 tempest-TestVolumeBootPattern-1339481357 tempest-TestVolumeBootPattern-1339481357-project] [instance: 27a6c52e-9545-4713-870a-1d553eb7d609] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='7bf50ac5-4831-47b0-a1e0-02a155eaedde',volume_size=None,volume_type=None)] {{(pid=120593) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 24 05:11:13.057705 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-9433c400-798a-4021-8f7a-9ed291406d09 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Calling method '>' {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:11:13.058394 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.compute.api [None req-9433c400-798a-4021-8f7a-9ed291406d09 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] [instance: 36f8e098-a4b5-40a4-8f49-f341c5ad940c] Fetching instance by UUID {{(pid=120594) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:11:13.065988 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG dbcounter [-] [120594] Writing DB stats nova_api:SELECT=88,nova_api:INSERT=1,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=120594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 05:11:13.068204 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-9433c400-798a-4021-8f7a-9ed291406d09 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:11:13.068752 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-9433c400-798a-4021-8f7a-9ed291406d09 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:11:13.070651 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-9433c400-798a-4021-8f7a-9ed291406d09 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:11:13.071938 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-9433c400-798a-4021-8f7a-9ed291406d09 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:11:13.072405 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-9433c400-798a-4021-8f7a-9ed291406d09 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:11:13.072837 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-9433c400-798a-4021-8f7a-9ed291406d09 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:11:13.165877 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG dbcounter [-] [120593] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=6,nova_api:UPDATE=1 {{(pid=120593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 05:11:13.186969 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-44583087-6486-4281-b0ad-ffedaed28565 tempest-TestVolumeBootPattern-1339481357 tempest-TestVolumeBootPattern-1339481357-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.845393 Sep 24 05:11:13.187988 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 516/1058] 10.222.0.50 () {60 vars in 1147 bytes} [Sat Sep 24 05:11:12 2022] POST /compute/v2.1/servers => generated 406 bytes in 847 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Sep 24 05:11:13.205396 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-0926e44c-2364-43c2-97ec-a92aa0fdce3f tempest-TestVolumeBootPattern-1339481357 tempest-TestVolumeBootPattern-1339481357-project] Calling method '>' {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:11:13.206047 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.compute.api [None req-0926e44c-2364-43c2-97ec-a92aa0fdce3f tempest-TestVolumeBootPattern-1339481357 tempest-TestVolumeBootPattern-1339481357-project] [instance: 27a6c52e-9545-4713-870a-1d553eb7d609] Fetching instance by UUID {{(pid=120593) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:11:13.276783 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-0926e44c-2364-43c2-97ec-a92aa0fdce3f tempest-TestVolumeBootPattern-1339481357 tempest-TestVolumeBootPattern-1339481357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60edcebcccaa4da99ffddadd3e27c1c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fef19544ec414094953daea6d545a361', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:11:13.280412 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.policy [None req-9433c400-798a-4021-8f7a-9ed291406d09 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0948754217fc4ff2ba0241fa35feaf90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1aaf20f480a423ea5feca81585aeeed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:11:13.286035 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-0926e44c-2364-43c2-97ec-a92aa0fdce3f tempest-TestVolumeBootPattern-1339481357 tempest-TestVolumeBootPattern-1339481357-project] 10.222.0.50 "GET /compute/v2.1/servers/27a6c52e-9545-4713-870a-1d553eb7d609" status: 200 len: 1093 microversion: 2.1 time: 0.086777 Sep 24 05:11:13.287256 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 517/1059] 10.222.0.50 () {58 vars in 1236 bytes} [Sat Sep 24 05:11:13 2022] GET /compute/v2.1/servers/27a6c52e-9545-4713-870a-1d553eb7d609 => generated 1093 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 05:11:13.304541 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.policy [None req-9433c400-798a-4021-8f7a-9ed291406d09 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0948754217fc4ff2ba0241fa35feaf90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1aaf20f480a423ea5feca81585aeeed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:11:13.306115 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.policy [None req-9433c400-798a-4021-8f7a-9ed291406d09 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0948754217fc4ff2ba0241fa35feaf90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1aaf20f480a423ea5feca81585aeeed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:11:13.307603 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [None req-9433c400-798a-4021-8f7a-9ed291406d09 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] 10.222.0.50 "GET /compute/v2.1/servers/36f8e098-a4b5-40a4-8f49-f341c5ad940c" status: 200 len: 1724 microversion: 2.20 time: 0.254653 Sep 24 05:11:13.308552 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 543/1060] 10.222.0.50 () {60 vars in 1277 bytes} [Sat Sep 24 05:11:13 2022] GET /compute/v2.1/servers/36f8e098-a4b5-40a4-8f49-f341c5ad940c => generated 1724 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 24 05:11:14.070142 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-efcb8ea2-4cb1-425a-8025-55a960568293 tempest-TestMinimumBasicScenario-2093795776 tempest-TestMinimumBasicScenario-2093795776-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "e5c6afc9-9f1a-4e9c-9f68-d6b4af6844a8"}} {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 05:11:14.074117 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.compute.api [None req-efcb8ea2-4cb1-425a-8025-55a960568293 tempest-TestMinimumBasicScenario-2093795776 tempest-TestMinimumBasicScenario-2093795776-project] [instance: c8dc693a-12ca-40a8-8ce8-4f5cb342fb8f] Fetching instance by UUID {{(pid=120593) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:11:14.083920 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-efcb8ea2-4cb1-425a-8025-55a960568293 tempest-TestMinimumBasicScenario-2093795776 tempest-TestMinimumBasicScenario-2093795776-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:11:14.084503 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-efcb8ea2-4cb1-425a-8025-55a960568293 tempest-TestMinimumBasicScenario-2093795776 tempest-TestMinimumBasicScenario-2093795776-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:11:14.085018 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-efcb8ea2-4cb1-425a-8025-55a960568293 tempest-TestMinimumBasicScenario-2093795776 tempest-TestMinimumBasicScenario-2093795776-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:11:14.085830 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-efcb8ea2-4cb1-425a-8025-55a960568293 tempest-TestMinimumBasicScenario-2093795776 tempest-TestMinimumBasicScenario-2093795776-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:11:14.086402 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-efcb8ea2-4cb1-425a-8025-55a960568293 tempest-TestMinimumBasicScenario-2093795776 tempest-TestMinimumBasicScenario-2093795776-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:11:14.087615 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-efcb8ea2-4cb1-425a-8025-55a960568293 tempest-TestMinimumBasicScenario-2093795776 tempest-TestMinimumBasicScenario-2093795776-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:11:14.308885 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-9d2297bc-8fc3-4b21-bbb8-b9b0fde9bfe5 tempest-TestVolumeBootPattern-1339481357 tempest-TestVolumeBootPattern-1339481357-project] Calling method '>' {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:11:14.309462 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.compute.api [None req-9d2297bc-8fc3-4b21-bbb8-b9b0fde9bfe5 tempest-TestVolumeBootPattern-1339481357 tempest-TestVolumeBootPattern-1339481357-project] [instance: 27a6c52e-9545-4713-870a-1d553eb7d609] Fetching instance by UUID {{(pid=120594) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:11:14.315716 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-9d2297bc-8fc3-4b21-bbb8-b9b0fde9bfe5 tempest-TestVolumeBootPattern-1339481357 tempest-TestVolumeBootPattern-1339481357-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:11:14.316186 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-9d2297bc-8fc3-4b21-bbb8-b9b0fde9bfe5 tempest-TestVolumeBootPattern-1339481357 tempest-TestVolumeBootPattern-1339481357-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:11:14.316618 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-9d2297bc-8fc3-4b21-bbb8-b9b0fde9bfe5 tempest-TestVolumeBootPattern-1339481357 tempest-TestVolumeBootPattern-1339481357-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:11:14.317291 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-9d2297bc-8fc3-4b21-bbb8-b9b0fde9bfe5 tempest-TestVolumeBootPattern-1339481357 tempest-TestVolumeBootPattern-1339481357-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:11:14.317736 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-9d2297bc-8fc3-4b21-bbb8-b9b0fde9bfe5 tempest-TestVolumeBootPattern-1339481357 tempest-TestVolumeBootPattern-1339481357-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:11:14.318187 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-9d2297bc-8fc3-4b21-bbb8-b9b0fde9bfe5 tempest-TestVolumeBootPattern-1339481357 tempest-TestVolumeBootPattern-1339481357-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:11:14.388204 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.policy [None req-9d2297bc-8fc3-4b21-bbb8-b9b0fde9bfe5 tempest-TestVolumeBootPattern-1339481357 tempest-TestVolumeBootPattern-1339481357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60edcebcccaa4da99ffddadd3e27c1c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fef19544ec414094953daea6d545a361', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:11:14.395871 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [None req-9d2297bc-8fc3-4b21-bbb8-b9b0fde9bfe5 tempest-TestVolumeBootPattern-1339481357 tempest-TestVolumeBootPattern-1339481357-project] 10.222.0.50 "GET /compute/v2.1/servers/27a6c52e-9545-4713-870a-1d553eb7d609" status: 200 len: 1191 microversion: 2.1 time: 0.091005 Sep 24 05:11:14.396427 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 544/1061] 10.222.0.50 () {58 vars in 1236 bytes} [Sat Sep 24 05:11:14 2022] GET /compute/v2.1/servers/27a6c52e-9545-4713-870a-1d553eb7d609 => generated 1191 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 24 05:11:14.401565 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-096357fa-9fb2-449a-8a20-2eca9d8f1362 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Calling method '>' {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:11:14.402185 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.compute.api [None req-096357fa-9fb2-449a-8a20-2eca9d8f1362 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] [instance: 36f8e098-a4b5-40a4-8f49-f341c5ad940c] Fetching instance by UUID {{(pid=120594) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:11:14.407641 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-096357fa-9fb2-449a-8a20-2eca9d8f1362 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:11:14.408112 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-096357fa-9fb2-449a-8a20-2eca9d8f1362 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:11:14.408540 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-096357fa-9fb2-449a-8a20-2eca9d8f1362 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:11:14.409227 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-096357fa-9fb2-449a-8a20-2eca9d8f1362 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:11:14.409652 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-096357fa-9fb2-449a-8a20-2eca9d8f1362 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:11:14.410345 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-096357fa-9fb2-449a-8a20-2eca9d8f1362 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:11:14.623100 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.policy [None req-096357fa-9fb2-449a-8a20-2eca9d8f1362 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0948754217fc4ff2ba0241fa35feaf90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1aaf20f480a423ea5feca81585aeeed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:11:14.626967 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG dbcounter [-] [120594] Writing DB stats nova_cell1:SELECT=100 {{(pid=120594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 05:11:14.656452 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.policy [None req-096357fa-9fb2-449a-8a20-2eca9d8f1362 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0948754217fc4ff2ba0241fa35feaf90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1aaf20f480a423ea5feca81585aeeed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:11:14.662971 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.policy [None req-096357fa-9fb2-449a-8a20-2eca9d8f1362 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0948754217fc4ff2ba0241fa35feaf90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1aaf20f480a423ea5feca81585aeeed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:11:14.665299 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [None req-096357fa-9fb2-449a-8a20-2eca9d8f1362 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] 10.222.0.50 "GET /compute/v2.1/servers/36f8e098-a4b5-40a4-8f49-f341c5ad940c" status: 200 len: 1724 microversion: 2.20 time: 0.267704 Sep 24 05:11:14.683771 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 545/1062] 10.222.0.50 () {60 vars in 1277 bytes} [Sat Sep 24 05:11:14 2022] GET /compute/v2.1/servers/36f8e098-a4b5-40a4-8f49-f341c5ad940c => generated 1724 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 05:11:14.735245 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-efcb8ea2-4cb1-425a-8025-55a960568293 tempest-TestMinimumBasicScenario-2093795776 tempest-TestMinimumBasicScenario-2093795776-project] 10.222.0.50 "POST /compute/v2.1/servers/c8dc693a-12ca-40a8-8ce8-4f5cb342fb8f/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.669202 Sep 24 05:11:14.736183 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 518/1063] 10.222.0.50 () {60 vars in 1323 bytes} [Sat Sep 24 05:11:14 2022] POST /compute/v2.1/servers/c8dc693a-12ca-40a8-8ce8-4f5cb342fb8f/os-volume_attachments => generated 194 bytes in 671 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 05:11:15.426566 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-1d08d5a2-ab46-48d8-8830-355216a0851b tempest-TestVolumeBootPattern-1339481357 tempest-TestVolumeBootPattern-1339481357-project] Calling method '>' {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:11:15.427187 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.compute.api [None req-1d08d5a2-ab46-48d8-8830-355216a0851b tempest-TestVolumeBootPattern-1339481357 tempest-TestVolumeBootPattern-1339481357-project] [instance: 27a6c52e-9545-4713-870a-1d553eb7d609] Fetching instance by UUID {{(pid=120594) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:11:15.446291 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-1d08d5a2-ab46-48d8-8830-355216a0851b tempest-TestVolumeBootPattern-1339481357 tempest-TestVolumeBootPattern-1339481357-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:11:15.448545 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-1d08d5a2-ab46-48d8-8830-355216a0851b tempest-TestVolumeBootPattern-1339481357 tempest-TestVolumeBootPattern-1339481357-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:11:15.449264 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-1d08d5a2-ab46-48d8-8830-355216a0851b tempest-TestVolumeBootPattern-1339481357 tempest-TestVolumeBootPattern-1339481357-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:11:15.450279 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-1d08d5a2-ab46-48d8-8830-355216a0851b tempest-TestVolumeBootPattern-1339481357 tempest-TestVolumeBootPattern-1339481357-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:11:15.450829 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-1d08d5a2-ab46-48d8-8830-355216a0851b tempest-TestVolumeBootPattern-1339481357 tempest-TestVolumeBootPattern-1339481357-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:11:15.451727 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-1d08d5a2-ab46-48d8-8830-355216a0851b tempest-TestVolumeBootPattern-1339481357 tempest-TestVolumeBootPattern-1339481357-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:11:15.566419 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.policy [None req-1d08d5a2-ab46-48d8-8830-355216a0851b tempest-TestVolumeBootPattern-1339481357 tempest-TestVolumeBootPattern-1339481357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60edcebcccaa4da99ffddadd3e27c1c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fef19544ec414094953daea6d545a361', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:11:15.574798 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [None req-1d08d5a2-ab46-48d8-8830-355216a0851b tempest-TestVolumeBootPattern-1339481357 tempest-TestVolumeBootPattern-1339481357-project] 10.222.0.50 "GET /compute/v2.1/servers/27a6c52e-9545-4713-870a-1d553eb7d609" status: 200 len: 1209 microversion: 2.1 time: 0.157852 Sep 24 05:11:15.575981 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 546/1064] 10.222.0.50 () {58 vars in 1236 bytes} [Sat Sep 24 05:11:15 2022] GET /compute/v2.1/servers/27a6c52e-9545-4713-870a-1d553eb7d609 => generated 1209 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 05:11:15.696863 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-351ada9e-2a3e-4503-8cb3-3862b3f3dd47 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Calling method '>' {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:11:15.698405 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.compute.api [None req-351ada9e-2a3e-4503-8cb3-3862b3f3dd47 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] [instance: 36f8e098-a4b5-40a4-8f49-f341c5ad940c] Fetching instance by UUID {{(pid=120593) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:11:15.707300 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-351ada9e-2a3e-4503-8cb3-3862b3f3dd47 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:11:15.708290 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-351ada9e-2a3e-4503-8cb3-3862b3f3dd47 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:11:15.709050 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-351ada9e-2a3e-4503-8cb3-3862b3f3dd47 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:11:15.710011 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-351ada9e-2a3e-4503-8cb3-3862b3f3dd47 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:11:15.710687 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-351ada9e-2a3e-4503-8cb3-3862b3f3dd47 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:11:15.711360 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-351ada9e-2a3e-4503-8cb3-3862b3f3dd47 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:11:15.988368 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-351ada9e-2a3e-4503-8cb3-3862b3f3dd47 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0948754217fc4ff2ba0241fa35feaf90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1aaf20f480a423ea5feca81585aeeed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:11:15.993514 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG dbcounter [-] [120593] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=120593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 05:11:16.003940 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-351ada9e-2a3e-4503-8cb3-3862b3f3dd47 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0948754217fc4ff2ba0241fa35feaf90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1aaf20f480a423ea5feca81585aeeed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:11:16.006410 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-351ada9e-2a3e-4503-8cb3-3862b3f3dd47 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0948754217fc4ff2ba0241fa35feaf90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1aaf20f480a423ea5feca81585aeeed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:11:16.007939 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-351ada9e-2a3e-4503-8cb3-3862b3f3dd47 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] 10.222.0.50 "GET /compute/v2.1/servers/36f8e098-a4b5-40a4-8f49-f341c5ad940c" status: 200 len: 1724 microversion: 2.20 time: 0.315854 Sep 24 05:11:16.008627 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 519/1065] 10.222.0.50 () {60 vars in 1277 bytes} [Sat Sep 24 05:11:15 2022] GET /compute/v2.1/servers/36f8e098-a4b5-40a4-8f49-f341c5ad940c => generated 1724 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 05:11:16.567676 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [req-297d4703-dd11-4619-8d67-f4cf840d0a75 req-84786a0c-9843-457e-8620-e6e437b801ae service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "27a6c52e-9545-4713-870a-1d553eb7d609", "tag": "19cc232a-7d00-42f7-b737-1cb2a22e6c05"}]} {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 05:11:16.579827 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [req-297d4703-dd11-4619-8d67-f4cf840d0a75 req-84786a0c-9843-457e-8620-e6e437b801ae service nova] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:11:16.580596 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [req-297d4703-dd11-4619-8d67-f4cf840d0a75 req-84786a0c-9843-457e-8620-e6e437b801ae service nova] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:11:16.581244 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [req-297d4703-dd11-4619-8d67-f4cf840d0a75 req-84786a0c-9843-457e-8620-e6e437b801ae service nova] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:11:16.596743 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: INFO nova.api.openstack.compute.server_external_events [req-297d4703-dd11-4619-8d67-f4cf840d0a75 req-84786a0c-9843-457e-8620-e6e437b801ae service nova] Creating event network-changed:19cc232a-7d00-42f7-b737-1cb2a22e6c05 for instance 27a6c52e-9545-4713-870a-1d553eb7d609 on hv-cinder-85918 Sep 24 05:11:16.599377 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-f57c29d1-e6d5-40f6-bd5f-f3add505ffd3 tempest-TestVolumeBootPattern-1339481357 tempest-TestVolumeBootPattern-1339481357-project] Calling method '>' {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:11:16.600068 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.compute.api [None req-f57c29d1-e6d5-40f6-bd5f-f3add505ffd3 tempest-TestVolumeBootPattern-1339481357 tempest-TestVolumeBootPattern-1339481357-project] [instance: 27a6c52e-9545-4713-870a-1d553eb7d609] Fetching instance by UUID {{(pid=120593) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:11:16.605022 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [req-297d4703-dd11-4619-8d67-f4cf840d0a75 req-84786a0c-9843-457e-8620-e6e437b801ae service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041294 Sep 24 05:11:16.606163 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 547/1066] 10.222.0.50 () {64 vars in 1317 bytes} [Sat Sep 24 05:11:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 24 05:11:16.607871 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-f57c29d1-e6d5-40f6-bd5f-f3add505ffd3 tempest-TestVolumeBootPattern-1339481357 tempest-TestVolumeBootPattern-1339481357-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:11:16.608397 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-f57c29d1-e6d5-40f6-bd5f-f3add505ffd3 tempest-TestVolumeBootPattern-1339481357 tempest-TestVolumeBootPattern-1339481357-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:11:16.608819 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-f57c29d1-e6d5-40f6-bd5f-f3add505ffd3 tempest-TestVolumeBootPattern-1339481357 tempest-TestVolumeBootPattern-1339481357-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:11:16.609519 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-f57c29d1-e6d5-40f6-bd5f-f3add505ffd3 tempest-TestVolumeBootPattern-1339481357 tempest-TestVolumeBootPattern-1339481357-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:11:16.610085 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-f57c29d1-e6d5-40f6-bd5f-f3add505ffd3 tempest-TestVolumeBootPattern-1339481357 tempest-TestVolumeBootPattern-1339481357-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:11:16.610695 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-f57c29d1-e6d5-40f6-bd5f-f3add505ffd3 tempest-TestVolumeBootPattern-1339481357 tempest-TestVolumeBootPattern-1339481357-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:11:17.037781 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-3dfaf46a-afdd-44d0-a603-83c7ecd9db0e tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Calling method '>' {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:11:17.040924 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.compute.api [None req-3dfaf46a-afdd-44d0-a603-83c7ecd9db0e tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] [instance: 36f8e098-a4b5-40a4-8f49-f341c5ad940c] Fetching instance by UUID {{(pid=120594) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:11:17.049613 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-3dfaf46a-afdd-44d0-a603-83c7ecd9db0e tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:11:17.050293 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-3dfaf46a-afdd-44d0-a603-83c7ecd9db0e tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:11:17.050835 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-3dfaf46a-afdd-44d0-a603-83c7ecd9db0e tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:11:17.051777 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-3dfaf46a-afdd-44d0-a603-83c7ecd9db0e tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:11:17.052446 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-3dfaf46a-afdd-44d0-a603-83c7ecd9db0e tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:11:17.053156 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-3dfaf46a-afdd-44d0-a603-83c7ecd9db0e tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:11:17.142327 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-f57c29d1-e6d5-40f6-bd5f-f3add505ffd3 tempest-TestVolumeBootPattern-1339481357 tempest-TestVolumeBootPattern-1339481357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60edcebcccaa4da99ffddadd3e27c1c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fef19544ec414094953daea6d545a361', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:11:17.153280 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-f57c29d1-e6d5-40f6-bd5f-f3add505ffd3 tempest-TestVolumeBootPattern-1339481357 tempest-TestVolumeBootPattern-1339481357-project] 10.222.0.50 "GET /compute/v2.1/servers/27a6c52e-9545-4713-870a-1d553eb7d609" status: 200 len: 1265 microversion: 2.1 time: 0.558522 Sep 24 05:11:17.154215 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 520/1067] 10.222.0.50 () {58 vars in 1236 bytes} [Sat Sep 24 05:11:16 2022] GET /compute/v2.1/servers/27a6c52e-9545-4713-870a-1d553eb7d609 => generated 1265 bytes in 560 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 24 05:11:17.357791 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.policy [None req-3dfaf46a-afdd-44d0-a603-83c7ecd9db0e tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0948754217fc4ff2ba0241fa35feaf90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1aaf20f480a423ea5feca81585aeeed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:11:17.366355 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.policy [None req-3dfaf46a-afdd-44d0-a603-83c7ecd9db0e tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0948754217fc4ff2ba0241fa35feaf90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1aaf20f480a423ea5feca81585aeeed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:11:17.368997 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.policy [None req-3dfaf46a-afdd-44d0-a603-83c7ecd9db0e tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0948754217fc4ff2ba0241fa35feaf90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1aaf20f480a423ea5feca81585aeeed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:11:17.370269 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [None req-3dfaf46a-afdd-44d0-a603-83c7ecd9db0e tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] 10.222.0.50 "GET /compute/v2.1/servers/36f8e098-a4b5-40a4-8f49-f341c5ad940c" status: 200 len: 1724 microversion: 2.20 time: 0.339286 Sep 24 05:11:17.370764 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 548/1068] 10.222.0.50 () {60 vars in 1277 bytes} [Sat Sep 24 05:11:17 2022] GET /compute/v2.1/servers/36f8e098-a4b5-40a4-8f49-f341c5ad940c => generated 1724 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 24 05:11:18.176421 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-b3729fc0-9124-4704-a0a2-d7018ed531be tempest-TestVolumeBootPattern-1339481357 tempest-TestVolumeBootPattern-1339481357-project] Calling method '>' {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:11:18.177115 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.compute.api [None req-b3729fc0-9124-4704-a0a2-d7018ed531be tempest-TestVolumeBootPattern-1339481357 tempest-TestVolumeBootPattern-1339481357-project] [instance: 27a6c52e-9545-4713-870a-1d553eb7d609] Fetching instance by UUID {{(pid=120593) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:11:18.186744 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-b3729fc0-9124-4704-a0a2-d7018ed531be tempest-TestVolumeBootPattern-1339481357 tempest-TestVolumeBootPattern-1339481357-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:11:18.187233 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-b3729fc0-9124-4704-a0a2-d7018ed531be tempest-TestVolumeBootPattern-1339481357 tempest-TestVolumeBootPattern-1339481357-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:11:18.187675 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-b3729fc0-9124-4704-a0a2-d7018ed531be tempest-TestVolumeBootPattern-1339481357 tempest-TestVolumeBootPattern-1339481357-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:11:18.188434 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-b3729fc0-9124-4704-a0a2-d7018ed531be tempest-TestVolumeBootPattern-1339481357 tempest-TestVolumeBootPattern-1339481357-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:11:18.188891 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-b3729fc0-9124-4704-a0a2-d7018ed531be tempest-TestVolumeBootPattern-1339481357 tempest-TestVolumeBootPattern-1339481357-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:11:18.189317 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-b3729fc0-9124-4704-a0a2-d7018ed531be tempest-TestVolumeBootPattern-1339481357 tempest-TestVolumeBootPattern-1339481357-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:11:18.396156 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-67130ffa-f14c-4f3d-b435-89026cdfc2f8 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Calling method '>' {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:11:18.396949 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.compute.api [None req-67130ffa-f14c-4f3d-b435-89026cdfc2f8 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] [instance: 36f8e098-a4b5-40a4-8f49-f341c5ad940c] Fetching instance by UUID {{(pid=120594) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:11:18.402978 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-b3729fc0-9124-4704-a0a2-d7018ed531be tempest-TestVolumeBootPattern-1339481357 tempest-TestVolumeBootPattern-1339481357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60edcebcccaa4da99ffddadd3e27c1c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fef19544ec414094953daea6d545a361', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:11:18.405048 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-67130ffa-f14c-4f3d-b435-89026cdfc2f8 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:11:18.405544 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-67130ffa-f14c-4f3d-b435-89026cdfc2f8 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:11:18.405982 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-67130ffa-f14c-4f3d-b435-89026cdfc2f8 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:11:18.406737 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-67130ffa-f14c-4f3d-b435-89026cdfc2f8 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:11:18.407371 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-67130ffa-f14c-4f3d-b435-89026cdfc2f8 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:11:18.407960 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-67130ffa-f14c-4f3d-b435-89026cdfc2f8 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:11:18.416973 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-b3729fc0-9124-4704-a0a2-d7018ed531be tempest-TestVolumeBootPattern-1339481357 tempest-TestVolumeBootPattern-1339481357-project] 10.222.0.50 "GET /compute/v2.1/servers/27a6c52e-9545-4713-870a-1d553eb7d609" status: 200 len: 1265 microversion: 2.1 time: 0.244265 Sep 24 05:11:18.433479 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 521/1069] 10.222.0.50 () {58 vars in 1236 bytes} [Sat Sep 24 05:11:18 2022] GET /compute/v2.1/servers/27a6c52e-9545-4713-870a-1d553eb7d609 => generated 1265 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 05:11:18.573327 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.policy [None req-67130ffa-f14c-4f3d-b435-89026cdfc2f8 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0948754217fc4ff2ba0241fa35feaf90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1aaf20f480a423ea5feca81585aeeed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:11:18.585422 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.policy [None req-67130ffa-f14c-4f3d-b435-89026cdfc2f8 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0948754217fc4ff2ba0241fa35feaf90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1aaf20f480a423ea5feca81585aeeed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:11:18.587060 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.policy [None req-67130ffa-f14c-4f3d-b435-89026cdfc2f8 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0948754217fc4ff2ba0241fa35feaf90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1aaf20f480a423ea5feca81585aeeed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:11:18.588238 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [None req-67130ffa-f14c-4f3d-b435-89026cdfc2f8 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] 10.222.0.50 "GET /compute/v2.1/servers/36f8e098-a4b5-40a4-8f49-f341c5ad940c" status: 200 len: 1724 microversion: 2.20 time: 0.196845 Sep 24 05:11:18.599954 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 549/1070] 10.222.0.50 () {60 vars in 1277 bytes} [Sat Sep 24 05:11:18 2022] GET /compute/v2.1/servers/36f8e098-a4b5-40a4-8f49-f341c5ad940c => generated 1724 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 24 05:11:19.440800 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-a34bd441-211a-44d7-871b-a54c09c1ae16 tempest-TestVolumeBootPattern-1339481357 tempest-TestVolumeBootPattern-1339481357-project] Calling method '>' {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:11:19.441442 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.compute.api [None req-a34bd441-211a-44d7-871b-a54c09c1ae16 tempest-TestVolumeBootPattern-1339481357 tempest-TestVolumeBootPattern-1339481357-project] [instance: 27a6c52e-9545-4713-870a-1d553eb7d609] Fetching instance by UUID {{(pid=120593) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:11:19.448474 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-a34bd441-211a-44d7-871b-a54c09c1ae16 tempest-TestVolumeBootPattern-1339481357 tempest-TestVolumeBootPattern-1339481357-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:11:19.448983 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-a34bd441-211a-44d7-871b-a54c09c1ae16 tempest-TestVolumeBootPattern-1339481357 tempest-TestVolumeBootPattern-1339481357-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:11:19.449406 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-a34bd441-211a-44d7-871b-a54c09c1ae16 tempest-TestVolumeBootPattern-1339481357 tempest-TestVolumeBootPattern-1339481357-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:11:19.450141 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-a34bd441-211a-44d7-871b-a54c09c1ae16 tempest-TestVolumeBootPattern-1339481357 tempest-TestVolumeBootPattern-1339481357-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:11:19.450587 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-a34bd441-211a-44d7-871b-a54c09c1ae16 tempest-TestVolumeBootPattern-1339481357 tempest-TestVolumeBootPattern-1339481357-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:11:19.451136 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-a34bd441-211a-44d7-871b-a54c09c1ae16 tempest-TestVolumeBootPattern-1339481357 tempest-TestVolumeBootPattern-1339481357-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:11:19.597783 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-a34bd441-211a-44d7-871b-a54c09c1ae16 tempest-TestVolumeBootPattern-1339481357 tempest-TestVolumeBootPattern-1339481357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60edcebcccaa4da99ffddadd3e27c1c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fef19544ec414094953daea6d545a361', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:11:19.605852 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-a34bd441-211a-44d7-871b-a54c09c1ae16 tempest-TestVolumeBootPattern-1339481357 tempest-TestVolumeBootPattern-1339481357-project] 10.222.0.50 "GET /compute/v2.1/servers/27a6c52e-9545-4713-870a-1d553eb7d609" status: 200 len: 1265 microversion: 2.1 time: 0.168845 Sep 24 05:11:19.606511 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 522/1071] 10.222.0.50 () {58 vars in 1236 bytes} [Sat Sep 24 05:11:19 2022] GET /compute/v2.1/servers/27a6c52e-9545-4713-870a-1d553eb7d609 => generated 1265 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 05:11:19.615123 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-0b2d6417-51f3-432c-ab8e-fd183d484c2f tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Calling method '>' {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:11:19.615738 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.compute.api [None req-0b2d6417-51f3-432c-ab8e-fd183d484c2f tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] [instance: 36f8e098-a4b5-40a4-8f49-f341c5ad940c] Fetching instance by UUID {{(pid=120594) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:11:19.623204 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-0b2d6417-51f3-432c-ab8e-fd183d484c2f tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:11:19.623748 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-0b2d6417-51f3-432c-ab8e-fd183d484c2f tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:11:19.624188 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-0b2d6417-51f3-432c-ab8e-fd183d484c2f tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:11:19.624880 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-0b2d6417-51f3-432c-ab8e-fd183d484c2f tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:11:19.625332 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-0b2d6417-51f3-432c-ab8e-fd183d484c2f tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:11:19.625755 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-0b2d6417-51f3-432c-ab8e-fd183d484c2f tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:11:19.781082 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.policy [None req-0b2d6417-51f3-432c-ab8e-fd183d484c2f tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0948754217fc4ff2ba0241fa35feaf90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1aaf20f480a423ea5feca81585aeeed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:11:19.790725 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.policy [None req-0b2d6417-51f3-432c-ab8e-fd183d484c2f tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0948754217fc4ff2ba0241fa35feaf90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1aaf20f480a423ea5feca81585aeeed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:11:19.792341 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.policy [None req-0b2d6417-51f3-432c-ab8e-fd183d484c2f tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0948754217fc4ff2ba0241fa35feaf90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1aaf20f480a423ea5feca81585aeeed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:11:19.793756 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [None req-0b2d6417-51f3-432c-ab8e-fd183d484c2f tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] 10.222.0.50 "GET /compute/v2.1/servers/36f8e098-a4b5-40a4-8f49-f341c5ad940c" status: 200 len: 1745 microversion: 2.20 time: 0.182432 Sep 24 05:11:19.800318 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 550/1072] 10.222.0.50 () {60 vars in 1277 bytes} [Sat Sep 24 05:11:19 2022] GET /compute/v2.1/servers/36f8e098-a4b5-40a4-8f49-f341c5ad940c => generated 1745 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 05:11:20.135515 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-15a92f9c-9e93-489a-9265-a7323b594c2e tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Calling method '>' {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:11:20.136007 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.compute.api [None req-15a92f9c-9e93-489a-9265-a7323b594c2e tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] [instance: 87b5a30a-8b76-44d0-a014-23e753d0835f] Fetching instance by UUID {{(pid=120593) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:11:20.141811 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-15a92f9c-9e93-489a-9265-a7323b594c2e tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:11:20.142326 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-15a92f9c-9e93-489a-9265-a7323b594c2e tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:11:20.142759 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-15a92f9c-9e93-489a-9265-a7323b594c2e tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:11:20.143449 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-15a92f9c-9e93-489a-9265-a7323b594c2e tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:11:20.143897 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-15a92f9c-9e93-489a-9265-a7323b594c2e tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:11:20.144319 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-15a92f9c-9e93-489a-9265-a7323b594c2e tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:11:20.170718 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-15a92f9c-9e93-489a-9265-a7323b594c2e tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] 10.222.0.50 "GET /compute/v2.1/servers/87b5a30a-8b76-44d0-a014-23e753d0835f/ips" status: 200 len: 149 microversion: 2.1 time: 0.344210 Sep 24 05:11:20.180047 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 523/1073] 10.222.0.50 () {58 vars in 1248 bytes} [Sat Sep 24 05:11:19 2022] GET /compute/v2.1/servers/87b5a30a-8b76-44d0-a014-23e753d0835f/ips => generated 149 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 05:11:20.628272 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-454e637e-4eb4-4c92-86aa-d678cc0a61d6 tempest-TestVolumeBootPattern-1339481357 tempest-TestVolumeBootPattern-1339481357-project] Calling method '>' {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:11:20.628799 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.compute.api [None req-454e637e-4eb4-4c92-86aa-d678cc0a61d6 tempest-TestVolumeBootPattern-1339481357 tempest-TestVolumeBootPattern-1339481357-project] [instance: 27a6c52e-9545-4713-870a-1d553eb7d609] Fetching instance by UUID {{(pid=120594) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:11:20.635675 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-454e637e-4eb4-4c92-86aa-d678cc0a61d6 tempest-TestVolumeBootPattern-1339481357 tempest-TestVolumeBootPattern-1339481357-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:11:20.636149 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-454e637e-4eb4-4c92-86aa-d678cc0a61d6 tempest-TestVolumeBootPattern-1339481357 tempest-TestVolumeBootPattern-1339481357-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:11:20.636581 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-454e637e-4eb4-4c92-86aa-d678cc0a61d6 tempest-TestVolumeBootPattern-1339481357 tempest-TestVolumeBootPattern-1339481357-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:11:20.637264 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-454e637e-4eb4-4c92-86aa-d678cc0a61d6 tempest-TestVolumeBootPattern-1339481357 tempest-TestVolumeBootPattern-1339481357-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:11:20.637706 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-454e637e-4eb4-4c92-86aa-d678cc0a61d6 tempest-TestVolumeBootPattern-1339481357 tempest-TestVolumeBootPattern-1339481357-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:11:20.638157 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-454e637e-4eb4-4c92-86aa-d678cc0a61d6 tempest-TestVolumeBootPattern-1339481357 tempest-TestVolumeBootPattern-1339481357-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:11:20.773010 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.policy [None req-454e637e-4eb4-4c92-86aa-d678cc0a61d6 tempest-TestVolumeBootPattern-1339481357 tempest-TestVolumeBootPattern-1339481357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60edcebcccaa4da99ffddadd3e27c1c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fef19544ec414094953daea6d545a361', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:11:20.780817 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [None req-454e637e-4eb4-4c92-86aa-d678cc0a61d6 tempest-TestVolumeBootPattern-1339481357 tempest-TestVolumeBootPattern-1339481357-project] 10.222.0.50 "GET /compute/v2.1/servers/27a6c52e-9545-4713-870a-1d553eb7d609" status: 200 len: 1265 microversion: 2.1 time: 0.156450 Sep 24 05:11:20.781378 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 551/1074] 10.222.0.50 () {58 vars in 1236 bytes} [Sat Sep 24 05:11:20 2022] GET /compute/v2.1/servers/27a6c52e-9545-4713-870a-1d553eb7d609 => generated 1265 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 05:11:20.819676 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-3e86f11b-c43e-4a57-a22a-3b827fd269fc tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Calling method '>' {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:11:20.820283 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.compute.api [None req-3e86f11b-c43e-4a57-a22a-3b827fd269fc tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] [instance: 36f8e098-a4b5-40a4-8f49-f341c5ad940c] Fetching instance by UUID {{(pid=120593) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:11:20.827240 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-3e86f11b-c43e-4a57-a22a-3b827fd269fc tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:11:20.827716 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-3e86f11b-c43e-4a57-a22a-3b827fd269fc tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:11:20.828147 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-3e86f11b-c43e-4a57-a22a-3b827fd269fc tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:11:20.828829 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-3e86f11b-c43e-4a57-a22a-3b827fd269fc tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:11:20.829282 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-3e86f11b-c43e-4a57-a22a-3b827fd269fc tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:11:20.829702 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-3e86f11b-c43e-4a57-a22a-3b827fd269fc tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:11:20.953843 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-3e86f11b-c43e-4a57-a22a-3b827fd269fc tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0948754217fc4ff2ba0241fa35feaf90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1aaf20f480a423ea5feca81585aeeed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:11:20.961820 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-3e86f11b-c43e-4a57-a22a-3b827fd269fc tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0948754217fc4ff2ba0241fa35feaf90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1aaf20f480a423ea5feca81585aeeed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:11:20.963294 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-3e86f11b-c43e-4a57-a22a-3b827fd269fc tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0948754217fc4ff2ba0241fa35feaf90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1aaf20f480a423ea5feca81585aeeed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:11:20.964455 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-3e86f11b-c43e-4a57-a22a-3b827fd269fc tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] 10.222.0.50 "GET /compute/v2.1/servers/36f8e098-a4b5-40a4-8f49-f341c5ad940c" status: 200 len: 1745 microversion: 2.20 time: 0.148630 Sep 24 05:11:20.965046 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 524/1075] 10.222.0.50 () {60 vars in 1277 bytes} [Sat Sep 24 05:11:20 2022] GET /compute/v2.1/servers/36f8e098-a4b5-40a4-8f49-f341c5ad940c => generated 1745 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 05:11:21.528615 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-0524d59f-db5e-44f6-89e2-87a8563aaaf1 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "4f6f2720-7a4a-49cd-a46d-c4d56ef02725"}} {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 05:11:21.530931 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.compute.api [None req-0524d59f-db5e-44f6-89e2-87a8563aaaf1 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] [instance: 87b5a30a-8b76-44d0-a014-23e753d0835f] Fetching instance by UUID {{(pid=120594) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:11:21.537127 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-0524d59f-db5e-44f6-89e2-87a8563aaaf1 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:11:21.537605 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-0524d59f-db5e-44f6-89e2-87a8563aaaf1 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:11:21.538058 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-0524d59f-db5e-44f6-89e2-87a8563aaaf1 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:11:21.538740 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-0524d59f-db5e-44f6-89e2-87a8563aaaf1 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:11:21.539191 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-0524d59f-db5e-44f6-89e2-87a8563aaaf1 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:11:21.540243 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-0524d59f-db5e-44f6-89e2-87a8563aaaf1 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:11:21.802817 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-cdafe5bc-588c-498f-bb1b-795e1315504b tempest-TestVolumeBootPattern-1339481357 tempest-TestVolumeBootPattern-1339481357-project] Calling method '>' {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:11:21.803433 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.compute.api [None req-cdafe5bc-588c-498f-bb1b-795e1315504b tempest-TestVolumeBootPattern-1339481357 tempest-TestVolumeBootPattern-1339481357-project] [instance: 27a6c52e-9545-4713-870a-1d553eb7d609] Fetching instance by UUID {{(pid=120593) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:11:21.809446 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-cdafe5bc-588c-498f-bb1b-795e1315504b tempest-TestVolumeBootPattern-1339481357 tempest-TestVolumeBootPattern-1339481357-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:11:21.809928 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-cdafe5bc-588c-498f-bb1b-795e1315504b tempest-TestVolumeBootPattern-1339481357 tempest-TestVolumeBootPattern-1339481357-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:11:21.810399 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-cdafe5bc-588c-498f-bb1b-795e1315504b tempest-TestVolumeBootPattern-1339481357 tempest-TestVolumeBootPattern-1339481357-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:11:21.811092 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-cdafe5bc-588c-498f-bb1b-795e1315504b tempest-TestVolumeBootPattern-1339481357 tempest-TestVolumeBootPattern-1339481357-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:11:21.811550 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-cdafe5bc-588c-498f-bb1b-795e1315504b tempest-TestVolumeBootPattern-1339481357 tempest-TestVolumeBootPattern-1339481357-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:11:21.811972 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-cdafe5bc-588c-498f-bb1b-795e1315504b tempest-TestVolumeBootPattern-1339481357 tempest-TestVolumeBootPattern-1339481357-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:11:21.948504 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-cdafe5bc-588c-498f-bb1b-795e1315504b tempest-TestVolumeBootPattern-1339481357 tempest-TestVolumeBootPattern-1339481357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60edcebcccaa4da99ffddadd3e27c1c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fef19544ec414094953daea6d545a361', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:11:21.956383 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-cdafe5bc-588c-498f-bb1b-795e1315504b tempest-TestVolumeBootPattern-1339481357 tempest-TestVolumeBootPattern-1339481357-project] 10.222.0.50 "GET /compute/v2.1/servers/27a6c52e-9545-4713-870a-1d553eb7d609" status: 200 len: 1265 microversion: 2.1 time: 0.157377 Sep 24 05:11:21.956986 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 525/1076] 10.222.0.50 () {58 vars in 1236 bytes} [Sat Sep 24 05:11:21 2022] GET /compute/v2.1/servers/27a6c52e-9545-4713-870a-1d553eb7d609 => generated 1265 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 24 05:11:21.962191 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [req-ed6c4f59-9416-4371-a38d-b46b214abebd req-1f29ed3e-ecdf-428a-96d2-2e7c3d1530b9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "36f8e098-a4b5-40a4-8f49-f341c5ad940c", "name": "network-vif-plugged", "status": "completed", "tag": "e1514bf0-06bf-454f-bb1a-b1c69713927f"}]} {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 05:11:21.971087 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [req-ed6c4f59-9416-4371-a38d-b46b214abebd req-1f29ed3e-ecdf-428a-96d2-2e7c3d1530b9 service nova] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:11:21.971563 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [req-ed6c4f59-9416-4371-a38d-b46b214abebd req-1f29ed3e-ecdf-428a-96d2-2e7c3d1530b9 service nova] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:11:21.971997 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [req-ed6c4f59-9416-4371-a38d-b46b214abebd req-1f29ed3e-ecdf-428a-96d2-2e7c3d1530b9 service nova] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:11:21.982700 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.compute.server_external_events [req-ed6c4f59-9416-4371-a38d-b46b214abebd req-1f29ed3e-ecdf-428a-96d2-2e7c3d1530b9 service nova] Creating event network-vif-plugged:e1514bf0-06bf-454f-bb1a-b1c69713927f for instance 36f8e098-a4b5-40a4-8f49-f341c5ad940c on hv-cinder-85918 Sep 24 05:11:21.987784 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [req-ed6c4f59-9416-4371-a38d-b46b214abebd req-1f29ed3e-ecdf-428a-96d2-2e7c3d1530b9 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029588 Sep 24 05:11:21.988381 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 526/1077] 10.222.0.50 () {64 vars in 1317 bytes} [Sat Sep 24 05:11:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 05:11:21.993452 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-610c8da7-1fa7-4865-84ec-30b5a9aab88f tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Calling method '>' {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:11:21.994149 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.compute.api [None req-610c8da7-1fa7-4865-84ec-30b5a9aab88f tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] [instance: 36f8e098-a4b5-40a4-8f49-f341c5ad940c] Fetching instance by UUID {{(pid=120593) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:11:22.000034 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-610c8da7-1fa7-4865-84ec-30b5a9aab88f tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:11:22.000514 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-610c8da7-1fa7-4865-84ec-30b5a9aab88f tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:11:22.000951 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-610c8da7-1fa7-4865-84ec-30b5a9aab88f tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:11:22.001636 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-610c8da7-1fa7-4865-84ec-30b5a9aab88f tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:11:22.002119 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-610c8da7-1fa7-4865-84ec-30b5a9aab88f tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:11:22.002550 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-610c8da7-1fa7-4865-84ec-30b5a9aab88f tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:11:22.073392 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG dbcounter [-] [120594] Writing DB stats nova_cell0:SELECT=2 {{(pid=120594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 05:11:22.161082 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-610c8da7-1fa7-4865-84ec-30b5a9aab88f tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0948754217fc4ff2ba0241fa35feaf90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1aaf20f480a423ea5feca81585aeeed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:11:22.177504 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-610c8da7-1fa7-4865-84ec-30b5a9aab88f tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0948754217fc4ff2ba0241fa35feaf90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1aaf20f480a423ea5feca81585aeeed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:11:22.181422 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-610c8da7-1fa7-4865-84ec-30b5a9aab88f tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0948754217fc4ff2ba0241fa35feaf90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1aaf20f480a423ea5feca81585aeeed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:11:22.186848 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-610c8da7-1fa7-4865-84ec-30b5a9aab88f tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] 10.222.0.50 "GET /compute/v2.1/servers/36f8e098-a4b5-40a4-8f49-f341c5ad940c" status: 200 len: 1745 microversion: 2.20 time: 0.197245 Sep 24 05:11:22.187722 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 527/1078] 10.222.0.50 () {60 vars in 1277 bytes} [Sat Sep 24 05:11:21 2022] GET /compute/v2.1/servers/36f8e098-a4b5-40a4-8f49-f341c5ad940c => generated 1745 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 05:11:22.215137 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [None req-0524d59f-db5e-44f6-89e2-87a8563aaaf1 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] 10.222.0.50 "POST /compute/v2.1/servers/87b5a30a-8b76-44d0-a014-23e753d0835f/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.689749 Sep 24 05:11:22.218030 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 552/1079] 10.222.0.50 () {60 vars in 1323 bytes} [Sat Sep 24 05:11:21 2022] POST /compute/v2.1/servers/87b5a30a-8b76-44d0-a014-23e753d0835f/os-volume_attachments => generated 194 bytes in 693 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 05:11:22.460302 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-a5d698e9-c373-4d5e-bbad-2b0a5047a6ed tempest-TestMinimumBasicScenario-2093795776 tempest-TestMinimumBasicScenario-2093795776-project] Calling method '>' {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:11:22.460922 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.compute.api [None req-a5d698e9-c373-4d5e-bbad-2b0a5047a6ed tempest-TestMinimumBasicScenario-2093795776 tempest-TestMinimumBasicScenario-2093795776-project] [instance: c8dc693a-12ca-40a8-8ce8-4f5cb342fb8f] Fetching instance by UUID {{(pid=120593) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:11:22.467253 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-a5d698e9-c373-4d5e-bbad-2b0a5047a6ed tempest-TestMinimumBasicScenario-2093795776 tempest-TestMinimumBasicScenario-2093795776-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:11:22.467736 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-a5d698e9-c373-4d5e-bbad-2b0a5047a6ed tempest-TestMinimumBasicScenario-2093795776 tempest-TestMinimumBasicScenario-2093795776-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:11:22.468170 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-a5d698e9-c373-4d5e-bbad-2b0a5047a6ed tempest-TestMinimumBasicScenario-2093795776 tempest-TestMinimumBasicScenario-2093795776-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:11:22.468857 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-a5d698e9-c373-4d5e-bbad-2b0a5047a6ed tempest-TestMinimumBasicScenario-2093795776 tempest-TestMinimumBasicScenario-2093795776-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:11:22.469309 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-a5d698e9-c373-4d5e-bbad-2b0a5047a6ed tempest-TestMinimumBasicScenario-2093795776 tempest-TestMinimumBasicScenario-2093795776-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:11:22.469732 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-a5d698e9-c373-4d5e-bbad-2b0a5047a6ed tempest-TestMinimumBasicScenario-2093795776 tempest-TestMinimumBasicScenario-2093795776-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:11:22.599164 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-a5d698e9-c373-4d5e-bbad-2b0a5047a6ed tempest-TestMinimumBasicScenario-2093795776 tempest-TestMinimumBasicScenario-2093795776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f67fe549bae6447f8b24219becb3bf97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85c73f9a74da4079a54a503e0b42ca2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:11:22.607792 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-a5d698e9-c373-4d5e-bbad-2b0a5047a6ed tempest-TestMinimumBasicScenario-2093795776 tempest-TestMinimumBasicScenario-2093795776-project] 10.222.0.50 "GET /compute/v2.1/servers/c8dc693a-12ca-40a8-8ce8-4f5cb342fb8f" status: 200 len: 1595 microversion: 2.1 time: 0.151477 Sep 24 05:11:22.608374 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 528/1080] 10.222.0.50 () {58 vars in 1236 bytes} [Sat Sep 24 05:11:22 2022] GET /compute/v2.1/servers/c8dc693a-12ca-40a8-8ce8-4f5cb342fb8f => generated 1595 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 05:11:22.980241 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-35fa3f53-1721-41a5-a835-21adb0c030d9 tempest-TestVolumeBootPattern-1339481357 tempest-TestVolumeBootPattern-1339481357-project] Calling method '>' {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:11:22.980988 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.compute.api [None req-35fa3f53-1721-41a5-a835-21adb0c030d9 tempest-TestVolumeBootPattern-1339481357 tempest-TestVolumeBootPattern-1339481357-project] [instance: 27a6c52e-9545-4713-870a-1d553eb7d609] Fetching instance by UUID {{(pid=120594) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:11:22.987640 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-35fa3f53-1721-41a5-a835-21adb0c030d9 tempest-TestVolumeBootPattern-1339481357 tempest-TestVolumeBootPattern-1339481357-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:11:22.988118 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-35fa3f53-1721-41a5-a835-21adb0c030d9 tempest-TestVolumeBootPattern-1339481357 tempest-TestVolumeBootPattern-1339481357-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:11:22.988551 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-35fa3f53-1721-41a5-a835-21adb0c030d9 tempest-TestVolumeBootPattern-1339481357 tempest-TestVolumeBootPattern-1339481357-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:11:22.989233 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-35fa3f53-1721-41a5-a835-21adb0c030d9 tempest-TestVolumeBootPattern-1339481357 tempest-TestVolumeBootPattern-1339481357-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:11:22.989710 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-35fa3f53-1721-41a5-a835-21adb0c030d9 tempest-TestVolumeBootPattern-1339481357 tempest-TestVolumeBootPattern-1339481357-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:11:22.990156 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-35fa3f53-1721-41a5-a835-21adb0c030d9 tempest-TestVolumeBootPattern-1339481357 tempest-TestVolumeBootPattern-1339481357-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:11:23.207447 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.policy [None req-35fa3f53-1721-41a5-a835-21adb0c030d9 tempest-TestVolumeBootPattern-1339481357 tempest-TestVolumeBootPattern-1339481357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60edcebcccaa4da99ffddadd3e27c1c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fef19544ec414094953daea6d545a361', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:11:23.216196 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [None req-35fa3f53-1721-41a5-a835-21adb0c030d9 tempest-TestVolumeBootPattern-1339481357 tempest-TestVolumeBootPattern-1339481357-project] 10.222.0.50 "GET /compute/v2.1/servers/27a6c52e-9545-4713-870a-1d553eb7d609" status: 200 len: 1265 microversion: 2.1 time: 0.240893 Sep 24 05:11:23.216774 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 553/1081] 10.222.0.50 () {58 vars in 1236 bytes} [Sat Sep 24 05:11:22 2022] GET /compute/v2.1/servers/27a6c52e-9545-4713-870a-1d553eb7d609 => generated 1265 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 05:11:23.226474 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-765f45b2-8e10-44b3-ba2e-61dd05a12469 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Calling method '>' {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:11:23.227642 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.compute.api [None req-765f45b2-8e10-44b3-ba2e-61dd05a12469 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] [instance: 36f8e098-a4b5-40a4-8f49-f341c5ad940c] Fetching instance by UUID {{(pid=120593) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:11:23.233301 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG dbcounter [-] [120593] Writing DB stats nova_cell0:SELECT=2 {{(pid=120593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 05:11:23.235207 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-765f45b2-8e10-44b3-ba2e-61dd05a12469 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:11:23.235687 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-765f45b2-8e10-44b3-ba2e-61dd05a12469 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:11:23.236120 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-765f45b2-8e10-44b3-ba2e-61dd05a12469 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:11:23.236810 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-765f45b2-8e10-44b3-ba2e-61dd05a12469 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:11:23.237258 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-765f45b2-8e10-44b3-ba2e-61dd05a12469 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:11:23.237682 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-765f45b2-8e10-44b3-ba2e-61dd05a12469 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:11:23.280737 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG dbcounter [-] [120593] Writing DB stats nova_cell0:SELECT=8 {{(pid=120593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 05:11:23.456914 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-765f45b2-8e10-44b3-ba2e-61dd05a12469 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0948754217fc4ff2ba0241fa35feaf90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1aaf20f480a423ea5feca81585aeeed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:11:23.466099 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-765f45b2-8e10-44b3-ba2e-61dd05a12469 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0948754217fc4ff2ba0241fa35feaf90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1aaf20f480a423ea5feca81585aeeed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:11:23.467545 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-765f45b2-8e10-44b3-ba2e-61dd05a12469 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0948754217fc4ff2ba0241fa35feaf90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1aaf20f480a423ea5feca81585aeeed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:11:23.468709 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-765f45b2-8e10-44b3-ba2e-61dd05a12469 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] 10.222.0.50 "GET /compute/v2.1/servers/36f8e098-a4b5-40a4-8f49-f341c5ad940c" status: 200 len: 1745 microversion: 2.20 time: 0.246094 Sep 24 05:11:23.469469 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 529/1082] 10.222.0.50 () {60 vars in 1277 bytes} [Sat Sep 24 05:11:23 2022] GET /compute/v2.1/servers/36f8e098-a4b5-40a4-8f49-f341c5ad940c => generated 1745 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 05:11:24.239367 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-a284e18b-5d33-41ec-bf70-c99d0caf245c tempest-TestVolumeBootPattern-1339481357 tempest-TestVolumeBootPattern-1339481357-project] Calling method '>' {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:11:24.239885 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.compute.api [None req-a284e18b-5d33-41ec-bf70-c99d0caf245c tempest-TestVolumeBootPattern-1339481357 tempest-TestVolumeBootPattern-1339481357-project] [instance: 27a6c52e-9545-4713-870a-1d553eb7d609] Fetching instance by UUID {{(pid=120594) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:11:24.246190 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-a284e18b-5d33-41ec-bf70-c99d0caf245c tempest-TestVolumeBootPattern-1339481357 tempest-TestVolumeBootPattern-1339481357-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:11:24.246665 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-a284e18b-5d33-41ec-bf70-c99d0caf245c tempest-TestVolumeBootPattern-1339481357 tempest-TestVolumeBootPattern-1339481357-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:11:24.247094 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-a284e18b-5d33-41ec-bf70-c99d0caf245c tempest-TestVolumeBootPattern-1339481357 tempest-TestVolumeBootPattern-1339481357-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:11:24.247778 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-a284e18b-5d33-41ec-bf70-c99d0caf245c tempest-TestVolumeBootPattern-1339481357 tempest-TestVolumeBootPattern-1339481357-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:11:24.248222 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-a284e18b-5d33-41ec-bf70-c99d0caf245c tempest-TestVolumeBootPattern-1339481357 tempest-TestVolumeBootPattern-1339481357-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:11:24.248638 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-a284e18b-5d33-41ec-bf70-c99d0caf245c tempest-TestVolumeBootPattern-1339481357 tempest-TestVolumeBootPattern-1339481357-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:11:24.492669 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-65d2f358-8e8e-4df8-8f84-82f0f9ad9da9 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Calling method '>' {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:11:24.493274 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.compute.api [None req-65d2f358-8e8e-4df8-8f84-82f0f9ad9da9 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] [instance: 36f8e098-a4b5-40a4-8f49-f341c5ad940c] Fetching instance by UUID {{(pid=120593) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:11:24.493553 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.policy [None req-a284e18b-5d33-41ec-bf70-c99d0caf245c tempest-TestVolumeBootPattern-1339481357 tempest-TestVolumeBootPattern-1339481357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60edcebcccaa4da99ffddadd3e27c1c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fef19544ec414094953daea6d545a361', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:11:24.499432 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-65d2f358-8e8e-4df8-8f84-82f0f9ad9da9 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:11:24.499912 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-65d2f358-8e8e-4df8-8f84-82f0f9ad9da9 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:11:24.500343 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-65d2f358-8e8e-4df8-8f84-82f0f9ad9da9 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:11:24.501047 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-65d2f358-8e8e-4df8-8f84-82f0f9ad9da9 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:11:24.501497 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-65d2f358-8e8e-4df8-8f84-82f0f9ad9da9 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:11:24.501917 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-65d2f358-8e8e-4df8-8f84-82f0f9ad9da9 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:11:24.503303 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [None req-a284e18b-5d33-41ec-bf70-c99d0caf245c tempest-TestVolumeBootPattern-1339481357 tempest-TestVolumeBootPattern-1339481357-project] 10.222.0.50 "GET /compute/v2.1/servers/27a6c52e-9545-4713-870a-1d553eb7d609" status: 200 len: 1265 microversion: 2.1 time: 0.266605 Sep 24 05:11:24.518034 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 554/1083] 10.222.0.50 () {58 vars in 1236 bytes} [Sat Sep 24 05:11:24 2022] GET /compute/v2.1/servers/27a6c52e-9545-4713-870a-1d553eb7d609 => generated 1265 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 05:11:24.721611 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-65d2f358-8e8e-4df8-8f84-82f0f9ad9da9 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0948754217fc4ff2ba0241fa35feaf90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1aaf20f480a423ea5feca81585aeeed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:11:24.730259 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-65d2f358-8e8e-4df8-8f84-82f0f9ad9da9 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0948754217fc4ff2ba0241fa35feaf90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1aaf20f480a423ea5feca81585aeeed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:11:24.731699 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-65d2f358-8e8e-4df8-8f84-82f0f9ad9da9 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0948754217fc4ff2ba0241fa35feaf90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1aaf20f480a423ea5feca81585aeeed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:11:24.732859 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-65d2f358-8e8e-4df8-8f84-82f0f9ad9da9 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] 10.222.0.50 "GET /compute/v2.1/servers/36f8e098-a4b5-40a4-8f49-f341c5ad940c" status: 200 len: 1745 microversion: 2.20 time: 0.244155 Sep 24 05:11:24.733425 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 530/1084] 10.222.0.50 () {60 vars in 1277 bytes} [Sat Sep 24 05:11:24 2022] GET /compute/v2.1/servers/36f8e098-a4b5-40a4-8f49-f341c5ad940c => generated 1745 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 24 05:11:24.912847 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [req-f43e4404-ba64-43ce-b1fb-b26893243ec5 req-c4c3ad2f-78bd-4e59-81a8-b0fbd857908e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c8dc693a-12ca-40a8-8ce8-4f5cb342fb8f", "tag": "3c4098d3-98fe-49ac-9677-5b3632da2208"}]} {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 05:11:24.923190 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [req-f43e4404-ba64-43ce-b1fb-b26893243ec5 req-c4c3ad2f-78bd-4e59-81a8-b0fbd857908e service nova] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:11:24.923910 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [req-f43e4404-ba64-43ce-b1fb-b26893243ec5 req-c4c3ad2f-78bd-4e59-81a8-b0fbd857908e service nova] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:11:24.924638 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [req-f43e4404-ba64-43ce-b1fb-b26893243ec5 req-c4c3ad2f-78bd-4e59-81a8-b0fbd857908e service nova] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:11:24.935822 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: INFO nova.api.openstack.compute.server_external_events [req-f43e4404-ba64-43ce-b1fb-b26893243ec5 req-c4c3ad2f-78bd-4e59-81a8-b0fbd857908e service nova] Creating event network-changed:3c4098d3-98fe-49ac-9677-5b3632da2208 for instance c8dc693a-12ca-40a8-8ce8-4f5cb342fb8f on hv-cinder-85918 Sep 24 05:11:24.940632 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [req-f43e4404-ba64-43ce-b1fb-b26893243ec5 req-c4c3ad2f-78bd-4e59-81a8-b0fbd857908e service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031671 Sep 24 05:11:24.941751 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 555/1085] 10.222.0.50 () {64 vars in 1317 bytes} [Sat Sep 24 05:11:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 05:11:25.526824 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-63f3f5f6-b8ca-4c0a-8eae-88f3ea0affef tempest-TestVolumeBootPattern-1339481357 tempest-TestVolumeBootPattern-1339481357-project] Calling method '>' {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:11:25.528112 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.compute.api [None req-63f3f5f6-b8ca-4c0a-8eae-88f3ea0affef tempest-TestVolumeBootPattern-1339481357 tempest-TestVolumeBootPattern-1339481357-project] [instance: 27a6c52e-9545-4713-870a-1d553eb7d609] Fetching instance by UUID {{(pid=120593) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:11:25.534419 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-63f3f5f6-b8ca-4c0a-8eae-88f3ea0affef tempest-TestVolumeBootPattern-1339481357 tempest-TestVolumeBootPattern-1339481357-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:11:25.535396 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-63f3f5f6-b8ca-4c0a-8eae-88f3ea0affef tempest-TestVolumeBootPattern-1339481357 tempest-TestVolumeBootPattern-1339481357-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:11:25.535985 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-63f3f5f6-b8ca-4c0a-8eae-88f3ea0affef tempest-TestVolumeBootPattern-1339481357 tempest-TestVolumeBootPattern-1339481357-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:11:25.536900 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-63f3f5f6-b8ca-4c0a-8eae-88f3ea0affef tempest-TestVolumeBootPattern-1339481357 tempest-TestVolumeBootPattern-1339481357-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:11:25.537535 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-63f3f5f6-b8ca-4c0a-8eae-88f3ea0affef tempest-TestVolumeBootPattern-1339481357 tempest-TestVolumeBootPattern-1339481357-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:11:25.538222 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-63f3f5f6-b8ca-4c0a-8eae-88f3ea0affef tempest-TestVolumeBootPattern-1339481357 tempest-TestVolumeBootPattern-1339481357-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:11:25.727472 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-63f3f5f6-b8ca-4c0a-8eae-88f3ea0affef tempest-TestVolumeBootPattern-1339481357 tempest-TestVolumeBootPattern-1339481357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60edcebcccaa4da99ffddadd3e27c1c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fef19544ec414094953daea6d545a361', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:11:25.735385 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-63f3f5f6-b8ca-4c0a-8eae-88f3ea0affef tempest-TestVolumeBootPattern-1339481357 tempest-TestVolumeBootPattern-1339481357-project] 10.222.0.50 "GET /compute/v2.1/servers/27a6c52e-9545-4713-870a-1d553eb7d609" status: 200 len: 1265 microversion: 2.1 time: 0.212394 Sep 24 05:11:25.735956 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 531/1086] 10.222.0.50 () {58 vars in 1236 bytes} [Sat Sep 24 05:11:25 2022] GET /compute/v2.1/servers/27a6c52e-9545-4713-870a-1d553eb7d609 => generated 1265 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 05:11:25.762133 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-091b165e-3298-4c73-a652-bc71684a3041 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Calling method '>' {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:11:25.763449 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.compute.api [None req-091b165e-3298-4c73-a652-bc71684a3041 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] [instance: 36f8e098-a4b5-40a4-8f49-f341c5ad940c] Fetching instance by UUID {{(pid=120594) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:11:25.770039 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-091b165e-3298-4c73-a652-bc71684a3041 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:11:25.770530 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-091b165e-3298-4c73-a652-bc71684a3041 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:11:25.770981 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-091b165e-3298-4c73-a652-bc71684a3041 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:11:25.771708 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-091b165e-3298-4c73-a652-bc71684a3041 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:11:25.772169 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-091b165e-3298-4c73-a652-bc71684a3041 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:11:25.772678 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-091b165e-3298-4c73-a652-bc71684a3041 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:11:25.988090 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.policy [None req-091b165e-3298-4c73-a652-bc71684a3041 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0948754217fc4ff2ba0241fa35feaf90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1aaf20f480a423ea5feca81585aeeed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:11:26.000877 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.policy [None req-091b165e-3298-4c73-a652-bc71684a3041 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0948754217fc4ff2ba0241fa35feaf90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1aaf20f480a423ea5feca81585aeeed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:11:26.002380 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.policy [None req-091b165e-3298-4c73-a652-bc71684a3041 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0948754217fc4ff2ba0241fa35feaf90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1aaf20f480a423ea5feca81585aeeed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:11:26.002615 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-e163a295-e7b6-4e23-8e15-5e7ecb375150 tempest-TestMinimumBasicScenario-2093795776 tempest-TestMinimumBasicScenario-2093795776-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-872743105"}} {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 05:11:26.003300 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.compute.api [None req-e163a295-e7b6-4e23-8e15-5e7ecb375150 tempest-TestMinimumBasicScenario-2093795776 tempest-TestMinimumBasicScenario-2093795776-project] [instance: c8dc693a-12ca-40a8-8ce8-4f5cb342fb8f] Fetching instance by UUID {{(pid=120593) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:11:26.003555 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [None req-091b165e-3298-4c73-a652-bc71684a3041 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] 10.222.0.50 "GET /compute/v2.1/servers/36f8e098-a4b5-40a4-8f49-f341c5ad940c" status: 200 len: 1745 microversion: 2.20 time: 0.247219 Sep 24 05:11:26.004122 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 556/1087] 10.222.0.50 () {60 vars in 1277 bytes} [Sat Sep 24 05:11:25 2022] GET /compute/v2.1/servers/36f8e098-a4b5-40a4-8f49-f341c5ad940c => generated 1745 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 05:11:26.010459 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-e163a295-e7b6-4e23-8e15-5e7ecb375150 tempest-TestMinimumBasicScenario-2093795776 tempest-TestMinimumBasicScenario-2093795776-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:11:26.010928 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-e163a295-e7b6-4e23-8e15-5e7ecb375150 tempest-TestMinimumBasicScenario-2093795776 tempest-TestMinimumBasicScenario-2093795776-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:11:26.011533 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-e163a295-e7b6-4e23-8e15-5e7ecb375150 tempest-TestMinimumBasicScenario-2093795776 tempest-TestMinimumBasicScenario-2093795776-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:11:26.012783 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-e163a295-e7b6-4e23-8e15-5e7ecb375150 tempest-TestMinimumBasicScenario-2093795776 tempest-TestMinimumBasicScenario-2093795776-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:11:26.013521 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-e163a295-e7b6-4e23-8e15-5e7ecb375150 tempest-TestMinimumBasicScenario-2093795776 tempest-TestMinimumBasicScenario-2093795776-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:11:26.014405 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-e163a295-e7b6-4e23-8e15-5e7ecb375150 tempest-TestMinimumBasicScenario-2093795776 tempest-TestMinimumBasicScenario-2093795776-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:11:26.177220 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: INFO nova.network.security_group_api [None req-e163a295-e7b6-4e23-8e15-5e7ecb375150 tempest-TestMinimumBasicScenario-2093795776 tempest-TestMinimumBasicScenario-2093795776-project] Adding security group 04ed11fc-2c07-4d53-8110-ad9819653190 to port 3c4098d3-98fe-49ac-9677-5b3632da2208 Sep 24 05:11:26.511353 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-e163a295-e7b6-4e23-8e15-5e7ecb375150 tempest-TestMinimumBasicScenario-2093795776 tempest-TestMinimumBasicScenario-2093795776-project] 10.222.0.50 "POST /compute/v2.1/servers/c8dc693a-12ca-40a8-8ce8-4f5cb342fb8f/action" status: 202 len: 0 microversion: 2.1 time: 0.512724 Sep 24 05:11:26.515604 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 532/1088] 10.222.0.50 () {60 vars in 1278 bytes} [Sat Sep 24 05:11:25 2022] POST /compute/v2.1/servers/c8dc693a-12ca-40a8-8ce8-4f5cb342fb8f/action => generated 0 bytes in 516 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 24 05:11:26.527283 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-9f9e1143-80d7-43bd-8505-9166c649db11 tempest-TestMinimumBasicScenario-2093795776 tempest-TestMinimumBasicScenario-2093795776-project] Calling method '>' {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:11:26.528180 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.compute.api [None req-9f9e1143-80d7-43bd-8505-9166c649db11 tempest-TestMinimumBasicScenario-2093795776 tempest-TestMinimumBasicScenario-2093795776-project] [instance: c8dc693a-12ca-40a8-8ce8-4f5cb342fb8f] Fetching instance by UUID {{(pid=120594) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:11:26.538274 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-9f9e1143-80d7-43bd-8505-9166c649db11 tempest-TestMinimumBasicScenario-2093795776 tempest-TestMinimumBasicScenario-2093795776-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:11:26.542143 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-9f9e1143-80d7-43bd-8505-9166c649db11 tempest-TestMinimumBasicScenario-2093795776 tempest-TestMinimumBasicScenario-2093795776-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:11:26.542801 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-9f9e1143-80d7-43bd-8505-9166c649db11 tempest-TestMinimumBasicScenario-2093795776 tempest-TestMinimumBasicScenario-2093795776-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:11:26.543744 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-9f9e1143-80d7-43bd-8505-9166c649db11 tempest-TestMinimumBasicScenario-2093795776 tempest-TestMinimumBasicScenario-2093795776-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:11:26.546016 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-9f9e1143-80d7-43bd-8505-9166c649db11 tempest-TestMinimumBasicScenario-2093795776 tempest-TestMinimumBasicScenario-2093795776-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:11:26.546658 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-9f9e1143-80d7-43bd-8505-9166c649db11 tempest-TestMinimumBasicScenario-2093795776 tempest-TestMinimumBasicScenario-2093795776-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:11:26.722947 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.policy [None req-9f9e1143-80d7-43bd-8505-9166c649db11 tempest-TestMinimumBasicScenario-2093795776 tempest-TestMinimumBasicScenario-2093795776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f67fe549bae6447f8b24219becb3bf97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85c73f9a74da4079a54a503e0b42ca2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:11:26.732149 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [None req-9f9e1143-80d7-43bd-8505-9166c649db11 tempest-TestMinimumBasicScenario-2093795776 tempest-TestMinimumBasicScenario-2093795776-project] 10.222.0.50 "GET /compute/v2.1/servers/c8dc693a-12ca-40a8-8ce8-4f5cb342fb8f" status: 200 len: 1760 microversion: 2.1 time: 0.213672 Sep 24 05:11:26.732741 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 557/1089] 10.222.0.50 () {58 vars in 1236 bytes} [Sat Sep 24 05:11:26 2022] GET /compute/v2.1/servers/c8dc693a-12ca-40a8-8ce8-4f5cb342fb8f => generated 1760 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 24 05:11:26.761857 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-4242eae7-e7e5-449a-9796-c90d459aa20a tempest-TestVolumeBootPattern-1339481357 tempest-TestVolumeBootPattern-1339481357-project] Calling method '>' {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:11:26.762584 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.compute.api [None req-4242eae7-e7e5-449a-9796-c90d459aa20a tempest-TestVolumeBootPattern-1339481357 tempest-TestVolumeBootPattern-1339481357-project] [instance: 27a6c52e-9545-4713-870a-1d553eb7d609] Fetching instance by UUID {{(pid=120593) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:11:26.769265 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-4242eae7-e7e5-449a-9796-c90d459aa20a tempest-TestVolumeBootPattern-1339481357 tempest-TestVolumeBootPattern-1339481357-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:11:26.770138 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-4242eae7-e7e5-449a-9796-c90d459aa20a tempest-TestVolumeBootPattern-1339481357 tempest-TestVolumeBootPattern-1339481357-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:11:26.770594 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-4242eae7-e7e5-449a-9796-c90d459aa20a tempest-TestVolumeBootPattern-1339481357 tempest-TestVolumeBootPattern-1339481357-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:11:26.771317 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-4242eae7-e7e5-449a-9796-c90d459aa20a tempest-TestVolumeBootPattern-1339481357 tempest-TestVolumeBootPattern-1339481357-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:11:26.771867 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-4242eae7-e7e5-449a-9796-c90d459aa20a tempest-TestVolumeBootPattern-1339481357 tempest-TestVolumeBootPattern-1339481357-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:11:26.772321 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-4242eae7-e7e5-449a-9796-c90d459aa20a tempest-TestVolumeBootPattern-1339481357 tempest-TestVolumeBootPattern-1339481357-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:11:26.918695 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-4242eae7-e7e5-449a-9796-c90d459aa20a tempest-TestVolumeBootPattern-1339481357 tempest-TestVolumeBootPattern-1339481357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60edcebcccaa4da99ffddadd3e27c1c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fef19544ec414094953daea6d545a361', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:11:26.928445 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-4242eae7-e7e5-449a-9796-c90d459aa20a tempest-TestVolumeBootPattern-1339481357 tempest-TestVolumeBootPattern-1339481357-project] 10.222.0.50 "GET /compute/v2.1/servers/27a6c52e-9545-4713-870a-1d553eb7d609" status: 200 len: 1265 microversion: 2.1 time: 0.173286 Sep 24 05:11:26.929399 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 533/1090] 10.222.0.50 () {58 vars in 1236 bytes} [Sat Sep 24 05:11:26 2022] GET /compute/v2.1/servers/27a6c52e-9545-4713-870a-1d553eb7d609 => generated 1265 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 05:11:26.957480 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [req-de18d8ac-2944-41a6-9d7b-07abbceffd5a req-6f8679c1-8c74-4489-9b93-bbb47b8d27aa service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c8dc693a-12ca-40a8-8ce8-4f5cb342fb8f", "tag": "3c4098d3-98fe-49ac-9677-5b3632da2208"}]} {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 05:11:26.969502 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [req-de18d8ac-2944-41a6-9d7b-07abbceffd5a req-6f8679c1-8c74-4489-9b93-bbb47b8d27aa service nova] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:11:26.970264 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [req-de18d8ac-2944-41a6-9d7b-07abbceffd5a req-6f8679c1-8c74-4489-9b93-bbb47b8d27aa service nova] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:11:26.970758 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [req-de18d8ac-2944-41a6-9d7b-07abbceffd5a req-6f8679c1-8c74-4489-9b93-bbb47b8d27aa service nova] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:11:26.982607 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: INFO nova.api.openstack.compute.server_external_events [req-de18d8ac-2944-41a6-9d7b-07abbceffd5a req-6f8679c1-8c74-4489-9b93-bbb47b8d27aa service nova] Creating event network-changed:3c4098d3-98fe-49ac-9677-5b3632da2208 for instance c8dc693a-12ca-40a8-8ce8-4f5cb342fb8f on hv-cinder-85918 Sep 24 05:11:26.987763 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [req-de18d8ac-2944-41a6-9d7b-07abbceffd5a req-6f8679c1-8c74-4489-9b93-bbb47b8d27aa service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034213 Sep 24 05:11:26.988351 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 558/1091] 10.222.0.50 () {64 vars in 1317 bytes} [Sat Sep 24 05:11:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 05:11:27.032155 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-89dd6da9-c4a4-4829-a22e-02a2ce3a5d15 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Calling method '>' {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:11:27.032832 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.compute.api [None req-89dd6da9-c4a4-4829-a22e-02a2ce3a5d15 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] [instance: 36f8e098-a4b5-40a4-8f49-f341c5ad940c] Fetching instance by UUID {{(pid=120593) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:11:27.040393 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-89dd6da9-c4a4-4829-a22e-02a2ce3a5d15 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:11:27.040963 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-89dd6da9-c4a4-4829-a22e-02a2ce3a5d15 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:11:27.041499 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-89dd6da9-c4a4-4829-a22e-02a2ce3a5d15 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:11:27.042303 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-89dd6da9-c4a4-4829-a22e-02a2ce3a5d15 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:11:27.043009 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-89dd6da9-c4a4-4829-a22e-02a2ce3a5d15 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:11:27.043673 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-89dd6da9-c4a4-4829-a22e-02a2ce3a5d15 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:11:27.309577 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-89dd6da9-c4a4-4829-a22e-02a2ce3a5d15 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0948754217fc4ff2ba0241fa35feaf90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1aaf20f480a423ea5feca81585aeeed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:11:27.317904 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-89dd6da9-c4a4-4829-a22e-02a2ce3a5d15 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0948754217fc4ff2ba0241fa35feaf90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1aaf20f480a423ea5feca81585aeeed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:11:27.319639 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-89dd6da9-c4a4-4829-a22e-02a2ce3a5d15 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0948754217fc4ff2ba0241fa35feaf90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1aaf20f480a423ea5feca81585aeeed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:11:27.321499 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-89dd6da9-c4a4-4829-a22e-02a2ce3a5d15 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] 10.222.0.50 "GET /compute/v2.1/servers/36f8e098-a4b5-40a4-8f49-f341c5ad940c" status: 200 len: 1740 microversion: 2.20 time: 0.296528 Sep 24 05:11:27.338553 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 534/1092] 10.222.0.50 () {60 vars in 1277 bytes} [Sat Sep 24 05:11:27 2022] GET /compute/v2.1/servers/36f8e098-a4b5-40a4-8f49-f341c5ad940c => generated 1740 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 05:11:27.951870 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-7cace100-673a-4285-93e3-6eddc5591570 tempest-TestVolumeBootPattern-1339481357 tempest-TestVolumeBootPattern-1339481357-project] Calling method '>' {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:11:27.952490 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.compute.api [None req-7cace100-673a-4285-93e3-6eddc5591570 tempest-TestVolumeBootPattern-1339481357 tempest-TestVolumeBootPattern-1339481357-project] [instance: 27a6c52e-9545-4713-870a-1d553eb7d609] Fetching instance by UUID {{(pid=120594) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:11:27.958699 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-7cace100-673a-4285-93e3-6eddc5591570 tempest-TestVolumeBootPattern-1339481357 tempest-TestVolumeBootPattern-1339481357-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:11:27.959254 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-7cace100-673a-4285-93e3-6eddc5591570 tempest-TestVolumeBootPattern-1339481357 tempest-TestVolumeBootPattern-1339481357-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:11:27.959606 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-7cace100-673a-4285-93e3-6eddc5591570 tempest-TestVolumeBootPattern-1339481357 tempest-TestVolumeBootPattern-1339481357-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:11:27.960290 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-7cace100-673a-4285-93e3-6eddc5591570 tempest-TestVolumeBootPattern-1339481357 tempest-TestVolumeBootPattern-1339481357-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:11:27.960743 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-7cace100-673a-4285-93e3-6eddc5591570 tempest-TestVolumeBootPattern-1339481357 tempest-TestVolumeBootPattern-1339481357-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:11:27.961167 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-7cace100-673a-4285-93e3-6eddc5591570 tempest-TestVolumeBootPattern-1339481357 tempest-TestVolumeBootPattern-1339481357-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:11:28.093399 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.policy [None req-7cace100-673a-4285-93e3-6eddc5591570 tempest-TestVolumeBootPattern-1339481357 tempest-TestVolumeBootPattern-1339481357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60edcebcccaa4da99ffddadd3e27c1c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fef19544ec414094953daea6d545a361', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:11:28.101130 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [None req-7cace100-673a-4285-93e3-6eddc5591570 tempest-TestVolumeBootPattern-1339481357 tempest-TestVolumeBootPattern-1339481357-project] 10.222.0.50 "GET /compute/v2.1/servers/27a6c52e-9545-4713-870a-1d553eb7d609" status: 200 len: 1265 microversion: 2.1 time: 0.153567 Sep 24 05:11:28.102448 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 559/1093] 10.222.0.50 () {58 vars in 1236 bytes} [Sat Sep 24 05:11:27 2022] GET /compute/v2.1/servers/27a6c52e-9545-4713-870a-1d553eb7d609 => generated 1265 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 05:11:28.348667 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-3f3d9ec1-f888-479d-8cf6-2ecaf77c2d47 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Calling method '>' {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:11:28.349277 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.compute.api [None req-3f3d9ec1-f888-479d-8cf6-2ecaf77c2d47 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] [instance: 36f8e098-a4b5-40a4-8f49-f341c5ad940c] Fetching instance by UUID {{(pid=120593) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:11:28.356402 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-3f3d9ec1-f888-479d-8cf6-2ecaf77c2d47 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:11:28.357092 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-3f3d9ec1-f888-479d-8cf6-2ecaf77c2d47 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:11:28.357710 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-3f3d9ec1-f888-479d-8cf6-2ecaf77c2d47 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:11:28.358633 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-3f3d9ec1-f888-479d-8cf6-2ecaf77c2d47 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:11:28.359258 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-3f3d9ec1-f888-479d-8cf6-2ecaf77c2d47 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:11:28.359686 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-3f3d9ec1-f888-479d-8cf6-2ecaf77c2d47 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:11:28.538976 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-3f3d9ec1-f888-479d-8cf6-2ecaf77c2d47 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0948754217fc4ff2ba0241fa35feaf90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1aaf20f480a423ea5feca81585aeeed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:11:28.569496 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-3f3d9ec1-f888-479d-8cf6-2ecaf77c2d47 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0948754217fc4ff2ba0241fa35feaf90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1aaf20f480a423ea5feca81585aeeed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:11:28.572654 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-3f3d9ec1-f888-479d-8cf6-2ecaf77c2d47 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0948754217fc4ff2ba0241fa35feaf90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1aaf20f480a423ea5feca81585aeeed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:11:28.574706 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-3f3d9ec1-f888-479d-8cf6-2ecaf77c2d47 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] 10.222.0.50 "GET /compute/v2.1/servers/36f8e098-a4b5-40a4-8f49-f341c5ad940c" status: 200 len: 1740 microversion: 2.20 time: 0.229845 Sep 24 05:11:28.583923 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 535/1094] 10.222.0.50 () {60 vars in 1277 bytes} [Sat Sep 24 05:11:28 2022] GET /compute/v2.1/servers/36f8e098-a4b5-40a4-8f49-f341c5ad940c => generated 1740 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 05:11:28.859278 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [req-76bcb5f7-9635-47d4-8b2b-788f9e510b92 req-819bfd89-571b-4a0b-a617-06ab4dd0eb5e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "27a6c52e-9545-4713-870a-1d553eb7d609", "name": "network-vif-plugged", "status": "completed", "tag": "19cc232a-7d00-42f7-b737-1cb2a22e6c05"}]} {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 05:11:28.876079 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [req-76bcb5f7-9635-47d4-8b2b-788f9e510b92 req-819bfd89-571b-4a0b-a617-06ab4dd0eb5e service nova] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:11:28.876562 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [req-76bcb5f7-9635-47d4-8b2b-788f9e510b92 req-819bfd89-571b-4a0b-a617-06ab4dd0eb5e service nova] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:11:28.877047 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [req-76bcb5f7-9635-47d4-8b2b-788f9e510b92 req-819bfd89-571b-4a0b-a617-06ab4dd0eb5e service nova] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:11:28.894816 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: INFO nova.api.openstack.compute.server_external_events [req-76bcb5f7-9635-47d4-8b2b-788f9e510b92 req-819bfd89-571b-4a0b-a617-06ab4dd0eb5e service nova] Creating event network-vif-plugged:19cc232a-7d00-42f7-b737-1cb2a22e6c05 for instance 27a6c52e-9545-4713-870a-1d553eb7d609 on hv-cinder-85918 Sep 24 05:11:28.902214 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [req-76bcb5f7-9635-47d4-8b2b-788f9e510b92 req-819bfd89-571b-4a0b-a617-06ab4dd0eb5e service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047828 Sep 24 05:11:28.903114 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 560/1095] 10.222.0.50 () {64 vars in 1317 bytes} [Sat Sep 24 05:11:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 05:11:29.126519 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-61c3bec2-ca4e-4d13-a5a0-6e23414b0148 tempest-TestVolumeBootPattern-1339481357 tempest-TestVolumeBootPattern-1339481357-project] Calling method '>' {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:11:29.127293 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.compute.api [None req-61c3bec2-ca4e-4d13-a5a0-6e23414b0148 tempest-TestVolumeBootPattern-1339481357 tempest-TestVolumeBootPattern-1339481357-project] [instance: 27a6c52e-9545-4713-870a-1d553eb7d609] Fetching instance by UUID {{(pid=120593) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:11:29.135569 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-61c3bec2-ca4e-4d13-a5a0-6e23414b0148 tempest-TestVolumeBootPattern-1339481357 tempest-TestVolumeBootPattern-1339481357-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:11:29.136212 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-61c3bec2-ca4e-4d13-a5a0-6e23414b0148 tempest-TestVolumeBootPattern-1339481357 tempest-TestVolumeBootPattern-1339481357-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:11:29.136844 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-61c3bec2-ca4e-4d13-a5a0-6e23414b0148 tempest-TestVolumeBootPattern-1339481357 tempest-TestVolumeBootPattern-1339481357-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:11:29.138378 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-61c3bec2-ca4e-4d13-a5a0-6e23414b0148 tempest-TestVolumeBootPattern-1339481357 tempest-TestVolumeBootPattern-1339481357-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:11:29.138948 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-61c3bec2-ca4e-4d13-a5a0-6e23414b0148 tempest-TestVolumeBootPattern-1339481357 tempest-TestVolumeBootPattern-1339481357-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:11:29.139491 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-61c3bec2-ca4e-4d13-a5a0-6e23414b0148 tempest-TestVolumeBootPattern-1339481357 tempest-TestVolumeBootPattern-1339481357-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:11:29.372941 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-61c3bec2-ca4e-4d13-a5a0-6e23414b0148 tempest-TestVolumeBootPattern-1339481357 tempest-TestVolumeBootPattern-1339481357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60edcebcccaa4da99ffddadd3e27c1c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fef19544ec414094953daea6d545a361', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:11:29.383756 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-61c3bec2-ca4e-4d13-a5a0-6e23414b0148 tempest-TestVolumeBootPattern-1339481357 tempest-TestVolumeBootPattern-1339481357-project] 10.222.0.50 "GET /compute/v2.1/servers/27a6c52e-9545-4713-870a-1d553eb7d609" status: 200 len: 1265 microversion: 2.1 time: 0.262283 Sep 24 05:11:29.401868 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 536/1096] 10.222.0.50 () {58 vars in 1236 bytes} [Sat Sep 24 05:11:29 2022] GET /compute/v2.1/servers/27a6c52e-9545-4713-870a-1d553eb7d609 => generated 1265 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 05:11:29.611095 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-768cec06-f72c-4527-a15f-57c4c7ec119a tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Calling method '>' {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:11:29.612594 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.compute.api [None req-768cec06-f72c-4527-a15f-57c4c7ec119a tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] [instance: 36f8e098-a4b5-40a4-8f49-f341c5ad940c] Fetching instance by UUID {{(pid=120594) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:11:29.625643 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-768cec06-f72c-4527-a15f-57c4c7ec119a tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:11:29.626457 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-768cec06-f72c-4527-a15f-57c4c7ec119a tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:11:29.640018 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-768cec06-f72c-4527-a15f-57c4c7ec119a tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:11:29.646343 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-768cec06-f72c-4527-a15f-57c4c7ec119a tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:11:29.647105 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-768cec06-f72c-4527-a15f-57c4c7ec119a tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:11:29.648164 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-768cec06-f72c-4527-a15f-57c4c7ec119a tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:11:29.842423 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.policy [None req-768cec06-f72c-4527-a15f-57c4c7ec119a tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0948754217fc4ff2ba0241fa35feaf90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1aaf20f480a423ea5feca81585aeeed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:11:29.863095 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.policy [None req-768cec06-f72c-4527-a15f-57c4c7ec119a tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0948754217fc4ff2ba0241fa35feaf90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1aaf20f480a423ea5feca81585aeeed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:11:29.865072 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.policy [None req-768cec06-f72c-4527-a15f-57c4c7ec119a tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0948754217fc4ff2ba0241fa35feaf90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1aaf20f480a423ea5feca81585aeeed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:11:29.866615 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [None req-768cec06-f72c-4527-a15f-57c4c7ec119a tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] 10.222.0.50 "GET /compute/v2.1/servers/36f8e098-a4b5-40a4-8f49-f341c5ad940c" status: 200 len: 1740 microversion: 2.20 time: 0.259718 Sep 24 05:11:29.870350 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 561/1097] 10.222.0.50 () {60 vars in 1277 bytes} [Sat Sep 24 05:11:29 2022] GET /compute/v2.1/servers/36f8e098-a4b5-40a4-8f49-f341c5ad940c => generated 1740 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 05:11:29.903202 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-ed568c82-613d-453c-b702-40f021cfa6fd tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "4f6f2720-7a4a-49cd-a46d-c4d56ef02725"}} {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 05:11:29.907784 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.compute.api [None req-ed568c82-613d-453c-b702-40f021cfa6fd tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] [instance: 87b5a30a-8b76-44d0-a014-23e753d0835f] Fetching instance by UUID {{(pid=120593) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:11:29.919801 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-ed568c82-613d-453c-b702-40f021cfa6fd tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:11:29.920541 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-ed568c82-613d-453c-b702-40f021cfa6fd tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:11:29.921152 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-ed568c82-613d-453c-b702-40f021cfa6fd tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:11:29.922078 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-ed568c82-613d-453c-b702-40f021cfa6fd tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:11:29.923001 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-ed568c82-613d-453c-b702-40f021cfa6fd tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:11:29.923484 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-ed568c82-613d-453c-b702-40f021cfa6fd tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:11:30.024755 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG dbcounter [-] [120593] Writing DB stats nova_cell1:SELECT=100 {{(pid=120593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 05:11:30.030576 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.wsgi [None req-ed568c82-613d-453c-b702-40f021cfa6fd tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] HTTP exception thrown: Invalid volume: volume 4f6f2720-7a4a-49cd-a46d-c4d56ef02725 is already attached to instances: 87b5a30a-8b76-44d0-a014-23e753d0835f Sep 24 05:11:30.033143 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-ed568c82-613d-453c-b702-40f021cfa6fd tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Request method failure captured: Sep 24 05:11:30.033143 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: request: POST /compute/v2.1/servers/87b5a30a-8b76-44d0-a014-23e753d0835f/os-volume_attachments HTTP/1.1 Sep 24 05:11:30.033143 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: Accept: application/json Sep 24 05:11:30.033143 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: Accept-Encoding: identity Sep 24 05:11:30.033143 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: Connection: close Sep 24 05:11:30.033143 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: Content-Length: 74 Sep 24 05:11:30.033143 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: Content-Type: application/json Sep 24 05:11:30.033143 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: Host: 10.222.0.50 Sep 24 05:11:30.033143 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: Openstack-System-Scope: None Sep 24 05:11:30.033143 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: User-Agent: python-urllib3/1.26.12 Sep 24 05:11:30.033143 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: X-Auth-Token: gAAAAABjLo8KJCPvHtvWyKaOwXAaewqfKJp-c56tHrqhjOY7vtWfARY07rjbw-W3QgTA2kDEaQgMq3ex8QYwhqyDv3WoWsnpjVPsFiqcb7HeDBvc5PhwgKBF3RB3Cu-UrcKVmBtV6eiqI3YpZ_J_-BmGo2bP4YmrVUCEd9XZC45eF-x5INM7y8Q Sep 24 05:11:30.033143 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: X-Domain-Id: None Sep 24 05:11:30.033143 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: X-Domain-Name: None Sep 24 05:11:30.033143 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: X-Identity-Status: Confirmed Sep 24 05:11:30.033143 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: X-Is-Admin-Project: True Sep 24 05:11:30.033143 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: X-Project-Domain-Id: default Sep 24 05:11:30.033143 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: X-Project-Domain-Name: Default Sep 24 05:11:30.033143 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: X-Project-Id: 87d5229e39fe4817b5187068d8acecc7 Sep 24 05:11:30.033143 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: X-Project-Name: tempest-AttachVolumeNegativeTest-993993432 Sep 24 05:11:30.033143 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: X-Role: member,reader Sep 24 05:11:30.033143 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: X-Roles: member,reader Sep 24 05:11:30.035319 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/87d5229e39fe4817b5187068d8acecc7"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/87d5229e39fe4817b5187068d8acecc7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/87d5229e39fe4817b5187068d8acecc7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.50:8080", "publicURL": "http://10.222.0.50:8080/v1/AUTH_87d5229e39fe4817b5187068d8acecc7"}]}] Sep 24 05:11:30.035319 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: X-Tenant: tempest-AttachVolumeNegativeTest-993993432 Sep 24 05:11:30.035319 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: X-Tenant-Id: 87d5229e39fe4817b5187068d8acecc7 Sep 24 05:11:30.035319 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-993993432 Sep 24 05:11:30.035319 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: X-User: tempest-AttachVolumeNegativeTest-993993432-project Sep 24 05:11:30.035319 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: X-User-Domain-Id: default Sep 24 05:11:30.035319 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: X-User-Domain-Name: Default Sep 24 05:11:30.035319 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: X-User-Id: 74a8cc19ab204424ab23c62915ac2bab Sep 24 05:11:30.035319 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: X-User-Name: tempest-AttachVolumeNegativeTest-993993432-project Sep 24 05:11:30.035319 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: Sep 24 05:11:30.035319 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: {"volumeAttachment": {"volumeId": "4f6f2720-7a4a-49cd-a46d-c4d56ef02725"}} Sep 24 05:11:30.035319 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: method: > Sep 24 05:11:30.036364 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: exception: Invalid volume: volume 4f6f2720-7a4a-49cd-a46d-c4d56ef02725 is already attached to instances: 87b5a30a-8b76-44d0-a014-23e753d0835f Sep 24 05:11:30.036364 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: action_args: {'server_id': '87b5a30a-8b76-44d0-a014-23e753d0835f', 'body': {'volumeAttachment': {'volumeId': '4f6f2720-7a4a-49cd-a46d-c4d56ef02725'}}} Sep 24 05:11:30.036364 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 24 05:11:30.036364 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 05:11:30.036364 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Sep 24 05:11:30.036364 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Sep 24 05:11:30.036364 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 24 05:11:30.036364 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 24 05:11:30.036364 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Sep 24 05:11:30.036364 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Sep 24 05:11:30.036364 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5130, in attach_volume Sep 24 05:11:30.036364 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Sep 24 05:11:30.036364 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4970, in _check_volume_already_attached Sep 24 05:11:30.036364 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Sep 24 05:11:30.036364 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 4f6f2720-7a4a-49cd-a46d-c4d56ef02725 is already attached to instances: 87b5a30a-8b76-44d0-a014-23e753d0835f Sep 24 05:11:30.036364 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi Sep 24 05:11:30.036364 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 05:11:30.036364 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi Sep 24 05:11:30.036364 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 05:11:30.037843 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 05:11:30.037843 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 05:11:30.037843 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 24 05:11:30.037843 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 24 05:11:30.037843 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 24 05:11:30.037843 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 24 05:11:30.037843 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 24 05:11:30.037843 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 24 05:11:30.037843 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 24 05:11:30.037843 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 24 05:11:30.037843 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 24 05:11:30.037843 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 24 05:11:30.037843 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Sep 24 05:11:30.037843 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Sep 24 05:11:30.037843 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 4f6f2720-7a4a-49cd-a46d-c4d56ef02725 is already attached to instances: 87b5a30a-8b76-44d0-a014-23e753d0835f Sep 24 05:11:30.037843 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi Sep 24 05:11:30.037843 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 05:11:30.037843 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi Sep 24 05:11:30.037843 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 05:11:30.037843 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 05:11:30.039815 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 05:11:30.039815 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 24 05:11:30.039815 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 24 05:11:30.039815 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 4f6f2720-7a4a-49cd-a46d-c4d56ef02725 is already attached to instances: 87b5a30a-8b76-44d0-a014-23e753d0835f Sep 24 05:11:30.039815 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi Sep 24 05:11:30.039815 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-ed568c82-613d-453c-b702-40f021cfa6fd tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Returning 400 to user: Invalid volume: volume 4f6f2720-7a4a-49cd-a46d-c4d56ef02725 is already attached to instances: 87b5a30a-8b76-44d0-a014-23e753d0835f {{(pid=120593) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 24 05:11:30.039815 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-ed568c82-613d-453c-b702-40f021cfa6fd tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] 10.222.0.50 "POST /compute/v2.1/servers/87b5a30a-8b76-44d0-a014-23e753d0835f/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.137813 Sep 24 05:11:30.039815 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 537/1098] 10.222.0.50 () {60 vars in 1323 bytes} [Sat Sep 24 05:11:29 2022] POST /compute/v2.1/servers/87b5a30a-8b76-44d0-a014-23e753d0835f/os-volume_attachments => generated 174 bytes in 140 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 24 05:11:30.117116 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-3516efa5-6444-4d57-9268-0d17a2a66149 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Calling method '>' {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:11:30.117610 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.compute.api [None req-3516efa5-6444-4d57-9268-0d17a2a66149 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] [instance: 87b5a30a-8b76-44d0-a014-23e753d0835f] Fetching instance by UUID {{(pid=120594) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:11:30.123868 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-3516efa5-6444-4d57-9268-0d17a2a66149 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:11:30.124411 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-3516efa5-6444-4d57-9268-0d17a2a66149 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:11:30.125033 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-3516efa5-6444-4d57-9268-0d17a2a66149 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:11:30.125719 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-3516efa5-6444-4d57-9268-0d17a2a66149 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:11:30.126272 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-3516efa5-6444-4d57-9268-0d17a2a66149 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:11:30.126823 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-3516efa5-6444-4d57-9268-0d17a2a66149 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:11:30.224334 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.objects.instance [None req-3516efa5-6444-4d57-9268-0d17a2a66149 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Lazy-loading 'services' on Instance uuid 87b5a30a-8b76-44d0-a014-23e753d0835f {{(pid=120594) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 24 05:11:30.307021 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [None req-3516efa5-6444-4d57-9268-0d17a2a66149 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] 10.222.0.50 "DELETE /compute/v2.1/servers/87b5a30a-8b76-44d0-a014-23e753d0835f/os-volume_attachments/4f6f2720-7a4a-49cd-a46d-c4d56ef02725" status: 202 len: 0 microversion: 2.1 time: 0.193707 Sep 24 05:11:30.309332 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 562/1099] 10.222.0.50 () {58 vars in 1416 bytes} [Sat Sep 24 05:11:30 2022] DELETE /compute/v2.1/servers/87b5a30a-8b76-44d0-a014-23e753d0835f/os-volume_attachments/4f6f2720-7a4a-49cd-a46d-c4d56ef02725 => generated 0 bytes in 196 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 24 05:11:30.316747 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-d061f65b-9bb7-4a9e-b07e-0bf89ca31ff0 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Calling method '>' {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:11:30.319410 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.compute.api [None req-d061f65b-9bb7-4a9e-b07e-0bf89ca31ff0 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] [instance: 87b5a30a-8b76-44d0-a014-23e753d0835f] Fetching instance by UUID {{(pid=120593) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:11:30.327190 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-d061f65b-9bb7-4a9e-b07e-0bf89ca31ff0 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:11:30.328057 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-d061f65b-9bb7-4a9e-b07e-0bf89ca31ff0 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:11:30.328506 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-d061f65b-9bb7-4a9e-b07e-0bf89ca31ff0 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:11:30.329197 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-d061f65b-9bb7-4a9e-b07e-0bf89ca31ff0 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:11:30.329810 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-d061f65b-9bb7-4a9e-b07e-0bf89ca31ff0 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:11:30.330419 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-d061f65b-9bb7-4a9e-b07e-0bf89ca31ff0 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:11:30.364188 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-d061f65b-9bb7-4a9e-b07e-0bf89ca31ff0 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] 10.222.0.50 "GET /compute/v2.1/servers/87b5a30a-8b76-44d0-a014-23e753d0835f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051534 Sep 24 05:11:30.364790 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 538/1100] 10.222.0.50 () {58 vars in 1302 bytes} [Sat Sep 24 05:11:30 2022] GET /compute/v2.1/servers/87b5a30a-8b76-44d0-a014-23e753d0835f/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 05:11:30.409887 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-c4a873ff-0d38-4770-842e-c77811ca49bc tempest-TestVolumeBootPattern-1339481357 tempest-TestVolumeBootPattern-1339481357-project] Calling method '>' {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:11:30.410713 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.compute.api [None req-c4a873ff-0d38-4770-842e-c77811ca49bc tempest-TestVolumeBootPattern-1339481357 tempest-TestVolumeBootPattern-1339481357-project] [instance: 27a6c52e-9545-4713-870a-1d553eb7d609] Fetching instance by UUID {{(pid=120594) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:11:30.417271 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-c4a873ff-0d38-4770-842e-c77811ca49bc tempest-TestVolumeBootPattern-1339481357 tempest-TestVolumeBootPattern-1339481357-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:11:30.417698 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-c4a873ff-0d38-4770-842e-c77811ca49bc tempest-TestVolumeBootPattern-1339481357 tempest-TestVolumeBootPattern-1339481357-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:11:30.418166 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-c4a873ff-0d38-4770-842e-c77811ca49bc tempest-TestVolumeBootPattern-1339481357 tempest-TestVolumeBootPattern-1339481357-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:11:30.418886 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-c4a873ff-0d38-4770-842e-c77811ca49bc tempest-TestVolumeBootPattern-1339481357 tempest-TestVolumeBootPattern-1339481357-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:11:30.419373 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-c4a873ff-0d38-4770-842e-c77811ca49bc tempest-TestVolumeBootPattern-1339481357 tempest-TestVolumeBootPattern-1339481357-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:11:30.419810 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-c4a873ff-0d38-4770-842e-c77811ca49bc tempest-TestVolumeBootPattern-1339481357 tempest-TestVolumeBootPattern-1339481357-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:11:30.424955 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG dbcounter [-] [120594] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 05:11:30.565525 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.policy [None req-c4a873ff-0d38-4770-842e-c77811ca49bc tempest-TestVolumeBootPattern-1339481357 tempest-TestVolumeBootPattern-1339481357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60edcebcccaa4da99ffddadd3e27c1c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fef19544ec414094953daea6d545a361', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:11:30.575995 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [None req-c4a873ff-0d38-4770-842e-c77811ca49bc tempest-TestVolumeBootPattern-1339481357 tempest-TestVolumeBootPattern-1339481357-project] 10.222.0.50 "GET /compute/v2.1/servers/27a6c52e-9545-4713-870a-1d553eb7d609" status: 200 len: 1265 microversion: 2.1 time: 0.170728 Sep 24 05:11:30.592100 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 563/1101] 10.222.0.50 () {58 vars in 1236 bytes} [Sat Sep 24 05:11:30 2022] GET /compute/v2.1/servers/27a6c52e-9545-4713-870a-1d553eb7d609 => generated 1265 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 05:11:30.894977 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-f6013f00-b654-4262-9b54-5df8e77a8217 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Calling method '>' {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:11:30.895583 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.compute.api [None req-f6013f00-b654-4262-9b54-5df8e77a8217 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] [instance: 36f8e098-a4b5-40a4-8f49-f341c5ad940c] Fetching instance by UUID {{(pid=120593) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:11:30.902016 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-f6013f00-b654-4262-9b54-5df8e77a8217 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:11:30.902721 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-f6013f00-b654-4262-9b54-5df8e77a8217 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:11:30.903156 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-f6013f00-b654-4262-9b54-5df8e77a8217 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:11:30.903835 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-f6013f00-b654-4262-9b54-5df8e77a8217 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:11:30.904280 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-f6013f00-b654-4262-9b54-5df8e77a8217 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:11:30.904699 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-f6013f00-b654-4262-9b54-5df8e77a8217 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:11:31.057295 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-f6013f00-b654-4262-9b54-5df8e77a8217 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0948754217fc4ff2ba0241fa35feaf90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1aaf20f480a423ea5feca81585aeeed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:11:31.065776 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-f6013f00-b654-4262-9b54-5df8e77a8217 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0948754217fc4ff2ba0241fa35feaf90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1aaf20f480a423ea5feca81585aeeed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:11:31.067406 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-f6013f00-b654-4262-9b54-5df8e77a8217 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0948754217fc4ff2ba0241fa35feaf90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1aaf20f480a423ea5feca81585aeeed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:11:31.068572 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-f6013f00-b654-4262-9b54-5df8e77a8217 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] 10.222.0.50 "GET /compute/v2.1/servers/36f8e098-a4b5-40a4-8f49-f341c5ad940c" status: 200 len: 1740 microversion: 2.20 time: 0.178182 Sep 24 05:11:31.086019 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 539/1102] 10.222.0.50 () {60 vars in 1277 bytes} [Sat Sep 24 05:11:30 2022] GET /compute/v2.1/servers/36f8e098-a4b5-40a4-8f49-f341c5ad940c => generated 1740 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 05:11:31.379320 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-ff1228c8-2a31-4219-a2d7-f870a20a74e6 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Calling method '>' {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:11:31.381825 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.compute.api [None req-ff1228c8-2a31-4219-a2d7-f870a20a74e6 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] [instance: 87b5a30a-8b76-44d0-a014-23e753d0835f] Fetching instance by UUID {{(pid=120594) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:11:31.389322 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-ff1228c8-2a31-4219-a2d7-f870a20a74e6 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:11:31.389912 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-ff1228c8-2a31-4219-a2d7-f870a20a74e6 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:11:31.390583 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-ff1228c8-2a31-4219-a2d7-f870a20a74e6 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:11:31.391492 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-ff1228c8-2a31-4219-a2d7-f870a20a74e6 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:11:31.392139 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-ff1228c8-2a31-4219-a2d7-f870a20a74e6 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:11:31.392798 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-ff1228c8-2a31-4219-a2d7-f870a20a74e6 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:11:31.422324 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [None req-ff1228c8-2a31-4219-a2d7-f870a20a74e6 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] 10.222.0.50 "GET /compute/v2.1/servers/87b5a30a-8b76-44d0-a014-23e753d0835f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047189 Sep 24 05:11:31.423054 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 564/1103] 10.222.0.50 () {58 vars in 1302 bytes} [Sat Sep 24 05:11:31 2022] GET /compute/v2.1/servers/87b5a30a-8b76-44d0-a014-23e753d0835f/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 05:11:31.599407 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-d9b41fbe-5a75-4065-b57a-5e7486863e2e tempest-TestVolumeBootPattern-1339481357 tempest-TestVolumeBootPattern-1339481357-project] Calling method '>' {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:11:31.600020 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.compute.api [None req-d9b41fbe-5a75-4065-b57a-5e7486863e2e tempest-TestVolumeBootPattern-1339481357 tempest-TestVolumeBootPattern-1339481357-project] [instance: 27a6c52e-9545-4713-870a-1d553eb7d609] Fetching instance by UUID {{(pid=120593) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:11:31.606946 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-d9b41fbe-5a75-4065-b57a-5e7486863e2e tempest-TestVolumeBootPattern-1339481357 tempest-TestVolumeBootPattern-1339481357-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:11:31.607428 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-d9b41fbe-5a75-4065-b57a-5e7486863e2e tempest-TestVolumeBootPattern-1339481357 tempest-TestVolumeBootPattern-1339481357-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:11:31.607865 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-d9b41fbe-5a75-4065-b57a-5e7486863e2e tempest-TestVolumeBootPattern-1339481357 tempest-TestVolumeBootPattern-1339481357-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:11:31.608556 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-d9b41fbe-5a75-4065-b57a-5e7486863e2e tempest-TestVolumeBootPattern-1339481357 tempest-TestVolumeBootPattern-1339481357-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:11:31.609007 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-d9b41fbe-5a75-4065-b57a-5e7486863e2e tempest-TestVolumeBootPattern-1339481357 tempest-TestVolumeBootPattern-1339481357-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:11:31.609428 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-d9b41fbe-5a75-4065-b57a-5e7486863e2e tempest-TestVolumeBootPattern-1339481357 tempest-TestVolumeBootPattern-1339481357-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:11:31.758083 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-d9b41fbe-5a75-4065-b57a-5e7486863e2e tempest-TestVolumeBootPattern-1339481357 tempest-TestVolumeBootPattern-1339481357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60edcebcccaa4da99ffddadd3e27c1c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fef19544ec414094953daea6d545a361', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:11:31.767024 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-d9b41fbe-5a75-4065-b57a-5e7486863e2e tempest-TestVolumeBootPattern-1339481357 tempest-TestVolumeBootPattern-1339481357-project] 10.222.0.50 "GET /compute/v2.1/servers/27a6c52e-9545-4713-870a-1d553eb7d609" status: 200 len: 1451 microversion: 2.1 time: 0.171568 Sep 24 05:11:31.767578 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 540/1104] 10.222.0.50 () {58 vars in 1236 bytes} [Sat Sep 24 05:11:31 2022] GET /compute/v2.1/servers/27a6c52e-9545-4713-870a-1d553eb7d609 => generated 1451 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 05:11:31.801699 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-c721001f-57ad-453b-9b5b-c6c9c34d2760 tempest-TestVolumeBootPattern-1339481357 tempest-TestVolumeBootPattern-1339481357-project] Calling method '>' {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:11:31.802601 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.compute.api [None req-c721001f-57ad-453b-9b5b-c6c9c34d2760 tempest-TestVolumeBootPattern-1339481357 tempest-TestVolumeBootPattern-1339481357-project] [instance: 27a6c52e-9545-4713-870a-1d553eb7d609] Fetching instance by UUID {{(pid=120594) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:11:31.809135 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-c721001f-57ad-453b-9b5b-c6c9c34d2760 tempest-TestVolumeBootPattern-1339481357 tempest-TestVolumeBootPattern-1339481357-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:11:31.809618 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-c721001f-57ad-453b-9b5b-c6c9c34d2760 tempest-TestVolumeBootPattern-1339481357 tempest-TestVolumeBootPattern-1339481357-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:11:31.810079 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-c721001f-57ad-453b-9b5b-c6c9c34d2760 tempest-TestVolumeBootPattern-1339481357 tempest-TestVolumeBootPattern-1339481357-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:11:31.810769 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-c721001f-57ad-453b-9b5b-c6c9c34d2760 tempest-TestVolumeBootPattern-1339481357 tempest-TestVolumeBootPattern-1339481357-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:11:31.811219 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-c721001f-57ad-453b-9b5b-c6c9c34d2760 tempest-TestVolumeBootPattern-1339481357 tempest-TestVolumeBootPattern-1339481357-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:11:31.811641 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-c721001f-57ad-453b-9b5b-c6c9c34d2760 tempest-TestVolumeBootPattern-1339481357 tempest-TestVolumeBootPattern-1339481357-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:11:31.953369 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.policy [None req-c721001f-57ad-453b-9b5b-c6c9c34d2760 tempest-TestVolumeBootPattern-1339481357 tempest-TestVolumeBootPattern-1339481357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60edcebcccaa4da99ffddadd3e27c1c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fef19544ec414094953daea6d545a361', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:11:31.962547 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [None req-c721001f-57ad-453b-9b5b-c6c9c34d2760 tempest-TestVolumeBootPattern-1339481357 tempest-TestVolumeBootPattern-1339481357-project] 10.222.0.50 "GET /compute/v2.1/servers/27a6c52e-9545-4713-870a-1d553eb7d609" status: 200 len: 1451 microversion: 2.1 time: 0.165265 Sep 24 05:11:31.963327 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 565/1105] 10.222.0.50 () {58 vars in 1236 bytes} [Sat Sep 24 05:11:31 2022] GET /compute/v2.1/servers/27a6c52e-9545-4713-870a-1d553eb7d609 => generated 1451 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 05:11:32.095033 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-baaee01d-5781-4c16-8893-dac2e4cb702b tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Calling method '>' {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:11:32.096333 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.compute.api [None req-baaee01d-5781-4c16-8893-dac2e4cb702b tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] [instance: 36f8e098-a4b5-40a4-8f49-f341c5ad940c] Fetching instance by UUID {{(pid=120593) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:11:32.107744 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-baaee01d-5781-4c16-8893-dac2e4cb702b tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:11:32.108691 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-baaee01d-5781-4c16-8893-dac2e4cb702b tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:11:32.109742 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-baaee01d-5781-4c16-8893-dac2e4cb702b tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:11:32.111111 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-baaee01d-5781-4c16-8893-dac2e4cb702b tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:11:32.112193 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-baaee01d-5781-4c16-8893-dac2e4cb702b tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:11:32.112911 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-baaee01d-5781-4c16-8893-dac2e4cb702b tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:11:32.436025 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-0da94ed6-e476-4795-8e1e-238b2e72b987 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Calling method '>' {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:11:32.438514 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.compute.api [None req-0da94ed6-e476-4795-8e1e-238b2e72b987 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] [instance: 87b5a30a-8b76-44d0-a014-23e753d0835f] Fetching instance by UUID {{(pid=120594) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:11:32.447714 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-0da94ed6-e476-4795-8e1e-238b2e72b987 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:11:32.448862 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-0da94ed6-e476-4795-8e1e-238b2e72b987 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:11:32.449490 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-0da94ed6-e476-4795-8e1e-238b2e72b987 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:11:32.450646 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-0da94ed6-e476-4795-8e1e-238b2e72b987 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:11:32.451304 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-0da94ed6-e476-4795-8e1e-238b2e72b987 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:11:32.451927 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-0da94ed6-e476-4795-8e1e-238b2e72b987 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:11:32.491761 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [None req-0da94ed6-e476-4795-8e1e-238b2e72b987 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] 10.222.0.50 "GET /compute/v2.1/servers/87b5a30a-8b76-44d0-a014-23e753d0835f/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.060837 Sep 24 05:11:32.492464 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 566/1106] 10.222.0.50 () {58 vars in 1302 bytes} [Sat Sep 24 05:11:32 2022] GET /compute/v2.1/servers/87b5a30a-8b76-44d0-a014-23e753d0835f/os-volume_attachments => generated 25 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Sep 24 05:11:32.577689 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-8a23b223-ab6d-47c7-a02d-bcaf965ce9ce tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Calling method '>' {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:11:32.578827 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.compute.api [None req-8a23b223-ab6d-47c7-a02d-bcaf965ce9ce tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] [instance: 87b5a30a-8b76-44d0-a014-23e753d0835f] Fetching instance by UUID {{(pid=120594) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:11:32.591387 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-8a23b223-ab6d-47c7-a02d-bcaf965ce9ce tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:11:32.592197 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-8a23b223-ab6d-47c7-a02d-bcaf965ce9ce tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:11:32.592867 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-8a23b223-ab6d-47c7-a02d-bcaf965ce9ce tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:11:32.593778 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-8a23b223-ab6d-47c7-a02d-bcaf965ce9ce tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:11:32.594444 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-8a23b223-ab6d-47c7-a02d-bcaf965ce9ce tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:11:32.598668 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-8a23b223-ab6d-47c7-a02d-bcaf965ce9ce tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:11:32.622750 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-baaee01d-5781-4c16-8893-dac2e4cb702b tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0948754217fc4ff2ba0241fa35feaf90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1aaf20f480a423ea5feca81585aeeed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:11:32.631613 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-baaee01d-5781-4c16-8893-dac2e4cb702b tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0948754217fc4ff2ba0241fa35feaf90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1aaf20f480a423ea5feca81585aeeed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:11:32.633527 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-baaee01d-5781-4c16-8893-dac2e4cb702b tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0948754217fc4ff2ba0241fa35feaf90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1aaf20f480a423ea5feca81585aeeed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:11:32.637910 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-baaee01d-5781-4c16-8893-dac2e4cb702b tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] 10.222.0.50 "GET /compute/v2.1/servers/36f8e098-a4b5-40a4-8f49-f341c5ad940c" status: 200 len: 1740 microversion: 2.20 time: 0.547294 Sep 24 05:11:32.638759 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.compute.api [None req-8a23b223-ab6d-47c7-a02d-bcaf965ce9ce tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] [instance: 87b5a30a-8b76-44d0-a014-23e753d0835f] Going to try to terminate instance {{(pid=120594) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 24 05:11:32.639640 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 541/1107] 10.222.0.50 () {60 vars in 1277 bytes} [Sat Sep 24 05:11:32 2022] GET /compute/v2.1/servers/36f8e098-a4b5-40a4-8f49-f341c5ad940c => generated 1740 bytes in 550 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 24 05:11:32.756861 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [None req-8a23b223-ab6d-47c7-a02d-bcaf965ce9ce tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] 10.222.0.50 "DELETE /compute/v2.1/servers/87b5a30a-8b76-44d0-a014-23e753d0835f" status: 204 len: 0 microversion: 2.1 time: 0.182557 Sep 24 05:11:32.758395 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 567/1108] 10.222.0.50 () {58 vars in 1239 bytes} [Sat Sep 24 05:11:32 2022] DELETE /compute/v2.1/servers/87b5a30a-8b76-44d0-a014-23e753d0835f => generated 0 bytes in 185 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Sep 24 05:11:32.767948 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-3847f9b1-cf56-46a7-a19d-08be54bd629b tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Calling method '>' {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:11:32.769259 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.compute.api [None req-3847f9b1-cf56-46a7-a19d-08be54bd629b tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] [instance: 87b5a30a-8b76-44d0-a014-23e753d0835f] Fetching instance by UUID {{(pid=120593) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:11:32.776945 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-3847f9b1-cf56-46a7-a19d-08be54bd629b tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:11:32.777433 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-3847f9b1-cf56-46a7-a19d-08be54bd629b tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:11:32.777902 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-3847f9b1-cf56-46a7-a19d-08be54bd629b tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:11:32.778639 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-3847f9b1-cf56-46a7-a19d-08be54bd629b tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:11:32.779118 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-3847f9b1-cf56-46a7-a19d-08be54bd629b tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:11:32.779725 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-3847f9b1-cf56-46a7-a19d-08be54bd629b tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:11:33.000520 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-3847f9b1-cf56-46a7-a19d-08be54bd629b tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74a8cc19ab204424ab23c62915ac2bab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87d5229e39fe4817b5187068d8acecc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:11:33.012983 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-3847f9b1-cf56-46a7-a19d-08be54bd629b tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] 10.222.0.50 "GET /compute/v2.1/servers/87b5a30a-8b76-44d0-a014-23e753d0835f" status: 200 len: 1681 microversion: 2.1 time: 0.250159 Sep 24 05:11:33.018996 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 542/1109] 10.222.0.50 () {58 vars in 1236 bytes} [Sat Sep 24 05:11:32 2022] GET /compute/v2.1/servers/87b5a30a-8b76-44d0-a014-23e753d0835f => generated 1681 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 24 05:11:33.669302 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-41eca70d-e66a-4ea5-94ac-1654cc680298 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Calling method '>' {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:11:33.670618 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.compute.api [None req-41eca70d-e66a-4ea5-94ac-1654cc680298 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] [instance: 36f8e098-a4b5-40a4-8f49-f341c5ad940c] Fetching instance by UUID {{(pid=120594) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:11:33.678085 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-41eca70d-e66a-4ea5-94ac-1654cc680298 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:11:33.678565 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-41eca70d-e66a-4ea5-94ac-1654cc680298 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:11:33.678989 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-41eca70d-e66a-4ea5-94ac-1654cc680298 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:11:33.679704 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-41eca70d-e66a-4ea5-94ac-1654cc680298 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:11:33.680188 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-41eca70d-e66a-4ea5-94ac-1654cc680298 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:11:33.680779 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-41eca70d-e66a-4ea5-94ac-1654cc680298 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:11:33.921986 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.policy [None req-41eca70d-e66a-4ea5-94ac-1654cc680298 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0948754217fc4ff2ba0241fa35feaf90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1aaf20f480a423ea5feca81585aeeed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:11:33.932084 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.policy [None req-41eca70d-e66a-4ea5-94ac-1654cc680298 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0948754217fc4ff2ba0241fa35feaf90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1aaf20f480a423ea5feca81585aeeed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:11:33.933687 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.policy [None req-41eca70d-e66a-4ea5-94ac-1654cc680298 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0948754217fc4ff2ba0241fa35feaf90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1aaf20f480a423ea5feca81585aeeed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:11:33.934968 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [None req-41eca70d-e66a-4ea5-94ac-1654cc680298 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] 10.222.0.50 "GET /compute/v2.1/servers/36f8e098-a4b5-40a4-8f49-f341c5ad940c" status: 200 len: 1740 microversion: 2.20 time: 0.271569 Sep 24 05:11:33.935612 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 568/1110] 10.222.0.50 () {60 vars in 1277 bytes} [Sat Sep 24 05:11:33 2022] GET /compute/v2.1/servers/36f8e098-a4b5-40a4-8f49-f341c5ad940c => generated 1740 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 05:11:34.044899 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-5d1e1c89-9138-482f-afa3-6edc5bf411e5 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Calling method '>' {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:11:34.045590 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.compute.api [None req-5d1e1c89-9138-482f-afa3-6edc5bf411e5 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] [instance: 87b5a30a-8b76-44d0-a014-23e753d0835f] Fetching instance by UUID {{(pid=120593) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:11:34.054627 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-5d1e1c89-9138-482f-afa3-6edc5bf411e5 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:11:34.055549 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-5d1e1c89-9138-482f-afa3-6edc5bf411e5 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:11:34.056494 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-5d1e1c89-9138-482f-afa3-6edc5bf411e5 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:11:34.057432 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-5d1e1c89-9138-482f-afa3-6edc5bf411e5 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:11:34.058088 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-5d1e1c89-9138-482f-afa3-6edc5bf411e5 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:11:34.058674 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-5d1e1c89-9138-482f-afa3-6edc5bf411e5 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:11:34.323781 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-5d1e1c89-9138-482f-afa3-6edc5bf411e5 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74a8cc19ab204424ab23c62915ac2bab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87d5229e39fe4817b5187068d8acecc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:11:34.337528 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-5d1e1c89-9138-482f-afa3-6edc5bf411e5 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] 10.222.0.50 "GET /compute/v2.1/servers/87b5a30a-8b76-44d0-a014-23e753d0835f" status: 200 len: 1681 microversion: 2.1 time: 0.296533 Sep 24 05:11:34.345843 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 543/1111] 10.222.0.50 () {58 vars in 1236 bytes} [Sat Sep 24 05:11:34 2022] GET /compute/v2.1/servers/87b5a30a-8b76-44d0-a014-23e753d0835f => generated 1681 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 05:11:34.461932 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [req-3294210b-3051-4a25-85b4-8a0c322722df req-e79793d1-e207-4544-9d74-7761f525dfb7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "27a6c52e-9545-4713-870a-1d553eb7d609", "tag": "19cc232a-7d00-42f7-b737-1cb2a22e6c05"}]} {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 05:11:34.480548 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [req-3294210b-3051-4a25-85b4-8a0c322722df req-e79793d1-e207-4544-9d74-7761f525dfb7 service nova] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:11:34.481161 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [req-3294210b-3051-4a25-85b4-8a0c322722df req-e79793d1-e207-4544-9d74-7761f525dfb7 service nova] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:11:34.481622 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [req-3294210b-3051-4a25-85b4-8a0c322722df req-e79793d1-e207-4544-9d74-7761f525dfb7 service nova] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:11:34.494980 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: INFO nova.api.openstack.compute.server_external_events [req-3294210b-3051-4a25-85b4-8a0c322722df req-e79793d1-e207-4544-9d74-7761f525dfb7 service nova] Creating event network-changed:19cc232a-7d00-42f7-b737-1cb2a22e6c05 for instance 27a6c52e-9545-4713-870a-1d553eb7d609 on hv-cinder-85918 Sep 24 05:11:34.501960 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [req-3294210b-3051-4a25-85b4-8a0c322722df req-e79793d1-e207-4544-9d74-7761f525dfb7 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043973 Sep 24 05:11:34.504417 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 569/1112] 10.222.0.50 () {64 vars in 1317 bytes} [Sat Sep 24 05:11:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 05:11:34.962819 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-07da1b30-0f31-4503-b2ce-43b43daa5e11 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Calling method '>' {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:11:34.963845 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.compute.api [None req-07da1b30-0f31-4503-b2ce-43b43daa5e11 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] [instance: 36f8e098-a4b5-40a4-8f49-f341c5ad940c] Fetching instance by UUID {{(pid=120593) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:11:34.975411 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-07da1b30-0f31-4503-b2ce-43b43daa5e11 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:11:34.976413 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-07da1b30-0f31-4503-b2ce-43b43daa5e11 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:11:34.977136 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-07da1b30-0f31-4503-b2ce-43b43daa5e11 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:11:34.978154 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-07da1b30-0f31-4503-b2ce-43b43daa5e11 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:11:34.984701 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-07da1b30-0f31-4503-b2ce-43b43daa5e11 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:11:34.985437 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-07da1b30-0f31-4503-b2ce-43b43daa5e11 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:11:35.364430 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-9da2d3f2-7fac-4c3a-a917-2d3ed88a722b tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Calling method '>' {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:11:35.366441 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.compute.api [None req-9da2d3f2-7fac-4c3a-a917-2d3ed88a722b tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] [instance: 87b5a30a-8b76-44d0-a014-23e753d0835f] Fetching instance by UUID {{(pid=120594) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:11:35.374707 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-9da2d3f2-7fac-4c3a-a917-2d3ed88a722b tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:11:35.376288 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-9da2d3f2-7fac-4c3a-a917-2d3ed88a722b tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:11:35.376915 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-9da2d3f2-7fac-4c3a-a917-2d3ed88a722b tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:11:35.377807 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-9da2d3f2-7fac-4c3a-a917-2d3ed88a722b tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:11:35.378971 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-9da2d3f2-7fac-4c3a-a917-2d3ed88a722b tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:11:35.379576 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-9da2d3f2-7fac-4c3a-a917-2d3ed88a722b tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:11:35.423656 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-07da1b30-0f31-4503-b2ce-43b43daa5e11 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0948754217fc4ff2ba0241fa35feaf90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1aaf20f480a423ea5feca81585aeeed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:11:35.439692 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-07da1b30-0f31-4503-b2ce-43b43daa5e11 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0948754217fc4ff2ba0241fa35feaf90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1aaf20f480a423ea5feca81585aeeed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:11:35.441228 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-07da1b30-0f31-4503-b2ce-43b43daa5e11 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0948754217fc4ff2ba0241fa35feaf90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1aaf20f480a423ea5feca81585aeeed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:11:35.442496 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-07da1b30-0f31-4503-b2ce-43b43daa5e11 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] 10.222.0.50 "GET /compute/v2.1/servers/36f8e098-a4b5-40a4-8f49-f341c5ad940c" status: 200 len: 1740 microversion: 2.20 time: 0.484887 Sep 24 05:11:35.458254 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 544/1113] 10.222.0.50 () {60 vars in 1277 bytes} [Sat Sep 24 05:11:34 2022] GET /compute/v2.1/servers/36f8e098-a4b5-40a4-8f49-f341c5ad940c => generated 1740 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 05:11:35.762452 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.policy [None req-9da2d3f2-7fac-4c3a-a917-2d3ed88a722b tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74a8cc19ab204424ab23c62915ac2bab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87d5229e39fe4817b5187068d8acecc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:11:35.775551 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [None req-9da2d3f2-7fac-4c3a-a917-2d3ed88a722b tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] 10.222.0.50 "GET /compute/v2.1/servers/87b5a30a-8b76-44d0-a014-23e753d0835f" status: 200 len: 1681 microversion: 2.1 time: 0.411397 Sep 24 05:11:35.776170 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 570/1114] 10.222.0.50 () {58 vars in 1236 bytes} [Sat Sep 24 05:11:35 2022] GET /compute/v2.1/servers/87b5a30a-8b76-44d0-a014-23e753d0835f => generated 1681 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 24 05:11:36.470497 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-40d20d85-fa6d-41f9-b9cc-c51f66e0b0e1 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Calling method '>' {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:11:36.471121 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.compute.api [None req-40d20d85-fa6d-41f9-b9cc-c51f66e0b0e1 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] [instance: 36f8e098-a4b5-40a4-8f49-f341c5ad940c] Fetching instance by UUID {{(pid=120593) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:11:36.484006 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-40d20d85-fa6d-41f9-b9cc-c51f66e0b0e1 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:11:36.484506 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-40d20d85-fa6d-41f9-b9cc-c51f66e0b0e1 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:11:36.485157 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-40d20d85-fa6d-41f9-b9cc-c51f66e0b0e1 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:11:36.485880 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-40d20d85-fa6d-41f9-b9cc-c51f66e0b0e1 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:11:36.486377 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-40d20d85-fa6d-41f9-b9cc-c51f66e0b0e1 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:11:36.486988 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-40d20d85-fa6d-41f9-b9cc-c51f66e0b0e1 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:11:36.742488 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-40d20d85-fa6d-41f9-b9cc-c51f66e0b0e1 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0948754217fc4ff2ba0241fa35feaf90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1aaf20f480a423ea5feca81585aeeed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:11:36.763243 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-40d20d85-fa6d-41f9-b9cc-c51f66e0b0e1 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0948754217fc4ff2ba0241fa35feaf90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1aaf20f480a423ea5feca81585aeeed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:11:36.770764 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-40d20d85-fa6d-41f9-b9cc-c51f66e0b0e1 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0948754217fc4ff2ba0241fa35feaf90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1aaf20f480a423ea5feca81585aeeed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:11:36.772389 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-40d20d85-fa6d-41f9-b9cc-c51f66e0b0e1 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] 10.222.0.50 "GET /compute/v2.1/servers/36f8e098-a4b5-40a4-8f49-f341c5ad940c" status: 200 len: 1740 microversion: 2.20 time: 0.305693 Sep 24 05:11:36.774606 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 545/1115] 10.222.0.50 () {60 vars in 1277 bytes} [Sat Sep 24 05:11:36 2022] GET /compute/v2.1/servers/36f8e098-a4b5-40a4-8f49-f341c5ad940c => generated 1740 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 05:11:36.780943 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [req-1053614f-f07e-47d8-872c-654c6a36b7fd req-93c68e07-707d-4a1e-9679-2220e34573b6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "87b5a30a-8b76-44d0-a014-23e753d0835f", "name": "network-vif-deleted", "tag": "69742a41-eeea-432a-8f65-c86e8714c51a"}]} {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 05:11:36.806490 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-2430b221-36f3-4ba1-aa9a-4b5e47d0e362 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Calling method '>' {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:11:36.807662 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.compute.api [None req-2430b221-36f3-4ba1-aa9a-4b5e47d0e362 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] [instance: 87b5a30a-8b76-44d0-a014-23e753d0835f] Fetching instance by UUID {{(pid=120593) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:11:36.810650 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [req-1053614f-f07e-47d8-872c-654c6a36b7fd req-93c68e07-707d-4a1e-9679-2220e34573b6 service nova] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:11:36.813951 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-2430b221-36f3-4ba1-aa9a-4b5e47d0e362 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:11:36.817507 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [req-1053614f-f07e-47d8-872c-654c6a36b7fd req-93c68e07-707d-4a1e-9679-2220e34573b6 service nova] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:11:36.818172 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [req-1053614f-f07e-47d8-872c-654c6a36b7fd req-93c68e07-707d-4a1e-9679-2220e34573b6 service nova] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:11:36.823323 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-2430b221-36f3-4ba1-aa9a-4b5e47d0e362 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:11:36.826390 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-2430b221-36f3-4ba1-aa9a-4b5e47d0e362 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:11:36.827301 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-2430b221-36f3-4ba1-aa9a-4b5e47d0e362 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:11:36.827786 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-2430b221-36f3-4ba1-aa9a-4b5e47d0e362 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:11:36.830453 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-2430b221-36f3-4ba1-aa9a-4b5e47d0e362 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:11:36.835154 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: INFO nova.api.openstack.compute.server_external_events [req-1053614f-f07e-47d8-872c-654c6a36b7fd req-93c68e07-707d-4a1e-9679-2220e34573b6 service nova] Creating event network-vif-deleted:69742a41-eeea-432a-8f65-c86e8714c51a for instance 87b5a30a-8b76-44d0-a014-23e753d0835f on hv-cinder-85918 Sep 24 05:11:36.841119 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [req-1053614f-f07e-47d8-872c-654c6a36b7fd req-93c68e07-707d-4a1e-9679-2220e34573b6 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.066763 Sep 24 05:11:36.842489 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 571/1116] 10.222.0.50 () {64 vars in 1317 bytes} [Sat Sep 24 05:11:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 05:11:36.975165 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-2430b221-36f3-4ba1-aa9a-4b5e47d0e362 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74a8cc19ab204424ab23c62915ac2bab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87d5229e39fe4817b5187068d8acecc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:11:36.984831 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-2430b221-36f3-4ba1-aa9a-4b5e47d0e362 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] 10.222.0.50 "GET /compute/v2.1/servers/87b5a30a-8b76-44d0-a014-23e753d0835f" status: 200 len: 1326 microversion: 2.1 time: 0.182124 Sep 24 05:11:36.985396 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 546/1117] 10.222.0.50 () {58 vars in 1236 bytes} [Sat Sep 24 05:11:36 2022] GET /compute/v2.1/servers/87b5a30a-8b76-44d0-a014-23e753d0835f => generated 1326 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 05:11:37.800037 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-d0e038da-1d8c-4b5d-98a3-f76291d28c8a tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Calling method '>' {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:11:37.800904 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.compute.api [None req-d0e038da-1d8c-4b5d-98a3-f76291d28c8a tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] [instance: 36f8e098-a4b5-40a4-8f49-f341c5ad940c] Fetching instance by UUID {{(pid=120594) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:11:37.806877 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-d0e038da-1d8c-4b5d-98a3-f76291d28c8a tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:11:37.807365 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-d0e038da-1d8c-4b5d-98a3-f76291d28c8a tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:11:37.807795 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-d0e038da-1d8c-4b5d-98a3-f76291d28c8a tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:11:37.808488 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-d0e038da-1d8c-4b5d-98a3-f76291d28c8a tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:11:37.808939 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-d0e038da-1d8c-4b5d-98a3-f76291d28c8a tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:11:37.809359 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-d0e038da-1d8c-4b5d-98a3-f76291d28c8a tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:11:37.978181 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.policy [None req-d0e038da-1d8c-4b5d-98a3-f76291d28c8a tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0948754217fc4ff2ba0241fa35feaf90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1aaf20f480a423ea5feca81585aeeed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:11:37.990018 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.policy [None req-d0e038da-1d8c-4b5d-98a3-f76291d28c8a tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0948754217fc4ff2ba0241fa35feaf90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1aaf20f480a423ea5feca81585aeeed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:11:37.992257 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.policy [None req-d0e038da-1d8c-4b5d-98a3-f76291d28c8a tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0948754217fc4ff2ba0241fa35feaf90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1aaf20f480a423ea5feca81585aeeed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:11:37.993792 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [None req-d0e038da-1d8c-4b5d-98a3-f76291d28c8a tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] 10.222.0.50 "GET /compute/v2.1/servers/36f8e098-a4b5-40a4-8f49-f341c5ad940c" status: 200 len: 1740 microversion: 2.20 time: 0.198500 Sep 24 05:11:38.018098 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 572/1118] 10.222.0.50 () {60 vars in 1277 bytes} [Sat Sep 24 05:11:37 2022] GET /compute/v2.1/servers/36f8e098-a4b5-40a4-8f49-f341c5ad940c => generated 1740 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 05:11:38.023610 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-b0c7bf4d-43f1-4391-bff8-b0dcdc4458ea tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Calling method '>' {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:11:38.026282 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.compute.api [None req-b0c7bf4d-43f1-4391-bff8-b0dcdc4458ea tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] [instance: 87b5a30a-8b76-44d0-a014-23e753d0835f] Fetching instance by UUID {{(pid=120593) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:11:38.056471 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-b0c7bf4d-43f1-4391-bff8-b0dcdc4458ea tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:11:38.058166 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-b0c7bf4d-43f1-4391-bff8-b0dcdc4458ea tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:11:38.059153 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-b0c7bf4d-43f1-4391-bff8-b0dcdc4458ea tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:11:38.060169 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-b0c7bf4d-43f1-4391-bff8-b0dcdc4458ea tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:11:38.060977 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-b0c7bf4d-43f1-4391-bff8-b0dcdc4458ea tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:11:38.061572 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-b0c7bf4d-43f1-4391-bff8-b0dcdc4458ea tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:11:38.080579 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.wsgi [None req-b0c7bf4d-43f1-4391-bff8-b0dcdc4458ea tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] HTTP exception thrown: Instance 87b5a30a-8b76-44d0-a014-23e753d0835f could not be found. Sep 24 05:11:38.083196 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-b0c7bf4d-43f1-4391-bff8-b0dcdc4458ea tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Request method failure captured: Sep 24 05:11:38.083196 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: request: GET /compute/v2.1/servers/87b5a30a-8b76-44d0-a014-23e753d0835f HTTP/1.1 Sep 24 05:11:38.083196 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: Accept: application/json Sep 24 05:11:38.083196 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: Accept-Encoding: identity Sep 24 05:11:38.083196 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: Connection: close Sep 24 05:11:38.083196 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: Content-Length: 0 Sep 24 05:11:38.083196 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: Content-Type: application/json Sep 24 05:11:38.083196 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: Host: 10.222.0.50 Sep 24 05:11:38.083196 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: Openstack-System-Scope: None Sep 24 05:11:38.083196 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: User-Agent: python-urllib3/1.26.12 Sep 24 05:11:38.083196 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: X-Auth-Token: gAAAAABjLo8KJCPvHtvWyKaOwXAaewqfKJp-c56tHrqhjOY7vtWfARY07rjbw-W3QgTA2kDEaQgMq3ex8QYwhqyDv3WoWsnpjVPsFiqcb7HeDBvc5PhwgKBF3RB3Cu-UrcKVmBtV6eiqI3YpZ_J_-BmGo2bP4YmrVUCEd9XZC45eF-x5INM7y8Q Sep 24 05:11:38.083196 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: X-Domain-Id: None Sep 24 05:11:38.083196 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: X-Domain-Name: None Sep 24 05:11:38.083196 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: X-Identity-Status: Confirmed Sep 24 05:11:38.083196 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: X-Is-Admin-Project: True Sep 24 05:11:38.083196 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: X-Project-Domain-Id: default Sep 24 05:11:38.083196 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: X-Project-Domain-Name: Default Sep 24 05:11:38.083196 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: X-Project-Id: 87d5229e39fe4817b5187068d8acecc7 Sep 24 05:11:38.083196 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: X-Project-Name: tempest-AttachVolumeNegativeTest-993993432 Sep 24 05:11:38.083196 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: X-Role: member,reader Sep 24 05:11:38.083196 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: X-Roles: member,reader Sep 24 05:11:38.084702 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/87d5229e39fe4817b5187068d8acecc7"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/87d5229e39fe4817b5187068d8acecc7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/87d5229e39fe4817b5187068d8acecc7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.50:8080", "publicURL": "http://10.222.0.50:8080/v1/AUTH_87d5229e39fe4817b5187068d8acecc7"}]}] Sep 24 05:11:38.084702 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: X-Tenant: tempest-AttachVolumeNegativeTest-993993432 Sep 24 05:11:38.084702 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: X-Tenant-Id: 87d5229e39fe4817b5187068d8acecc7 Sep 24 05:11:38.084702 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-993993432 Sep 24 05:11:38.084702 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: X-User: tempest-AttachVolumeNegativeTest-993993432-project Sep 24 05:11:38.084702 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: X-User-Domain-Id: default Sep 24 05:11:38.084702 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: X-User-Domain-Name: Default Sep 24 05:11:38.084702 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: X-User-Id: 74a8cc19ab204424ab23c62915ac2bab Sep 24 05:11:38.084702 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: X-User-Name: tempest-AttachVolumeNegativeTest-993993432-project Sep 24 05:11:38.084702 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: method: > Sep 24 05:11:38.084702 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: exception: Instance 87b5a30a-8b76-44d0-a014-23e753d0835f could not be found. Sep 24 05:11:38.084702 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: action_args: {'id': '87b5a30a-8b76-44d0-a014-23e753d0835f'} Sep 24 05:11:38.085596 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 24 05:11:38.085596 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 05:11:38.085596 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 24 05:11:38.085596 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 24 05:11:38.085596 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 24 05:11:38.085596 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 24 05:11:38.085596 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 24 05:11:38.085596 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 24 05:11:38.085596 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 24 05:11:38.085596 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 24 05:11:38.085596 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 87b5a30a-8b76-44d0-a014-23e753d0835f could not be found. Sep 24 05:11:38.085596 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi Sep 24 05:11:38.085596 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 05:11:38.085596 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi Sep 24 05:11:38.085596 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 05:11:38.085596 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 05:11:38.085596 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 05:11:38.085596 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 24 05:11:38.085596 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 24 05:11:38.085596 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 24 05:11:38.087774 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 24 05:11:38.087774 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 24 05:11:38.087774 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 24 05:11:38.087774 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 24 05:11:38.087774 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 24 05:11:38.087774 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 24 05:11:38.087774 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 24 05:11:38.087774 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 87b5a30a-8b76-44d0-a014-23e753d0835f could not be found. Sep 24 05:11:38.087774 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi Sep 24 05:11:38.087774 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 05:11:38.087774 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi Sep 24 05:11:38.087774 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 05:11:38.087774 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 05:11:38.087774 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 05:11:38.087774 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 24 05:11:38.087774 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 24 05:11:38.087774 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 87b5a30a-8b76-44d0-a014-23e753d0835f could not be found. Sep 24 05:11:38.087774 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi Sep 24 05:11:38.089481 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-b0c7bf4d-43f1-4391-bff8-b0dcdc4458ea tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Returning 404 to user: Instance 87b5a30a-8b76-44d0-a014-23e753d0835f could not be found. {{(pid=120593) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 24 05:11:38.089481 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-b0c7bf4d-43f1-4391-bff8-b0dcdc4458ea tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] 10.222.0.50 "GET /compute/v2.1/servers/87b5a30a-8b76-44d0-a014-23e753d0835f" status: 404 len: 111 microversion: 2.1 time: 0.075731 Sep 24 05:11:38.089481 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 547/1119] 10.222.0.50 () {58 vars in 1236 bytes} [Sat Sep 24 05:11:38 2022] GET /compute/v2.1/servers/87b5a30a-8b76-44d0-a014-23e753d0835f => generated 111 bytes in 77 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 24 05:11:38.097791 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-649470ee-860d-4756-bd32-35e088d36a01 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Calling method '.version_select at 0x7f7950554940>' {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:11:38.122920 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [None req-649470ee-860d-4756-bd32-35e088d36a01 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] 10.222.0.50 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-576671557" status: 202 len: 0 microversion: 2.1 time: 0.030795 Sep 24 05:11:38.127004 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 573/1120] 10.222.0.50 () {58 vars in 1218 bytes} [Sat Sep 24 05:11:38 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-576671557 => generated 0 bytes in 34 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 24 05:11:38.797846 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-1c556445-cfd0-4efc-9cda-ac6be6b9c516 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Action: 'create', calling method: .version_select at 0x7f795084a4c0>, body: {"keypair": {"name": "tempest-keypair-884230319", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBO3z+hnaZzGuSyeBdWsUJ2mYNSINy613I1daw4h6Gud3FFsdKa4kFF/xCW1NwWg1DEr0kii3Y0mZc4thUOn+zODxOoE/xkeauckjra7RiwHbO44jw53gTWrpnfIInACGJw=="}} {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 05:11:38.813580 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.quota [None req-1c556445-cfd0-4efc-9cda-ac6be6b9c516 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Getting quotas for project 87d5229e39fe4817b5187068d8acecc7. Resources: {'key_pairs'} {{(pid=120593) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 24 05:11:38.817362 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.quota [None req-1c556445-cfd0-4efc-9cda-ac6be6b9c516 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Getting quotas for user 74a8cc19ab204424ab23c62915ac2bab and project 87d5229e39fe4817b5187068d8acecc7. Resources: {'key_pairs'} {{(pid=120593) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 24 05:11:38.838592 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-1c556445-cfd0-4efc-9cda-ac6be6b9c516 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] 10.222.0.50 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.044732 Sep 24 05:11:38.839157 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 548/1121] 10.222.0.50 () {60 vars in 1159 bytes} [Sat Sep 24 05:11:38 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 05:11:39.022789 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-225b987e-f3ba-4461-be48-bcd79406af80 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Calling method '>' {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:11:39.023395 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.compute.api [None req-225b987e-f3ba-4461-be48-bcd79406af80 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] [instance: 36f8e098-a4b5-40a4-8f49-f341c5ad940c] Fetching instance by UUID {{(pid=120594) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:11:39.029227 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-225b987e-f3ba-4461-be48-bcd79406af80 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:11:39.029648 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-225b987e-f3ba-4461-be48-bcd79406af80 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:11:39.030186 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-225b987e-f3ba-4461-be48-bcd79406af80 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:11:39.030800 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-225b987e-f3ba-4461-be48-bcd79406af80 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:11:39.031248 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-225b987e-f3ba-4461-be48-bcd79406af80 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:11:39.031670 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-225b987e-f3ba-4461-be48-bcd79406af80 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:11:39.188329 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.policy [None req-225b987e-f3ba-4461-be48-bcd79406af80 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0948754217fc4ff2ba0241fa35feaf90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1aaf20f480a423ea5feca81585aeeed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:11:39.196517 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.policy [None req-225b987e-f3ba-4461-be48-bcd79406af80 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0948754217fc4ff2ba0241fa35feaf90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1aaf20f480a423ea5feca81585aeeed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:11:39.197935 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.policy [None req-225b987e-f3ba-4461-be48-bcd79406af80 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0948754217fc4ff2ba0241fa35feaf90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1aaf20f480a423ea5feca81585aeeed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:11:39.199107 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [None req-225b987e-f3ba-4461-be48-bcd79406af80 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] 10.222.0.50 "GET /compute/v2.1/servers/36f8e098-a4b5-40a4-8f49-f341c5ad940c" status: 200 len: 1740 microversion: 2.20 time: 0.180772 Sep 24 05:11:39.199859 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 574/1122] 10.222.0.50 () {60 vars in 1277 bytes} [Sat Sep 24 05:11:39 2022] GET /compute/v2.1/servers/36f8e098-a4b5-40a4-8f49-f341c5ad940c => generated 1740 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 05:11:40.143927 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-6e7e30c0-b81b-41e6-9bab-0952ef74f00a tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1817131594", "imageRef": "75ab730a-d8cc-4ea2-b58f-0f3eb476c976", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "17f0f6dc-1b39-4c78-b39c-2031585b359a"}], "security_groups": [{"name": "tempest-securitygroup--386483147"}], "key_name": "tempest-keypair-884230319", "user_data": "}} {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 05:11:40.229228 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-21ba1c02-6151-488e-9411-0cf796b43aa8 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Calling method '>' {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:11:40.229832 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.compute.api [None req-21ba1c02-6151-488e-9411-0cf796b43aa8 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] [instance: 36f8e098-a4b5-40a4-8f49-f341c5ad940c] Fetching instance by UUID {{(pid=120594) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:11:40.235967 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-21ba1c02-6151-488e-9411-0cf796b43aa8 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:11:40.236440 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-21ba1c02-6151-488e-9411-0cf796b43aa8 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:11:40.236903 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-21ba1c02-6151-488e-9411-0cf796b43aa8 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:11:40.237585 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-21ba1c02-6151-488e-9411-0cf796b43aa8 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:11:40.238046 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-21ba1c02-6151-488e-9411-0cf796b43aa8 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:11:40.238464 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-21ba1c02-6151-488e-9411-0cf796b43aa8 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:11:40.244881 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.network.neutron [None req-6e7e30c0-b81b-41e6-9bab-0952ef74f00a tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] validate_networks() for [('17f0f6dc-1b39-4c78-b39c-2031585b359a', None, None, None, None, None)] {{(pid=120593) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 24 05:11:40.440753 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.policy [None req-21ba1c02-6151-488e-9411-0cf796b43aa8 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0948754217fc4ff2ba0241fa35feaf90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1aaf20f480a423ea5feca81585aeeed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:11:40.448960 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.policy [None req-21ba1c02-6151-488e-9411-0cf796b43aa8 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0948754217fc4ff2ba0241fa35feaf90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1aaf20f480a423ea5feca81585aeeed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:11:40.450596 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.policy [None req-21ba1c02-6151-488e-9411-0cf796b43aa8 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0948754217fc4ff2ba0241fa35feaf90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1aaf20f480a423ea5feca81585aeeed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:11:40.451734 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [None req-21ba1c02-6151-488e-9411-0cf796b43aa8 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] 10.222.0.50 "GET /compute/v2.1/servers/36f8e098-a4b5-40a4-8f49-f341c5ad940c" status: 200 len: 1722 microversion: 2.20 time: 0.227155 Sep 24 05:11:40.452296 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 575/1123] 10.222.0.50 () {60 vars in 1277 bytes} [Sat Sep 24 05:11:40 2022] GET /compute/v2.1/servers/36f8e098-a4b5-40a4-8f49-f341c5ad940c => generated 1722 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 24 05:11:40.738403 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.virt.hardware [None req-6e7e30c0-b81b-41e6-9bab-0952ef74f00a tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Flavor limits 0:0:0 {{(pid=120593) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 24 05:11:40.739069 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.virt.hardware [None req-6e7e30c0-b81b-41e6-9bab-0952ef74f00a tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Image limits 0:0:0 {{(pid=120593) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 24 05:11:40.739805 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.virt.hardware [None req-6e7e30c0-b81b-41e6-9bab-0952ef74f00a tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Flavor pref 0:0:0 {{(pid=120593) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 24 05:11:40.740383 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.virt.hardware [None req-6e7e30c0-b81b-41e6-9bab-0952ef74f00a tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Image pref 0:0:0 {{(pid=120593) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 24 05:11:40.741093 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.virt.hardware [None req-6e7e30c0-b81b-41e6-9bab-0952ef74f00a tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120593) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 24 05:11:40.752078 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-6e7e30c0-b81b-41e6-9bab-0952ef74f00a tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:11:40.752561 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-6e7e30c0-b81b-41e6-9bab-0952ef74f00a tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:11:40.752993 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-6e7e30c0-b81b-41e6-9bab-0952ef74f00a tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:11:40.753720 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-6e7e30c0-b81b-41e6-9bab-0952ef74f00a tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:11:40.754199 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-6e7e30c0-b81b-41e6-9bab-0952ef74f00a tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:11:40.754623 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-6e7e30c0-b81b-41e6-9bab-0952ef74f00a tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:11:40.771772 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.quota [None req-6e7e30c0-b81b-41e6-9bab-0952ef74f00a tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Getting quotas for project 87d5229e39fe4817b5187068d8acecc7. Resources: {'instances', 'ram', 'cores'} {{(pid=120593) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 24 05:11:40.776401 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.quota [None req-6e7e30c0-b81b-41e6-9bab-0952ef74f00a tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Getting quotas for user 74a8cc19ab204424ab23c62915ac2bab and project 87d5229e39fe4817b5187068d8acecc7. Resources: {'instances', 'ram', 'cores'} {{(pid=120593) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 24 05:11:40.788773 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.compute.api [None req-6e7e30c0-b81b-41e6-9bab-0952ef74f00a tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Going to run 1 instances... {{(pid=120593) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 24 05:11:40.791906 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.compute.api [None req-6e7e30c0-b81b-41e6-9bab-0952ef74f00a tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] [instance: 459e75d4-67d0-437c-aad4-09523804e931] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='75ab730a-d8cc-4ea2-b58f-0f3eb476c976',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120593) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 24 05:11:40.837505 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-6e7e30c0-b81b-41e6-9bab-0952ef74f00a tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.698387 Sep 24 05:11:40.838182 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 549/1124] 10.222.0.50 () {60 vars in 1147 bytes} [Sat Sep 24 05:11:40 2022] POST /compute/v2.1/servers => generated 401 bytes in 700 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 24 05:11:40.849541 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-20a60d7a-bc47-4653-bb1e-46dcdd3b48c4 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Calling method '>' {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:11:40.850263 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.compute.api [None req-20a60d7a-bc47-4653-bb1e-46dcdd3b48c4 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] [instance: 459e75d4-67d0-437c-aad4-09523804e931] Fetching instance by UUID {{(pid=120594) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:11:40.915321 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.policy [None req-20a60d7a-bc47-4653-bb1e-46dcdd3b48c4 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74a8cc19ab204424ab23c62915ac2bab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87d5229e39fe4817b5187068d8acecc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:11:40.922061 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [None req-20a60d7a-bc47-4653-bb1e-46dcdd3b48c4 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] 10.222.0.50 "GET /compute/v2.1/servers/459e75d4-67d0-437c-aad4-09523804e931" status: 200 len: 1241 microversion: 2.1 time: 0.076653 Sep 24 05:11:40.922646 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 576/1125] 10.222.0.50 () {58 vars in 1236 bytes} [Sat Sep 24 05:11:40 2022] GET /compute/v2.1/servers/459e75d4-67d0-437c-aad4-09523804e931 => generated 1241 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 05:11:41.479921 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-0d9138d8-d7a1-4e2b-a391-fcede07ba9a8 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Calling method '>' {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:11:41.480613 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.compute.api [None req-0d9138d8-d7a1-4e2b-a391-fcede07ba9a8 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] [instance: 36f8e098-a4b5-40a4-8f49-f341c5ad940c] Fetching instance by UUID {{(pid=120593) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:11:41.486956 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-0d9138d8-d7a1-4e2b-a391-fcede07ba9a8 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:11:41.487438 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-0d9138d8-d7a1-4e2b-a391-fcede07ba9a8 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:11:41.487873 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-0d9138d8-d7a1-4e2b-a391-fcede07ba9a8 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:11:41.488631 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-0d9138d8-d7a1-4e2b-a391-fcede07ba9a8 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:11:41.489253 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-0d9138d8-d7a1-4e2b-a391-fcede07ba9a8 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:11:41.489818 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-0d9138d8-d7a1-4e2b-a391-fcede07ba9a8 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:11:41.626882 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-0d9138d8-d7a1-4e2b-a391-fcede07ba9a8 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0948754217fc4ff2ba0241fa35feaf90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1aaf20f480a423ea5feca81585aeeed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:11:41.636332 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-0d9138d8-d7a1-4e2b-a391-fcede07ba9a8 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0948754217fc4ff2ba0241fa35feaf90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1aaf20f480a423ea5feca81585aeeed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:11:41.637758 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-0d9138d8-d7a1-4e2b-a391-fcede07ba9a8 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0948754217fc4ff2ba0241fa35feaf90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1aaf20f480a423ea5feca81585aeeed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:11:41.638969 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-0d9138d8-d7a1-4e2b-a391-fcede07ba9a8 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] 10.222.0.50 "GET /compute/v2.1/servers/36f8e098-a4b5-40a4-8f49-f341c5ad940c" status: 200 len: 1722 microversion: 2.20 time: 0.164090 Sep 24 05:11:41.639525 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 550/1126] 10.222.0.50 () {60 vars in 1277 bytes} [Sat Sep 24 05:11:41 2022] GET /compute/v2.1/servers/36f8e098-a4b5-40a4-8f49-f341c5ad940c => generated 1722 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 05:11:41.945001 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-0c2d88fd-c78e-47bf-a36e-6b5eb95370ab tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Calling method '>' {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:11:41.945608 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.compute.api [None req-0c2d88fd-c78e-47bf-a36e-6b5eb95370ab tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] [instance: 459e75d4-67d0-437c-aad4-09523804e931] Fetching instance by UUID {{(pid=120594) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:11:41.952080 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-0c2d88fd-c78e-47bf-a36e-6b5eb95370ab tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:11:41.952560 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-0c2d88fd-c78e-47bf-a36e-6b5eb95370ab tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:11:41.952996 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-0c2d88fd-c78e-47bf-a36e-6b5eb95370ab tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:11:41.953693 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-0c2d88fd-c78e-47bf-a36e-6b5eb95370ab tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:11:41.954173 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-0c2d88fd-c78e-47bf-a36e-6b5eb95370ab tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:11:41.954598 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-0c2d88fd-c78e-47bf-a36e-6b5eb95370ab tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:11:42.017549 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.policy [None req-0c2d88fd-c78e-47bf-a36e-6b5eb95370ab tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74a8cc19ab204424ab23c62915ac2bab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87d5229e39fe4817b5187068d8acecc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:11:42.025554 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [None req-0c2d88fd-c78e-47bf-a36e-6b5eb95370ab tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] 10.222.0.50 "GET /compute/v2.1/servers/459e75d4-67d0-437c-aad4-09523804e931" status: 200 len: 1293 microversion: 2.1 time: 0.084484 Sep 24 05:11:42.026132 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 577/1127] 10.222.0.50 () {58 vars in 1236 bytes} [Sat Sep 24 05:11:41 2022] GET /compute/v2.1/servers/459e75d4-67d0-437c-aad4-09523804e931 => generated 1293 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 05:11:42.140232 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [req-aaef66af-99d0-4add-a3f6-79e031e4b5a3 req-d496644b-9559-4b26-9c43-55708b93d8fe service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "36f8e098-a4b5-40a4-8f49-f341c5ad940c", "name": "network-vif-unplugged", "status": "completed", "tag": "e1514bf0-06bf-454f-bb1a-b1c69713927f"}]} {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 05:11:42.151467 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [req-aaef66af-99d0-4add-a3f6-79e031e4b5a3 req-d496644b-9559-4b26-9c43-55708b93d8fe service nova] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:11:42.152229 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [req-aaef66af-99d0-4add-a3f6-79e031e4b5a3 req-d496644b-9559-4b26-9c43-55708b93d8fe service nova] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:11:42.152916 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [req-aaef66af-99d0-4add-a3f6-79e031e4b5a3 req-d496644b-9559-4b26-9c43-55708b93d8fe service nova] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:11:42.167446 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.compute.server_external_events [req-aaef66af-99d0-4add-a3f6-79e031e4b5a3 req-d496644b-9559-4b26-9c43-55708b93d8fe service nova] Creating event network-vif-unplugged:e1514bf0-06bf-454f-bb1a-b1c69713927f for instance 36f8e098-a4b5-40a4-8f49-f341c5ad940c on hv-cinder-85918 Sep 24 05:11:42.172599 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [req-aaef66af-99d0-4add-a3f6-79e031e4b5a3 req-d496644b-9559-4b26-9c43-55708b93d8fe service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.036322 Sep 24 05:11:42.173384 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 551/1128] 10.222.0.50 () {64 vars in 1317 bytes} [Sat Sep 24 05:11:42 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 24 05:11:42.664850 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-bdec4235-c3be-439d-8e87-f74ccb778c77 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Calling method '>' {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:11:42.665541 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.compute.api [None req-bdec4235-c3be-439d-8e87-f74ccb778c77 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] [instance: 36f8e098-a4b5-40a4-8f49-f341c5ad940c] Fetching instance by UUID {{(pid=120594) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:11:42.671545 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-bdec4235-c3be-439d-8e87-f74ccb778c77 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:11:42.672115 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-bdec4235-c3be-439d-8e87-f74ccb778c77 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:11:42.672549 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-bdec4235-c3be-439d-8e87-f74ccb778c77 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:11:42.673269 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-bdec4235-c3be-439d-8e87-f74ccb778c77 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:11:42.673736 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-bdec4235-c3be-439d-8e87-f74ccb778c77 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:11:42.674400 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-bdec4235-c3be-439d-8e87-f74ccb778c77 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:11:42.860517 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.policy [None req-bdec4235-c3be-439d-8e87-f74ccb778c77 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0948754217fc4ff2ba0241fa35feaf90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1aaf20f480a423ea5feca81585aeeed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:11:42.872535 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.policy [None req-bdec4235-c3be-439d-8e87-f74ccb778c77 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0948754217fc4ff2ba0241fa35feaf90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1aaf20f480a423ea5feca81585aeeed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:11:42.874563 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.policy [None req-bdec4235-c3be-439d-8e87-f74ccb778c77 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0948754217fc4ff2ba0241fa35feaf90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1aaf20f480a423ea5feca81585aeeed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:11:42.876298 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [None req-bdec4235-c3be-439d-8e87-f74ccb778c77 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] 10.222.0.50 "GET /compute/v2.1/servers/36f8e098-a4b5-40a4-8f49-f341c5ad940c" status: 200 len: 1665 microversion: 2.20 time: 0.215368 Sep 24 05:11:42.877521 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 578/1129] 10.222.0.50 () {60 vars in 1277 bytes} [Sat Sep 24 05:11:42 2022] GET /compute/v2.1/servers/36f8e098-a4b5-40a4-8f49-f341c5ad940c => generated 1665 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 05:11:42.906310 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-74faeb15-8d32-44e3-99ee-e6c91fb90b3d tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "0ce0ca46-c4a0-4cd6-9b26-15be8f087f54"}} {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 05:11:42.908741 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.compute.api [None req-74faeb15-8d32-44e3-99ee-e6c91fb90b3d tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] [instance: 36f8e098-a4b5-40a4-8f49-f341c5ad940c] Fetching instance by UUID {{(pid=120593) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:11:42.912025 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG dbcounter [-] [120593] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=4 {{(pid=120593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 05:11:42.916101 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-74faeb15-8d32-44e3-99ee-e6c91fb90b3d tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:11:42.916585 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-74faeb15-8d32-44e3-99ee-e6c91fb90b3d tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:11:42.917223 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-74faeb15-8d32-44e3-99ee-e6c91fb90b3d tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:11:42.917856 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-74faeb15-8d32-44e3-99ee-e6c91fb90b3d tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:11:42.918352 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-74faeb15-8d32-44e3-99ee-e6c91fb90b3d tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:11:42.918776 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-74faeb15-8d32-44e3-99ee-e6c91fb90b3d tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:11:43.048528 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-19b387e3-ebea-450d-813c-c01a55e3f47b tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Calling method '>' {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:11:43.049760 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.compute.api [None req-19b387e3-ebea-450d-813c-c01a55e3f47b tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] [instance: 459e75d4-67d0-437c-aad4-09523804e931] Fetching instance by UUID {{(pid=120594) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:11:43.058747 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-19b387e3-ebea-450d-813c-c01a55e3f47b tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:11:43.059230 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-19b387e3-ebea-450d-813c-c01a55e3f47b tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:11:43.059895 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-19b387e3-ebea-450d-813c-c01a55e3f47b tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:11:43.060606 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-19b387e3-ebea-450d-813c-c01a55e3f47b tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:11:43.061064 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-19b387e3-ebea-450d-813c-c01a55e3f47b tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:11:43.061727 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-19b387e3-ebea-450d-813c-c01a55e3f47b tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:11:43.255173 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-74faeb15-8d32-44e3-99ee-e6c91fb90b3d tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] 10.222.0.50 "POST /compute/v2.1/servers/36f8e098-a4b5-40a4-8f49-f341c5ad940c/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.353828 Sep 24 05:11:43.270203 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 552/1130] 10.222.0.50 () {62 vars in 1364 bytes} [Sat Sep 24 05:11:42 2022] POST /compute/v2.1/servers/36f8e098-a4b5-40a4-8f49-f341c5ad940c/os-volume_attachments => generated 188 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 24 05:11:43.295498 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.policy [None req-19b387e3-ebea-450d-813c-c01a55e3f47b tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74a8cc19ab204424ab23c62915ac2bab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87d5229e39fe4817b5187068d8acecc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:11:43.304050 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [None req-19b387e3-ebea-450d-813c-c01a55e3f47b tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] 10.222.0.50 "GET /compute/v2.1/servers/459e75d4-67d0-437c-aad4-09523804e931" status: 200 len: 1366 microversion: 2.1 time: 0.259231 Sep 24 05:11:43.304959 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 579/1131] 10.222.0.50 () {58 vars in 1236 bytes} [Sat Sep 24 05:11:43 2022] GET /compute/v2.1/servers/459e75d4-67d0-437c-aad4-09523804e931 => generated 1366 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 24 05:11:43.396009 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-ad03fec7-9a60-422a-bd21-213984b69b4a tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Calling method '>' {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:11:43.396601 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.compute.api [None req-ad03fec7-9a60-422a-bd21-213984b69b4a tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] [instance: 36f8e098-a4b5-40a4-8f49-f341c5ad940c] Fetching instance by UUID {{(pid=120593) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:11:43.403292 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-ad03fec7-9a60-422a-bd21-213984b69b4a tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:11:43.404021 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-ad03fec7-9a60-422a-bd21-213984b69b4a tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:11:43.404457 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-ad03fec7-9a60-422a-bd21-213984b69b4a tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:11:43.405339 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-ad03fec7-9a60-422a-bd21-213984b69b4a tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:11:43.405794 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-ad03fec7-9a60-422a-bd21-213984b69b4a tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:11:43.406249 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-ad03fec7-9a60-422a-bd21-213984b69b4a tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:11:43.501860 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG dbcounter [-] [120593] Writing DB stats nova_cell1:SELECT=92,nova_cell1:INSERT=4,nova_cell1:UPDATE=4 {{(pid=120593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 05:11:43.634344 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-ad03fec7-9a60-422a-bd21-213984b69b4a tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] 10.222.0.50 "DELETE /compute/v2.1/servers/36f8e098-a4b5-40a4-8f49-f341c5ad940c/os-volume_attachments/0ce0ca46-c4a0-4cd6-9b26-15be8f087f54" status: 202 len: 0 microversion: 2.20 time: 0.242441 Sep 24 05:11:43.634933 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 553/1132] 10.222.0.50 () {60 vars in 1457 bytes} [Sat Sep 24 05:11:43 2022] DELETE /compute/v2.1/servers/36f8e098-a4b5-40a4-8f49-f341c5ad940c/os-volume_attachments/0ce0ca46-c4a0-4cd6-9b26-15be8f087f54 => generated 0 bytes in 244 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Sep 24 05:11:43.700125 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-2304a723-6bd7-45ed-ade2-14008135a280 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 05:11:43.700945 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.compute.api [None req-2304a723-6bd7-45ed-ade2-14008135a280 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] [instance: 36f8e098-a4b5-40a4-8f49-f341c5ad940c] Fetching instance by UUID {{(pid=120594) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:11:43.703105 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG dbcounter [-] [120594] Writing DB stats nova_api:SELECT=82,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=120594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 05:11:43.708446 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-2304a723-6bd7-45ed-ade2-14008135a280 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:11:43.708999 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-2304a723-6bd7-45ed-ade2-14008135a280 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:11:43.709515 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-2304a723-6bd7-45ed-ade2-14008135a280 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:11:43.710298 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-2304a723-6bd7-45ed-ade2-14008135a280 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:11:43.710807 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-2304a723-6bd7-45ed-ade2-14008135a280 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:11:43.711293 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-2304a723-6bd7-45ed-ade2-14008135a280 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:11:43.744870 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.compute.api [None req-2304a723-6bd7-45ed-ade2-14008135a280 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] [instance: 36f8e098-a4b5-40a4-8f49-f341c5ad940c] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=120594) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Sep 24 05:11:43.787618 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG dbcounter [-] [120594] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 05:11:43.813840 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [None req-2304a723-6bd7-45ed-ade2-14008135a280 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] 10.222.0.50 "POST /compute/v2.1/servers/36f8e098-a4b5-40a4-8f49-f341c5ad940c/action" status: 202 len: 0 microversion: 2.20 time: 0.117728 Sep 24 05:11:43.817417 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 580/1133] 10.222.0.50 () {62 vars in 1319 bytes} [Sat Sep 24 05:11:43 2022] POST /compute/v2.1/servers/36f8e098-a4b5-40a4-8f49-f341c5ad940c/action => generated 0 bytes in 119 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Sep 24 05:11:43.822732 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-f4ad59ba-13b6-4063-9f1b-866f266829e8 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Calling method '>' {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:11:43.823347 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.compute.api [None req-f4ad59ba-13b6-4063-9f1b-866f266829e8 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] [instance: 36f8e098-a4b5-40a4-8f49-f341c5ad940c] Fetching instance by UUID {{(pid=120593) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:11:43.829380 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-f4ad59ba-13b6-4063-9f1b-866f266829e8 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:11:43.829872 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-f4ad59ba-13b6-4063-9f1b-866f266829e8 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:11:43.830405 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-f4ad59ba-13b6-4063-9f1b-866f266829e8 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:11:43.831122 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-f4ad59ba-13b6-4063-9f1b-866f266829e8 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:11:43.831576 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-f4ad59ba-13b6-4063-9f1b-866f266829e8 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:11:43.832003 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-f4ad59ba-13b6-4063-9f1b-866f266829e8 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:11:44.288979 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-f4ad59ba-13b6-4063-9f1b-866f266829e8 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0948754217fc4ff2ba0241fa35feaf90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1aaf20f480a423ea5feca81585aeeed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:11:44.297586 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-f4ad59ba-13b6-4063-9f1b-866f266829e8 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0948754217fc4ff2ba0241fa35feaf90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1aaf20f480a423ea5feca81585aeeed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:11:44.300542 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-f4ad59ba-13b6-4063-9f1b-866f266829e8 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0948754217fc4ff2ba0241fa35feaf90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1aaf20f480a423ea5feca81585aeeed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:11:44.302220 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-f4ad59ba-13b6-4063-9f1b-866f266829e8 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] 10.222.0.50 "GET /compute/v2.1/servers/36f8e098-a4b5-40a4-8f49-f341c5ad940c" status: 200 len: 1673 microversion: 2.20 time: 0.483000 Sep 24 05:11:44.309478 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 554/1134] 10.222.0.50 () {60 vars in 1277 bytes} [Sat Sep 24 05:11:43 2022] GET /compute/v2.1/servers/36f8e098-a4b5-40a4-8f49-f341c5ad940c => generated 1673 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 05:11:44.333881 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-1e6e9c86-48e1-4f28-a04e-f2172ba0b1fc tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Calling method '>' {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:11:44.334650 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.compute.api [None req-1e6e9c86-48e1-4f28-a04e-f2172ba0b1fc tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] [instance: 459e75d4-67d0-437c-aad4-09523804e931] Fetching instance by UUID {{(pid=120593) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:11:44.341792 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-1e6e9c86-48e1-4f28-a04e-f2172ba0b1fc tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:11:44.342595 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-1e6e9c86-48e1-4f28-a04e-f2172ba0b1fc tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:11:44.342951 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [req-8dd01aae-998d-471f-be58-c42ac5ac6dc7 req-cb4edf62-20fb-4c92-b6be-d85c6edc2834 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "459e75d4-67d0-437c-aad4-09523804e931", "tag": "ef9198dd-ee25-440b-bf14-75c1f892d961"}]} {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 05:11:44.343419 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-1e6e9c86-48e1-4f28-a04e-f2172ba0b1fc tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:11:44.343925 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-1e6e9c86-48e1-4f28-a04e-f2172ba0b1fc tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:11:44.344448 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-1e6e9c86-48e1-4f28-a04e-f2172ba0b1fc tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:11:44.344979 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-1e6e9c86-48e1-4f28-a04e-f2172ba0b1fc tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:11:44.355736 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [req-8dd01aae-998d-471f-be58-c42ac5ac6dc7 req-cb4edf62-20fb-4c92-b6be-d85c6edc2834 service nova] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:11:44.356598 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [req-8dd01aae-998d-471f-be58-c42ac5ac6dc7 req-cb4edf62-20fb-4c92-b6be-d85c6edc2834 service nova] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:11:44.357178 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [req-8dd01aae-998d-471f-be58-c42ac5ac6dc7 req-cb4edf62-20fb-4c92-b6be-d85c6edc2834 service nova] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:11:44.371598 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: INFO nova.api.openstack.compute.server_external_events [req-8dd01aae-998d-471f-be58-c42ac5ac6dc7 req-cb4edf62-20fb-4c92-b6be-d85c6edc2834 service nova] Creating event network-changed:ef9198dd-ee25-440b-bf14-75c1f892d961 for instance 459e75d4-67d0-437c-aad4-09523804e931 on hv-cinder-85918 Sep 24 05:11:44.389071 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [req-8dd01aae-998d-471f-be58-c42ac5ac6dc7 req-cb4edf62-20fb-4c92-b6be-d85c6edc2834 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.123653 Sep 24 05:11:44.390051 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 581/1135] 10.222.0.50 () {64 vars in 1317 bytes} [Sat Sep 24 05:11:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 05:11:44.606369 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-1e6e9c86-48e1-4f28-a04e-f2172ba0b1fc tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74a8cc19ab204424ab23c62915ac2bab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87d5229e39fe4817b5187068d8acecc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:11:44.615087 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-1e6e9c86-48e1-4f28-a04e-f2172ba0b1fc tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] 10.222.0.50 "GET /compute/v2.1/servers/459e75d4-67d0-437c-aad4-09523804e931" status: 200 len: 1366 microversion: 2.1 time: 0.285462 Sep 24 05:11:44.615665 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 555/1136] 10.222.0.50 () {58 vars in 1236 bytes} [Sat Sep 24 05:11:44 2022] GET /compute/v2.1/servers/459e75d4-67d0-437c-aad4-09523804e931 => generated 1366 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 24 05:11:45.328608 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-971909b0-a239-4afd-8100-22ca432721e1 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Calling method '>' {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:11:45.329299 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.compute.api [None req-971909b0-a239-4afd-8100-22ca432721e1 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] [instance: 36f8e098-a4b5-40a4-8f49-f341c5ad940c] Fetching instance by UUID {{(pid=120594) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:11:45.335880 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-971909b0-a239-4afd-8100-22ca432721e1 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:11:45.336358 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-971909b0-a239-4afd-8100-22ca432721e1 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:11:45.336788 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-971909b0-a239-4afd-8100-22ca432721e1 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:11:45.337468 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-971909b0-a239-4afd-8100-22ca432721e1 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:11:45.337917 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-971909b0-a239-4afd-8100-22ca432721e1 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:11:45.338360 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-971909b0-a239-4afd-8100-22ca432721e1 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:11:45.467585 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.policy [None req-971909b0-a239-4afd-8100-22ca432721e1 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0948754217fc4ff2ba0241fa35feaf90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1aaf20f480a423ea5feca81585aeeed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:11:45.475742 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.policy [None req-971909b0-a239-4afd-8100-22ca432721e1 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0948754217fc4ff2ba0241fa35feaf90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1aaf20f480a423ea5feca81585aeeed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:11:45.477501 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.policy [None req-971909b0-a239-4afd-8100-22ca432721e1 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0948754217fc4ff2ba0241fa35feaf90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1aaf20f480a423ea5feca81585aeeed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:11:45.478685 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [None req-971909b0-a239-4afd-8100-22ca432721e1 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] 10.222.0.50 "GET /compute/v2.1/servers/36f8e098-a4b5-40a4-8f49-f341c5ad940c" status: 200 len: 1673 microversion: 2.20 time: 0.154401 Sep 24 05:11:45.479240 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 582/1137] 10.222.0.50 () {60 vars in 1277 bytes} [Sat Sep 24 05:11:45 2022] GET /compute/v2.1/servers/36f8e098-a4b5-40a4-8f49-f341c5ad940c => generated 1673 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 24 05:11:45.639267 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-218fe562-2012-4cd8-8fd2-e0429a0f493d tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Calling method '>' {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:11:45.639818 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.compute.api [None req-218fe562-2012-4cd8-8fd2-e0429a0f493d tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] [instance: 459e75d4-67d0-437c-aad4-09523804e931] Fetching instance by UUID {{(pid=120593) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:11:45.646215 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-218fe562-2012-4cd8-8fd2-e0429a0f493d tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:11:45.646695 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-218fe562-2012-4cd8-8fd2-e0429a0f493d tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:11:45.647137 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-218fe562-2012-4cd8-8fd2-e0429a0f493d tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:11:45.647830 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-218fe562-2012-4cd8-8fd2-e0429a0f493d tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:11:45.648283 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-218fe562-2012-4cd8-8fd2-e0429a0f493d tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:11:45.648707 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-218fe562-2012-4cd8-8fd2-e0429a0f493d tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:11:45.773754 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-218fe562-2012-4cd8-8fd2-e0429a0f493d tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74a8cc19ab204424ab23c62915ac2bab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87d5229e39fe4817b5187068d8acecc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:11:45.781336 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-218fe562-2012-4cd8-8fd2-e0429a0f493d tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] 10.222.0.50 "GET /compute/v2.1/servers/459e75d4-67d0-437c-aad4-09523804e931" status: 200 len: 1366 microversion: 2.1 time: 0.146183 Sep 24 05:11:45.781889 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 556/1138] 10.222.0.50 () {58 vars in 1236 bytes} [Sat Sep 24 05:11:45 2022] GET /compute/v2.1/servers/459e75d4-67d0-437c-aad4-09523804e931 => generated 1366 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 05:11:46.504624 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-81bd34e2-55a4-4f6f-a082-54bdd3ecbbd9 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Calling method '>' {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:11:46.505234 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.compute.api [None req-81bd34e2-55a4-4f6f-a082-54bdd3ecbbd9 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] [instance: 36f8e098-a4b5-40a4-8f49-f341c5ad940c] Fetching instance by UUID {{(pid=120594) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:11:46.512127 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-81bd34e2-55a4-4f6f-a082-54bdd3ecbbd9 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:11:46.512601 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-81bd34e2-55a4-4f6f-a082-54bdd3ecbbd9 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:11:46.513029 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-81bd34e2-55a4-4f6f-a082-54bdd3ecbbd9 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:11:46.513703 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-81bd34e2-55a4-4f6f-a082-54bdd3ecbbd9 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:11:46.514181 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-81bd34e2-55a4-4f6f-a082-54bdd3ecbbd9 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:11:46.514597 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-81bd34e2-55a4-4f6f-a082-54bdd3ecbbd9 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:11:46.644972 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.policy [None req-81bd34e2-55a4-4f6f-a082-54bdd3ecbbd9 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0948754217fc4ff2ba0241fa35feaf90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1aaf20f480a423ea5feca81585aeeed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:11:46.653411 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.policy [None req-81bd34e2-55a4-4f6f-a082-54bdd3ecbbd9 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0948754217fc4ff2ba0241fa35feaf90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1aaf20f480a423ea5feca81585aeeed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:11:46.654840 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.policy [None req-81bd34e2-55a4-4f6f-a082-54bdd3ecbbd9 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0948754217fc4ff2ba0241fa35feaf90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1aaf20f480a423ea5feca81585aeeed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:11:46.655994 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [None req-81bd34e2-55a4-4f6f-a082-54bdd3ecbbd9 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] 10.222.0.50 "GET /compute/v2.1/servers/36f8e098-a4b5-40a4-8f49-f341c5ad940c" status: 200 len: 1673 microversion: 2.20 time: 0.155474 Sep 24 05:11:46.656554 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 583/1139] 10.222.0.50 () {60 vars in 1277 bytes} [Sat Sep 24 05:11:46 2022] GET /compute/v2.1/servers/36f8e098-a4b5-40a4-8f49-f341c5ad940c => generated 1673 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 05:11:46.804298 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-f2156d3f-a894-4e88-acb7-16ae929127bf tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Calling method '>' {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:11:46.805181 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.compute.api [None req-f2156d3f-a894-4e88-acb7-16ae929127bf tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] [instance: 459e75d4-67d0-437c-aad4-09523804e931] Fetching instance by UUID {{(pid=120593) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:11:46.812260 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-f2156d3f-a894-4e88-acb7-16ae929127bf tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:11:46.812736 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-f2156d3f-a894-4e88-acb7-16ae929127bf tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:11:46.813166 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-f2156d3f-a894-4e88-acb7-16ae929127bf tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:11:46.813843 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-f2156d3f-a894-4e88-acb7-16ae929127bf tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:11:46.814315 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-f2156d3f-a894-4e88-acb7-16ae929127bf tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:11:46.814791 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-f2156d3f-a894-4e88-acb7-16ae929127bf tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:11:46.943963 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-f2156d3f-a894-4e88-acb7-16ae929127bf tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74a8cc19ab204424ab23c62915ac2bab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87d5229e39fe4817b5187068d8acecc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:11:46.951749 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-f2156d3f-a894-4e88-acb7-16ae929127bf tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] 10.222.0.50 "GET /compute/v2.1/servers/459e75d4-67d0-437c-aad4-09523804e931" status: 200 len: 1366 microversion: 2.1 time: 0.151872 Sep 24 05:11:46.952312 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 557/1140] 10.222.0.50 () {58 vars in 1236 bytes} [Sat Sep 24 05:11:46 2022] GET /compute/v2.1/servers/459e75d4-67d0-437c-aad4-09523804e931 => generated 1366 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 05:11:47.681719 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-ba50ef89-9bcb-4295-82ed-5887d3312662 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Calling method '>' {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:11:47.682526 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.compute.api [None req-ba50ef89-9bcb-4295-82ed-5887d3312662 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] [instance: 36f8e098-a4b5-40a4-8f49-f341c5ad940c] Fetching instance by UUID {{(pid=120594) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:11:47.688832 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-ba50ef89-9bcb-4295-82ed-5887d3312662 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:11:47.689496 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-ba50ef89-9bcb-4295-82ed-5887d3312662 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:11:47.690033 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-ba50ef89-9bcb-4295-82ed-5887d3312662 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:11:47.690900 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-ba50ef89-9bcb-4295-82ed-5887d3312662 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:11:47.691418 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-ba50ef89-9bcb-4295-82ed-5887d3312662 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:11:47.691882 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-ba50ef89-9bcb-4295-82ed-5887d3312662 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:11:47.916017 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.policy [None req-ba50ef89-9bcb-4295-82ed-5887d3312662 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0948754217fc4ff2ba0241fa35feaf90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1aaf20f480a423ea5feca81585aeeed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:11:47.924002 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.policy [None req-ba50ef89-9bcb-4295-82ed-5887d3312662 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0948754217fc4ff2ba0241fa35feaf90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1aaf20f480a423ea5feca81585aeeed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:11:47.925480 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.policy [None req-ba50ef89-9bcb-4295-82ed-5887d3312662 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0948754217fc4ff2ba0241fa35feaf90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1aaf20f480a423ea5feca81585aeeed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:11:47.926698 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [None req-ba50ef89-9bcb-4295-82ed-5887d3312662 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] 10.222.0.50 "GET /compute/v2.1/servers/36f8e098-a4b5-40a4-8f49-f341c5ad940c" status: 200 len: 1731 microversion: 2.20 time: 0.249816 Sep 24 05:11:47.927274 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 584/1141] 10.222.0.50 () {60 vars in 1277 bytes} [Sat Sep 24 05:11:47 2022] GET /compute/v2.1/servers/36f8e098-a4b5-40a4-8f49-f341c5ad940c => generated 1731 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 05:11:47.974798 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-e2319970-4701-4745-b1e0-2ec01a8405b5 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Calling method '>' {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:11:47.975434 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.compute.api [None req-e2319970-4701-4745-b1e0-2ec01a8405b5 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] [instance: 459e75d4-67d0-437c-aad4-09523804e931] Fetching instance by UUID {{(pid=120593) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:11:47.982017 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-e2319970-4701-4745-b1e0-2ec01a8405b5 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:11:47.982513 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-e2319970-4701-4745-b1e0-2ec01a8405b5 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:11:47.982947 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-e2319970-4701-4745-b1e0-2ec01a8405b5 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:11:47.983633 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-e2319970-4701-4745-b1e0-2ec01a8405b5 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:11:47.984080 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-e2319970-4701-4745-b1e0-2ec01a8405b5 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:11:47.984503 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-e2319970-4701-4745-b1e0-2ec01a8405b5 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:11:48.111306 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-e2319970-4701-4745-b1e0-2ec01a8405b5 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74a8cc19ab204424ab23c62915ac2bab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87d5229e39fe4817b5187068d8acecc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:11:48.119778 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-e2319970-4701-4745-b1e0-2ec01a8405b5 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] 10.222.0.50 "GET /compute/v2.1/servers/459e75d4-67d0-437c-aad4-09523804e931" status: 200 len: 1366 microversion: 2.1 time: 0.148877 Sep 24 05:11:48.120643 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 558/1142] 10.222.0.50 () {58 vars in 1236 bytes} [Sat Sep 24 05:11:47 2022] GET /compute/v2.1/servers/459e75d4-67d0-437c-aad4-09523804e931 => generated 1366 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 05:11:48.952948 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-6eda4466-d1c9-4564-925a-5d4d7681f662 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Calling method '>' {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:11:48.953564 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.compute.api [None req-6eda4466-d1c9-4564-925a-5d4d7681f662 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] [instance: 36f8e098-a4b5-40a4-8f49-f341c5ad940c] Fetching instance by UUID {{(pid=120594) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:11:48.960586 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-6eda4466-d1c9-4564-925a-5d4d7681f662 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:11:48.961059 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-6eda4466-d1c9-4564-925a-5d4d7681f662 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:11:48.961522 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-6eda4466-d1c9-4564-925a-5d4d7681f662 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:11:48.962230 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-6eda4466-d1c9-4564-925a-5d4d7681f662 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:11:48.962681 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-6eda4466-d1c9-4564-925a-5d4d7681f662 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:11:48.963101 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-6eda4466-d1c9-4564-925a-5d4d7681f662 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:11:49.091886 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.policy [None req-6eda4466-d1c9-4564-925a-5d4d7681f662 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0948754217fc4ff2ba0241fa35feaf90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1aaf20f480a423ea5feca81585aeeed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:11:49.100351 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.policy [None req-6eda4466-d1c9-4564-925a-5d4d7681f662 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0948754217fc4ff2ba0241fa35feaf90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1aaf20f480a423ea5feca81585aeeed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:11:49.101821 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.policy [None req-6eda4466-d1c9-4564-925a-5d4d7681f662 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0948754217fc4ff2ba0241fa35feaf90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1aaf20f480a423ea5feca81585aeeed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:11:49.103114 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [None req-6eda4466-d1c9-4564-925a-5d4d7681f662 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] 10.222.0.50 "GET /compute/v2.1/servers/36f8e098-a4b5-40a4-8f49-f341c5ad940c" status: 200 len: 1731 microversion: 2.20 time: 0.153970 Sep 24 05:11:49.103490 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 585/1143] 10.222.0.50 () {60 vars in 1277 bytes} [Sat Sep 24 05:11:48 2022] GET /compute/v2.1/servers/36f8e098-a4b5-40a4-8f49-f341c5ad940c => generated 1731 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 05:11:49.143068 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-4df3ab31-acda-4e94-befe-5e896888e314 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Calling method '>' {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:11:49.143675 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.compute.api [None req-4df3ab31-acda-4e94-befe-5e896888e314 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] [instance: 459e75d4-67d0-437c-aad4-09523804e931] Fetching instance by UUID {{(pid=120593) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:11:49.150592 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-4df3ab31-acda-4e94-befe-5e896888e314 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:11:49.151072 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-4df3ab31-acda-4e94-befe-5e896888e314 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:11:49.151504 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-4df3ab31-acda-4e94-befe-5e896888e314 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:11:49.152192 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-4df3ab31-acda-4e94-befe-5e896888e314 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:11:49.152644 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-4df3ab31-acda-4e94-befe-5e896888e314 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:11:49.153105 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-4df3ab31-acda-4e94-befe-5e896888e314 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:11:49.340710 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-4df3ab31-acda-4e94-befe-5e896888e314 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74a8cc19ab204424ab23c62915ac2bab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87d5229e39fe4817b5187068d8acecc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:11:49.350105 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-4df3ab31-acda-4e94-befe-5e896888e314 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] 10.222.0.50 "GET /compute/v2.1/servers/459e75d4-67d0-437c-aad4-09523804e931" status: 200 len: 1366 microversion: 2.1 time: 0.210747 Sep 24 05:11:49.350724 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 559/1144] 10.222.0.50 () {58 vars in 1236 bytes} [Sat Sep 24 05:11:49 2022] GET /compute/v2.1/servers/459e75d4-67d0-437c-aad4-09523804e931 => generated 1366 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 05:11:50.128573 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-75fcdc52-4279-409f-8509-d55c7894c75d tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Calling method '>' {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:11:50.130377 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.compute.api [None req-75fcdc52-4279-409f-8509-d55c7894c75d tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] [instance: 36f8e098-a4b5-40a4-8f49-f341c5ad940c] Fetching instance by UUID {{(pid=120594) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:11:50.143736 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-75fcdc52-4279-409f-8509-d55c7894c75d tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:11:50.144310 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-75fcdc52-4279-409f-8509-d55c7894c75d tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:11:50.144819 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-75fcdc52-4279-409f-8509-d55c7894c75d tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:11:50.145614 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-75fcdc52-4279-409f-8509-d55c7894c75d tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:11:50.146095 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-75fcdc52-4279-409f-8509-d55c7894c75d tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:11:50.146516 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-75fcdc52-4279-409f-8509-d55c7894c75d tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:11:50.202088 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [req-0e0e282b-d730-49ba-b94f-35748a474024 req-6bd7a9a4-ab04-4a39-80d0-20c7a56696f4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "459e75d4-67d0-437c-aad4-09523804e931", "name": "network-vif-plugged", "status": "completed", "tag": "ef9198dd-ee25-440b-bf14-75c1f892d961"}]} {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 05:11:50.221928 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [req-0e0e282b-d730-49ba-b94f-35748a474024 req-6bd7a9a4-ab04-4a39-80d0-20c7a56696f4 service nova] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:11:50.222460 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [req-0e0e282b-d730-49ba-b94f-35748a474024 req-6bd7a9a4-ab04-4a39-80d0-20c7a56696f4 service nova] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:11:50.222898 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [req-0e0e282b-d730-49ba-b94f-35748a474024 req-6bd7a9a4-ab04-4a39-80d0-20c7a56696f4 service nova] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:11:50.236386 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.compute.server_external_events [req-0e0e282b-d730-49ba-b94f-35748a474024 req-6bd7a9a4-ab04-4a39-80d0-20c7a56696f4 service nova] Creating event network-vif-plugged:ef9198dd-ee25-440b-bf14-75c1f892d961 for instance 459e75d4-67d0-437c-aad4-09523804e931 on hv-cinder-85918 Sep 24 05:11:50.242387 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [req-0e0e282b-d730-49ba-b94f-35748a474024 req-6bd7a9a4-ab04-4a39-80d0-20c7a56696f4 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044127 Sep 24 05:11:50.243417 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 560/1145] 10.222.0.50 () {64 vars in 1317 bytes} [Sat Sep 24 05:11:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 05:11:50.311309 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.policy [None req-75fcdc52-4279-409f-8509-d55c7894c75d tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0948754217fc4ff2ba0241fa35feaf90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1aaf20f480a423ea5feca81585aeeed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:11:50.320702 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.policy [None req-75fcdc52-4279-409f-8509-d55c7894c75d tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0948754217fc4ff2ba0241fa35feaf90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1aaf20f480a423ea5feca81585aeeed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:11:50.322182 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.policy [None req-75fcdc52-4279-409f-8509-d55c7894c75d tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0948754217fc4ff2ba0241fa35feaf90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1aaf20f480a423ea5feca81585aeeed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:11:50.323349 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [None req-75fcdc52-4279-409f-8509-d55c7894c75d tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] 10.222.0.50 "GET /compute/v2.1/servers/36f8e098-a4b5-40a4-8f49-f341c5ad940c" status: 200 len: 1731 microversion: 2.20 time: 0.198786 Sep 24 05:11:50.323912 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 586/1146] 10.222.0.50 () {60 vars in 1277 bytes} [Sat Sep 24 05:11:50 2022] GET /compute/v2.1/servers/36f8e098-a4b5-40a4-8f49-f341c5ad940c => generated 1731 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 05:11:50.374395 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-4af85e64-388b-4ef2-bf66-0bf73ed9cdba tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Calling method '>' {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:11:50.375268 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.compute.api [None req-4af85e64-388b-4ef2-bf66-0bf73ed9cdba tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] [instance: 459e75d4-67d0-437c-aad4-09523804e931] Fetching instance by UUID {{(pid=120593) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:11:50.383054 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-4af85e64-388b-4ef2-bf66-0bf73ed9cdba tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:11:50.383553 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-4af85e64-388b-4ef2-bf66-0bf73ed9cdba tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:11:50.383994 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-4af85e64-388b-4ef2-bf66-0bf73ed9cdba tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:11:50.384894 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-4af85e64-388b-4ef2-bf66-0bf73ed9cdba tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:11:50.385353 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-4af85e64-388b-4ef2-bf66-0bf73ed9cdba tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:11:50.385914 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-4af85e64-388b-4ef2-bf66-0bf73ed9cdba tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:11:50.526099 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-4af85e64-388b-4ef2-bf66-0bf73ed9cdba tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74a8cc19ab204424ab23c62915ac2bab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87d5229e39fe4817b5187068d8acecc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:11:50.534077 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-4af85e64-388b-4ef2-bf66-0bf73ed9cdba tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] 10.222.0.50 "GET /compute/v2.1/servers/459e75d4-67d0-437c-aad4-09523804e931" status: 200 len: 1366 microversion: 2.1 time: 0.164105 Sep 24 05:11:50.534715 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 561/1147] 10.222.0.50 () {58 vars in 1236 bytes} [Sat Sep 24 05:11:50 2022] GET /compute/v2.1/servers/459e75d4-67d0-437c-aad4-09523804e931 => generated 1366 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 05:11:51.349770 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-f8557a4d-5501-4f9d-8dc0-2ccdf6561ef8 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Calling method '>' {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:11:51.349770 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.compute.api [None req-f8557a4d-5501-4f9d-8dc0-2ccdf6561ef8 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] [instance: 36f8e098-a4b5-40a4-8f49-f341c5ad940c] Fetching instance by UUID {{(pid=120594) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:11:51.351833 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG dbcounter [-] [120594] Writing DB stats nova_cell0:SELECT=2 {{(pid=120594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 05:11:51.367790 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-f8557a4d-5501-4f9d-8dc0-2ccdf6561ef8 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:11:51.368364 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-f8557a4d-5501-4f9d-8dc0-2ccdf6561ef8 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:11:51.369033 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-f8557a4d-5501-4f9d-8dc0-2ccdf6561ef8 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:11:51.370287 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-f8557a4d-5501-4f9d-8dc0-2ccdf6561ef8 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:11:51.370911 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-f8557a4d-5501-4f9d-8dc0-2ccdf6561ef8 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:11:51.371621 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-f8557a4d-5501-4f9d-8dc0-2ccdf6561ef8 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:11:51.502831 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.policy [None req-f8557a4d-5501-4f9d-8dc0-2ccdf6561ef8 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0948754217fc4ff2ba0241fa35feaf90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1aaf20f480a423ea5feca81585aeeed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:11:51.512329 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.policy [None req-f8557a4d-5501-4f9d-8dc0-2ccdf6561ef8 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0948754217fc4ff2ba0241fa35feaf90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1aaf20f480a423ea5feca81585aeeed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:11:51.513971 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.policy [None req-f8557a4d-5501-4f9d-8dc0-2ccdf6561ef8 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0948754217fc4ff2ba0241fa35feaf90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1aaf20f480a423ea5feca81585aeeed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:11:51.515274 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [None req-f8557a4d-5501-4f9d-8dc0-2ccdf6561ef8 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] 10.222.0.50 "GET /compute/v2.1/servers/36f8e098-a4b5-40a4-8f49-f341c5ad940c" status: 200 len: 1731 microversion: 2.20 time: 0.170412 Sep 24 05:11:51.515902 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 587/1148] 10.222.0.50 () {60 vars in 1277 bytes} [Sat Sep 24 05:11:51 2022] GET /compute/v2.1/servers/36f8e098-a4b5-40a4-8f49-f341c5ad940c => generated 1731 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 05:11:51.558147 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-4b64e504-517f-4333-a82c-013297b9023b tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Calling method '>' {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:11:51.559183 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.compute.api [None req-4b64e504-517f-4333-a82c-013297b9023b tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] [instance: 459e75d4-67d0-437c-aad4-09523804e931] Fetching instance by UUID {{(pid=120593) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:11:51.566104 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG dbcounter [-] [120593] Writing DB stats nova_cell0:SELECT=2 {{(pid=120593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 05:11:51.568264 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG dbcounter [-] [120593] Writing DB stats nova_cell0:SELECT=10 {{(pid=120593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 05:11:51.571397 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-4b64e504-517f-4333-a82c-013297b9023b tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:11:51.572377 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-4b64e504-517f-4333-a82c-013297b9023b tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:11:51.573052 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-4b64e504-517f-4333-a82c-013297b9023b tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:11:51.574046 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-4b64e504-517f-4333-a82c-013297b9023b tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:11:51.574712 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-4b64e504-517f-4333-a82c-013297b9023b tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:11:51.575360 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-4b64e504-517f-4333-a82c-013297b9023b tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:11:51.724873 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-4b64e504-517f-4333-a82c-013297b9023b tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74a8cc19ab204424ab23c62915ac2bab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87d5229e39fe4817b5187068d8acecc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:11:51.732546 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-4b64e504-517f-4333-a82c-013297b9023b tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] 10.222.0.50 "GET /compute/v2.1/servers/459e75d4-67d0-437c-aad4-09523804e931" status: 200 len: 1366 microversion: 2.1 time: 0.179562 Sep 24 05:11:51.733116 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 562/1149] 10.222.0.50 () {58 vars in 1236 bytes} [Sat Sep 24 05:11:51 2022] GET /compute/v2.1/servers/459e75d4-67d0-437c-aad4-09523804e931 => generated 1366 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 05:11:52.542610 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-dfee64a4-9611-4e6b-b67e-2e10673b3a5a tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Calling method '>' {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:11:52.543278 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.compute.api [None req-dfee64a4-9611-4e6b-b67e-2e10673b3a5a tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] [instance: 36f8e098-a4b5-40a4-8f49-f341c5ad940c] Fetching instance by UUID {{(pid=120594) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:11:52.549240 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-dfee64a4-9611-4e6b-b67e-2e10673b3a5a tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:11:52.550041 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-dfee64a4-9611-4e6b-b67e-2e10673b3a5a tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:11:52.550707 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-dfee64a4-9611-4e6b-b67e-2e10673b3a5a tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:11:52.551406 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-dfee64a4-9611-4e6b-b67e-2e10673b3a5a tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:11:52.551860 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-dfee64a4-9611-4e6b-b67e-2e10673b3a5a tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:11:52.552290 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-dfee64a4-9611-4e6b-b67e-2e10673b3a5a tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:11:52.696553 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.policy [None req-dfee64a4-9611-4e6b-b67e-2e10673b3a5a tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0948754217fc4ff2ba0241fa35feaf90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1aaf20f480a423ea5feca81585aeeed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:11:52.704972 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.policy [None req-dfee64a4-9611-4e6b-b67e-2e10673b3a5a tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0948754217fc4ff2ba0241fa35feaf90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1aaf20f480a423ea5feca81585aeeed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:11:52.706722 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.policy [None req-dfee64a4-9611-4e6b-b67e-2e10673b3a5a tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0948754217fc4ff2ba0241fa35feaf90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1aaf20f480a423ea5feca81585aeeed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:11:52.708159 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [None req-dfee64a4-9611-4e6b-b67e-2e10673b3a5a tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] 10.222.0.50 "GET /compute/v2.1/servers/36f8e098-a4b5-40a4-8f49-f341c5ad940c" status: 200 len: 1731 microversion: 2.20 time: 0.170283 Sep 24 05:11:52.721564 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 588/1150] 10.222.0.50 () {60 vars in 1277 bytes} [Sat Sep 24 05:11:52 2022] GET /compute/v2.1/servers/36f8e098-a4b5-40a4-8f49-f341c5ad940c => generated 1731 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 05:11:52.757374 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-cec0e489-5fe4-43c1-8bae-8df937964a71 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Calling method '>' {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:11:52.757988 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.compute.api [None req-cec0e489-5fe4-43c1-8bae-8df937964a71 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] [instance: 459e75d4-67d0-437c-aad4-09523804e931] Fetching instance by UUID {{(pid=120593) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:11:52.766747 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-cec0e489-5fe4-43c1-8bae-8df937964a71 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:11:52.767227 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-cec0e489-5fe4-43c1-8bae-8df937964a71 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:11:52.767658 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-cec0e489-5fe4-43c1-8bae-8df937964a71 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:11:52.768342 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-cec0e489-5fe4-43c1-8bae-8df937964a71 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:11:52.768789 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-cec0e489-5fe4-43c1-8bae-8df937964a71 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:11:52.769236 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-cec0e489-5fe4-43c1-8bae-8df937964a71 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:11:52.896163 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-cec0e489-5fe4-43c1-8bae-8df937964a71 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74a8cc19ab204424ab23c62915ac2bab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87d5229e39fe4817b5187068d8acecc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:11:52.904213 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-cec0e489-5fe4-43c1-8bae-8df937964a71 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] 10.222.0.50 "GET /compute/v2.1/servers/459e75d4-67d0-437c-aad4-09523804e931" status: 200 len: 1366 microversion: 2.1 time: 0.151305 Sep 24 05:11:52.904774 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 563/1151] 10.222.0.50 () {58 vars in 1236 bytes} [Sat Sep 24 05:11:52 2022] GET /compute/v2.1/servers/459e75d4-67d0-437c-aad4-09523804e931 => generated 1366 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 05:11:53.734831 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-b23b313f-6f86-4c0b-8c3f-cb613353917e tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Calling method '>' {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:11:53.735432 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.compute.api [None req-b23b313f-6f86-4c0b-8c3f-cb613353917e tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] [instance: 36f8e098-a4b5-40a4-8f49-f341c5ad940c] Fetching instance by UUID {{(pid=120594) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:11:53.741975 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-b23b313f-6f86-4c0b-8c3f-cb613353917e tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:11:53.742739 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-b23b313f-6f86-4c0b-8c3f-cb613353917e tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:11:53.743393 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-b23b313f-6f86-4c0b-8c3f-cb613353917e tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:11:53.744288 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-b23b313f-6f86-4c0b-8c3f-cb613353917e tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:11:53.744889 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-b23b313f-6f86-4c0b-8c3f-cb613353917e tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:11:53.745477 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-b23b313f-6f86-4c0b-8c3f-cb613353917e tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:11:53.877043 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.policy [None req-b23b313f-6f86-4c0b-8c3f-cb613353917e tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0948754217fc4ff2ba0241fa35feaf90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1aaf20f480a423ea5feca81585aeeed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:11:53.885287 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.policy [None req-b23b313f-6f86-4c0b-8c3f-cb613353917e tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0948754217fc4ff2ba0241fa35feaf90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1aaf20f480a423ea5feca81585aeeed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:11:53.886759 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.policy [None req-b23b313f-6f86-4c0b-8c3f-cb613353917e tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0948754217fc4ff2ba0241fa35feaf90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1aaf20f480a423ea5feca81585aeeed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:11:53.887897 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [None req-b23b313f-6f86-4c0b-8c3f-cb613353917e tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] 10.222.0.50 "GET /compute/v2.1/servers/36f8e098-a4b5-40a4-8f49-f341c5ad940c" status: 200 len: 1731 microversion: 2.20 time: 0.156972 Sep 24 05:11:53.888447 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 589/1152] 10.222.0.50 () {60 vars in 1277 bytes} [Sat Sep 24 05:11:53 2022] GET /compute/v2.1/servers/36f8e098-a4b5-40a4-8f49-f341c5ad940c => generated 1731 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 05:11:53.928073 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-6dc634e4-3a60-4939-b12d-b54e719016b2 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Calling method '>' {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:11:53.928683 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.compute.api [None req-6dc634e4-3a60-4939-b12d-b54e719016b2 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] [instance: 459e75d4-67d0-437c-aad4-09523804e931] Fetching instance by UUID {{(pid=120593) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:11:53.935169 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-6dc634e4-3a60-4939-b12d-b54e719016b2 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:11:53.935651 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-6dc634e4-3a60-4939-b12d-b54e719016b2 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:11:53.936086 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-6dc634e4-3a60-4939-b12d-b54e719016b2 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:11:53.936776 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-6dc634e4-3a60-4939-b12d-b54e719016b2 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:11:53.937231 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-6dc634e4-3a60-4939-b12d-b54e719016b2 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:11:53.937654 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-6dc634e4-3a60-4939-b12d-b54e719016b2 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:11:54.087883 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-6dc634e4-3a60-4939-b12d-b54e719016b2 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74a8cc19ab204424ab23c62915ac2bab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87d5229e39fe4817b5187068d8acecc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:11:54.095571 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-6dc634e4-3a60-4939-b12d-b54e719016b2 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] 10.222.0.50 "GET /compute/v2.1/servers/459e75d4-67d0-437c-aad4-09523804e931" status: 200 len: 1366 microversion: 2.1 time: 0.171312 Sep 24 05:11:54.096171 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 564/1153] 10.222.0.50 () {58 vars in 1236 bytes} [Sat Sep 24 05:11:53 2022] GET /compute/v2.1/servers/459e75d4-67d0-437c-aad4-09523804e931 => generated 1366 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 05:11:54.914881 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-21ae4270-e091-4311-84d3-d3a595af82e7 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Calling method '>' {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:11:54.916449 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.compute.api [None req-21ae4270-e091-4311-84d3-d3a595af82e7 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] [instance: 36f8e098-a4b5-40a4-8f49-f341c5ad940c] Fetching instance by UUID {{(pid=120594) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:11:54.924653 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-21ae4270-e091-4311-84d3-d3a595af82e7 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:11:54.925172 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-21ae4270-e091-4311-84d3-d3a595af82e7 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:11:54.925609 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-21ae4270-e091-4311-84d3-d3a595af82e7 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:11:54.926535 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-21ae4270-e091-4311-84d3-d3a595af82e7 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:11:54.927496 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-21ae4270-e091-4311-84d3-d3a595af82e7 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:11:54.928591 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-21ae4270-e091-4311-84d3-d3a595af82e7 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:11:55.065413 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.policy [None req-21ae4270-e091-4311-84d3-d3a595af82e7 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0948754217fc4ff2ba0241fa35feaf90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1aaf20f480a423ea5feca81585aeeed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:11:55.073590 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.policy [None req-21ae4270-e091-4311-84d3-d3a595af82e7 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0948754217fc4ff2ba0241fa35feaf90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1aaf20f480a423ea5feca81585aeeed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:11:55.075147 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.policy [None req-21ae4270-e091-4311-84d3-d3a595af82e7 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0948754217fc4ff2ba0241fa35feaf90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1aaf20f480a423ea5feca81585aeeed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:11:55.076296 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [None req-21ae4270-e091-4311-84d3-d3a595af82e7 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] 10.222.0.50 "GET /compute/v2.1/servers/36f8e098-a4b5-40a4-8f49-f341c5ad940c" status: 200 len: 1731 microversion: 2.20 time: 0.166910 Sep 24 05:11:55.076857 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 590/1154] 10.222.0.50 () {60 vars in 1277 bytes} [Sat Sep 24 05:11:54 2022] GET /compute/v2.1/servers/36f8e098-a4b5-40a4-8f49-f341c5ad940c => generated 1731 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 05:11:55.118403 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-9cf066e2-2377-459d-acc0-5217de4199cc tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Calling method '>' {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:11:55.119038 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.compute.api [None req-9cf066e2-2377-459d-acc0-5217de4199cc tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] [instance: 459e75d4-67d0-437c-aad4-09523804e931] Fetching instance by UUID {{(pid=120593) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:11:55.125426 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-9cf066e2-2377-459d-acc0-5217de4199cc tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:11:55.125904 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-9cf066e2-2377-459d-acc0-5217de4199cc tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:11:55.126371 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-9cf066e2-2377-459d-acc0-5217de4199cc tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:11:55.127060 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-9cf066e2-2377-459d-acc0-5217de4199cc tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:11:55.127512 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-9cf066e2-2377-459d-acc0-5217de4199cc tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:11:55.127938 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-9cf066e2-2377-459d-acc0-5217de4199cc tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:11:55.256756 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-9cf066e2-2377-459d-acc0-5217de4199cc tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74a8cc19ab204424ab23c62915ac2bab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87d5229e39fe4817b5187068d8acecc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:11:55.264399 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-9cf066e2-2377-459d-acc0-5217de4199cc tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] 10.222.0.50 "GET /compute/v2.1/servers/459e75d4-67d0-437c-aad4-09523804e931" status: 200 len: 1366 microversion: 2.1 time: 0.150469 Sep 24 05:11:55.264958 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 565/1155] 10.222.0.50 () {58 vars in 1236 bytes} [Sat Sep 24 05:11:55 2022] GET /compute/v2.1/servers/459e75d4-67d0-437c-aad4-09523804e931 => generated 1366 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 05:11:56.100736 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-528413eb-e660-4d91-b1ea-a2827483cc66 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Calling method '>' {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:11:56.101436 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.compute.api [None req-528413eb-e660-4d91-b1ea-a2827483cc66 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] [instance: 36f8e098-a4b5-40a4-8f49-f341c5ad940c] Fetching instance by UUID {{(pid=120594) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:11:56.107732 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-528413eb-e660-4d91-b1ea-a2827483cc66 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:11:56.108203 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-528413eb-e660-4d91-b1ea-a2827483cc66 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:11:56.108634 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-528413eb-e660-4d91-b1ea-a2827483cc66 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:11:56.109305 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-528413eb-e660-4d91-b1ea-a2827483cc66 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:11:56.109750 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-528413eb-e660-4d91-b1ea-a2827483cc66 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:11:56.110212 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-528413eb-e660-4d91-b1ea-a2827483cc66 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:11:56.243833 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.policy [None req-528413eb-e660-4d91-b1ea-a2827483cc66 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0948754217fc4ff2ba0241fa35feaf90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1aaf20f480a423ea5feca81585aeeed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:11:56.252432 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.policy [None req-528413eb-e660-4d91-b1ea-a2827483cc66 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0948754217fc4ff2ba0241fa35feaf90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1aaf20f480a423ea5feca81585aeeed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:11:56.253920 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.policy [None req-528413eb-e660-4d91-b1ea-a2827483cc66 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0948754217fc4ff2ba0241fa35feaf90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1aaf20f480a423ea5feca81585aeeed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:11:56.255115 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [None req-528413eb-e660-4d91-b1ea-a2827483cc66 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] 10.222.0.50 "GET /compute/v2.1/servers/36f8e098-a4b5-40a4-8f49-f341c5ad940c" status: 200 len: 1731 microversion: 2.20 time: 0.158348 Sep 24 05:11:56.255673 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 591/1156] 10.222.0.50 () {60 vars in 1277 bytes} [Sat Sep 24 05:11:56 2022] GET /compute/v2.1/servers/36f8e098-a4b5-40a4-8f49-f341c5ad940c => generated 1731 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 05:11:56.287702 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-9cf81a2b-d33c-4735-a7bd-79666ec22e68 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Calling method '>' {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:11:56.288305 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.compute.api [None req-9cf81a2b-d33c-4735-a7bd-79666ec22e68 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] [instance: 459e75d4-67d0-437c-aad4-09523804e931] Fetching instance by UUID {{(pid=120593) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:11:56.294863 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-9cf81a2b-d33c-4735-a7bd-79666ec22e68 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:11:56.295346 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-9cf81a2b-d33c-4735-a7bd-79666ec22e68 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:11:56.295779 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-9cf81a2b-d33c-4735-a7bd-79666ec22e68 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:11:56.296472 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-9cf81a2b-d33c-4735-a7bd-79666ec22e68 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:11:56.296931 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-9cf81a2b-d33c-4735-a7bd-79666ec22e68 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:11:56.297353 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-9cf81a2b-d33c-4735-a7bd-79666ec22e68 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:11:56.434294 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-9cf81a2b-d33c-4735-a7bd-79666ec22e68 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74a8cc19ab204424ab23c62915ac2bab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87d5229e39fe4817b5187068d8acecc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:11:56.442113 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-9cf81a2b-d33c-4735-a7bd-79666ec22e68 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] 10.222.0.50 "GET /compute/v2.1/servers/459e75d4-67d0-437c-aad4-09523804e931" status: 200 len: 1366 microversion: 2.1 time: 0.158490 Sep 24 05:11:56.442682 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 566/1157] 10.222.0.50 () {58 vars in 1236 bytes} [Sat Sep 24 05:11:56 2022] GET /compute/v2.1/servers/459e75d4-67d0-437c-aad4-09523804e931 => generated 1366 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 05:11:57.281876 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-44240162-c518-49ff-b4ec-092d326ddfb5 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Calling method '>' {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:11:57.282570 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.compute.api [None req-44240162-c518-49ff-b4ec-092d326ddfb5 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] [instance: 36f8e098-a4b5-40a4-8f49-f341c5ad940c] Fetching instance by UUID {{(pid=120594) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:11:57.290305 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-44240162-c518-49ff-b4ec-092d326ddfb5 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:11:57.291103 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-44240162-c518-49ff-b4ec-092d326ddfb5 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:11:57.291747 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-44240162-c518-49ff-b4ec-092d326ddfb5 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:11:57.292679 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-44240162-c518-49ff-b4ec-092d326ddfb5 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:11:57.293150 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-44240162-c518-49ff-b4ec-092d326ddfb5 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:11:57.293591 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-44240162-c518-49ff-b4ec-092d326ddfb5 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:11:57.442144 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.policy [None req-44240162-c518-49ff-b4ec-092d326ddfb5 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0948754217fc4ff2ba0241fa35feaf90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1aaf20f480a423ea5feca81585aeeed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:11:57.450661 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.policy [None req-44240162-c518-49ff-b4ec-092d326ddfb5 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0948754217fc4ff2ba0241fa35feaf90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1aaf20f480a423ea5feca81585aeeed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:11:57.452118 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.policy [None req-44240162-c518-49ff-b4ec-092d326ddfb5 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0948754217fc4ff2ba0241fa35feaf90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1aaf20f480a423ea5feca81585aeeed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:11:57.453261 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [None req-44240162-c518-49ff-b4ec-092d326ddfb5 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] 10.222.0.50 "GET /compute/v2.1/servers/36f8e098-a4b5-40a4-8f49-f341c5ad940c" status: 200 len: 1731 microversion: 2.20 time: 0.175319 Sep 24 05:11:57.453846 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 592/1158] 10.222.0.50 () {60 vars in 1277 bytes} [Sat Sep 24 05:11:57 2022] GET /compute/v2.1/servers/36f8e098-a4b5-40a4-8f49-f341c5ad940c => generated 1731 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 05:11:57.465547 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-63e0dcfa-762d-4357-b75e-d264121a1adf tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Calling method '>' {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:11:57.466314 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.compute.api [None req-63e0dcfa-762d-4357-b75e-d264121a1adf tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] [instance: 459e75d4-67d0-437c-aad4-09523804e931] Fetching instance by UUID {{(pid=120593) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:11:57.472734 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-63e0dcfa-762d-4357-b75e-d264121a1adf tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:11:57.473208 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-63e0dcfa-762d-4357-b75e-d264121a1adf tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:11:57.473640 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-63e0dcfa-762d-4357-b75e-d264121a1adf tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:11:57.474360 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-63e0dcfa-762d-4357-b75e-d264121a1adf tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:11:57.475502 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-63e0dcfa-762d-4357-b75e-d264121a1adf tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:11:57.475930 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-63e0dcfa-762d-4357-b75e-d264121a1adf tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:11:57.640837 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-63e0dcfa-762d-4357-b75e-d264121a1adf tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74a8cc19ab204424ab23c62915ac2bab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87d5229e39fe4817b5187068d8acecc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:11:57.642088 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-63e0dcfa-762d-4357-b75e-d264121a1adf tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] 10.222.0.50 "GET /compute/v2.1/servers/459e75d4-67d0-437c-aad4-09523804e931" status: 200 len: 1366 microversion: 2.1 time: 0.180687 Sep 24 05:11:57.642664 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 567/1159] 10.222.0.50 () {58 vars in 1236 bytes} [Sat Sep 24 05:11:57 2022] GET /compute/v2.1/servers/459e75d4-67d0-437c-aad4-09523804e931 => generated 1366 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 05:11:58.483311 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-05d58a8d-0a0a-451a-bb42-72b5755f4690 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Calling method '>' {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:11:58.483887 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.compute.api [None req-05d58a8d-0a0a-451a-bb42-72b5755f4690 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] [instance: 36f8e098-a4b5-40a4-8f49-f341c5ad940c] Fetching instance by UUID {{(pid=120594) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:11:58.490810 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-05d58a8d-0a0a-451a-bb42-72b5755f4690 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:11:58.491273 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-05d58a8d-0a0a-451a-bb42-72b5755f4690 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:11:58.491697 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-05d58a8d-0a0a-451a-bb42-72b5755f4690 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:11:58.492367 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-05d58a8d-0a0a-451a-bb42-72b5755f4690 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:11:58.492810 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-05d58a8d-0a0a-451a-bb42-72b5755f4690 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:11:58.493221 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-05d58a8d-0a0a-451a-bb42-72b5755f4690 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:11:58.634821 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.policy [None req-05d58a8d-0a0a-451a-bb42-72b5755f4690 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0948754217fc4ff2ba0241fa35feaf90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1aaf20f480a423ea5feca81585aeeed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:11:58.642865 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.policy [None req-05d58a8d-0a0a-451a-bb42-72b5755f4690 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0948754217fc4ff2ba0241fa35feaf90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1aaf20f480a423ea5feca81585aeeed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:11:58.644293 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.policy [None req-05d58a8d-0a0a-451a-bb42-72b5755f4690 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0948754217fc4ff2ba0241fa35feaf90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1aaf20f480a423ea5feca81585aeeed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:11:58.645430 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [None req-05d58a8d-0a0a-451a-bb42-72b5755f4690 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] 10.222.0.50 "GET /compute/v2.1/servers/36f8e098-a4b5-40a4-8f49-f341c5ad940c" status: 200 len: 1731 microversion: 2.20 time: 0.166041 Sep 24 05:11:58.646113 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 593/1160] 10.222.0.50 () {60 vars in 1277 bytes} [Sat Sep 24 05:11:58 2022] GET /compute/v2.1/servers/36f8e098-a4b5-40a4-8f49-f341c5ad940c => generated 1731 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 05:11:58.673383 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-5fd1523f-4fff-4079-be8f-ad07162407e6 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Calling method '>' {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:11:58.674005 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.compute.api [None req-5fd1523f-4fff-4079-be8f-ad07162407e6 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] [instance: 459e75d4-67d0-437c-aad4-09523804e931] Fetching instance by UUID {{(pid=120593) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:11:58.681080 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-5fd1523f-4fff-4079-be8f-ad07162407e6 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:11:58.681555 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-5fd1523f-4fff-4079-be8f-ad07162407e6 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:11:58.681988 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-5fd1523f-4fff-4079-be8f-ad07162407e6 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:11:58.682698 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-5fd1523f-4fff-4079-be8f-ad07162407e6 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:11:58.683149 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-5fd1523f-4fff-4079-be8f-ad07162407e6 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:11:58.683572 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-5fd1523f-4fff-4079-be8f-ad07162407e6 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:11:58.822329 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-5fd1523f-4fff-4079-be8f-ad07162407e6 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74a8cc19ab204424ab23c62915ac2bab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87d5229e39fe4817b5187068d8acecc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:11:58.829972 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-5fd1523f-4fff-4079-be8f-ad07162407e6 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] 10.222.0.50 "GET /compute/v2.1/servers/459e75d4-67d0-437c-aad4-09523804e931" status: 200 len: 1366 microversion: 2.1 time: 0.160396 Sep 24 05:11:58.836894 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 568/1161] 10.222.0.50 () {58 vars in 1236 bytes} [Sat Sep 24 05:11:58 2022] GET /compute/v2.1/servers/459e75d4-67d0-437c-aad4-09523804e931 => generated 1366 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 05:11:59.672768 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-ece780b0-a430-42bb-9648-612a4a8b2966 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Calling method '>' {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:11:59.673505 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.compute.api [None req-ece780b0-a430-42bb-9648-612a4a8b2966 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] [instance: 36f8e098-a4b5-40a4-8f49-f341c5ad940c] Fetching instance by UUID {{(pid=120594) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:11:59.680983 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-ece780b0-a430-42bb-9648-612a4a8b2966 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:11:59.681468 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-ece780b0-a430-42bb-9648-612a4a8b2966 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:11:59.681913 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-ece780b0-a430-42bb-9648-612a4a8b2966 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:11:59.682649 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-ece780b0-a430-42bb-9648-612a4a8b2966 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:11:59.683102 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-ece780b0-a430-42bb-9648-612a4a8b2966 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:11:59.683526 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-ece780b0-a430-42bb-9648-612a4a8b2966 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:11:59.814516 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.policy [None req-ece780b0-a430-42bb-9648-612a4a8b2966 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0948754217fc4ff2ba0241fa35feaf90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1aaf20f480a423ea5feca81585aeeed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:11:59.823095 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.policy [None req-ece780b0-a430-42bb-9648-612a4a8b2966 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0948754217fc4ff2ba0241fa35feaf90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1aaf20f480a423ea5feca81585aeeed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:11:59.824555 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.policy [None req-ece780b0-a430-42bb-9648-612a4a8b2966 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0948754217fc4ff2ba0241fa35feaf90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1aaf20f480a423ea5feca81585aeeed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:11:59.825700 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [None req-ece780b0-a430-42bb-9648-612a4a8b2966 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] 10.222.0.50 "GET /compute/v2.1/servers/36f8e098-a4b5-40a4-8f49-f341c5ad940c" status: 200 len: 1731 microversion: 2.20 time: 0.156921 Sep 24 05:11:59.826295 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 594/1162] 10.222.0.50 () {60 vars in 1277 bytes} [Sat Sep 24 05:11:59 2022] GET /compute/v2.1/servers/36f8e098-a4b5-40a4-8f49-f341c5ad940c => generated 1731 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 05:11:59.852778 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-b12689dd-d492-41f5-a2ff-4cbe3abbd18a tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Calling method '>' {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:11:59.853404 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.compute.api [None req-b12689dd-d492-41f5-a2ff-4cbe3abbd18a tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] [instance: 459e75d4-67d0-437c-aad4-09523804e931] Fetching instance by UUID {{(pid=120593) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:11:59.860749 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-b12689dd-d492-41f5-a2ff-4cbe3abbd18a tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:11:59.861231 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-b12689dd-d492-41f5-a2ff-4cbe3abbd18a tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:11:59.861667 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-b12689dd-d492-41f5-a2ff-4cbe3abbd18a tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:11:59.862474 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-b12689dd-d492-41f5-a2ff-4cbe3abbd18a tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:11:59.862920 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-b12689dd-d492-41f5-a2ff-4cbe3abbd18a tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:11:59.863332 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-b12689dd-d492-41f5-a2ff-4cbe3abbd18a tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:11:59.996390 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-b12689dd-d492-41f5-a2ff-4cbe3abbd18a tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74a8cc19ab204424ab23c62915ac2bab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87d5229e39fe4817b5187068d8acecc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:11:59.998567 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG dbcounter [-] [120593] Writing DB stats nova_cell1:UPDATE=4,nova_cell1:INSERT=1,nova_cell1:SELECT=95 {{(pid=120593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 05:12:00.006796 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-b12689dd-d492-41f5-a2ff-4cbe3abbd18a tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] 10.222.0.50 "GET /compute/v2.1/servers/459e75d4-67d0-437c-aad4-09523804e931" status: 200 len: 1366 microversion: 2.1 time: 0.157182 Sep 24 05:12:00.007374 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 569/1163] 10.222.0.50 () {58 vars in 1236 bytes} [Sat Sep 24 05:11:59 2022] GET /compute/v2.1/servers/459e75d4-67d0-437c-aad4-09523804e931 => generated 1366 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 05:12:00.862595 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-fae121ee-bcfe-4f4e-8f33-bc628064bc2c tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Calling method '>' {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:12:00.863228 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.compute.api [None req-fae121ee-bcfe-4f4e-8f33-bc628064bc2c tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] [instance: 36f8e098-a4b5-40a4-8f49-f341c5ad940c] Fetching instance by UUID {{(pid=120594) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:12:00.869658 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-fae121ee-bcfe-4f4e-8f33-bc628064bc2c tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:12:00.870163 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-fae121ee-bcfe-4f4e-8f33-bc628064bc2c tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:12:00.870599 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-fae121ee-bcfe-4f4e-8f33-bc628064bc2c tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:12:00.871284 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-fae121ee-bcfe-4f4e-8f33-bc628064bc2c tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:12:00.871726 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-fae121ee-bcfe-4f4e-8f33-bc628064bc2c tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:12:00.872143 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-fae121ee-bcfe-4f4e-8f33-bc628064bc2c tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:12:01.015946 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.policy [None req-fae121ee-bcfe-4f4e-8f33-bc628064bc2c tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0948754217fc4ff2ba0241fa35feaf90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1aaf20f480a423ea5feca81585aeeed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:12:01.026137 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.policy [None req-fae121ee-bcfe-4f4e-8f33-bc628064bc2c tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0948754217fc4ff2ba0241fa35feaf90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1aaf20f480a423ea5feca81585aeeed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:12:01.028047 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.policy [None req-fae121ee-bcfe-4f4e-8f33-bc628064bc2c tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0948754217fc4ff2ba0241fa35feaf90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1aaf20f480a423ea5feca81585aeeed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:12:01.028622 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-49c4b3d0-5123-4c9d-ae08-c27c90fb5128 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Calling method '>' {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:12:01.029208 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [None req-fae121ee-bcfe-4f4e-8f33-bc628064bc2c tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] 10.222.0.50 "GET /compute/v2.1/servers/36f8e098-a4b5-40a4-8f49-f341c5ad940c" status: 200 len: 1731 microversion: 2.20 time: 0.170824 Sep 24 05:12:01.029332 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.compute.api [None req-49c4b3d0-5123-4c9d-ae08-c27c90fb5128 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] [instance: 459e75d4-67d0-437c-aad4-09523804e931] Fetching instance by UUID {{(pid=120593) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:12:01.029962 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 595/1164] 10.222.0.50 () {60 vars in 1277 bytes} [Sat Sep 24 05:12:00 2022] GET /compute/v2.1/servers/36f8e098-a4b5-40a4-8f49-f341c5ad940c => generated 1731 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 05:12:01.037769 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-49c4b3d0-5123-4c9d-ae08-c27c90fb5128 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:12:01.038280 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-49c4b3d0-5123-4c9d-ae08-c27c90fb5128 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:12:01.038715 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-49c4b3d0-5123-4c9d-ae08-c27c90fb5128 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:12:01.039414 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-49c4b3d0-5123-4c9d-ae08-c27c90fb5128 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:12:01.039901 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-49c4b3d0-5123-4c9d-ae08-c27c90fb5128 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:12:01.040323 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-49c4b3d0-5123-4c9d-ae08-c27c90fb5128 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:12:01.170046 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-49c4b3d0-5123-4c9d-ae08-c27c90fb5128 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74a8cc19ab204424ab23c62915ac2bab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87d5229e39fe4817b5187068d8acecc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:12:01.178602 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-49c4b3d0-5123-4c9d-ae08-c27c90fb5128 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] 10.222.0.50 "GET /compute/v2.1/servers/459e75d4-67d0-437c-aad4-09523804e931" status: 200 len: 1366 microversion: 2.1 time: 0.153747 Sep 24 05:12:01.179160 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 570/1165] 10.222.0.50 () {58 vars in 1236 bytes} [Sat Sep 24 05:12:01 2022] GET /compute/v2.1/servers/459e75d4-67d0-437c-aad4-09523804e931 => generated 1366 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 24 05:12:02.055017 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-66460bea-0ef6-4105-8ec9-2c7bbdc9062b tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Calling method '>' {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:12:02.055632 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.compute.api [None req-66460bea-0ef6-4105-8ec9-2c7bbdc9062b tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] [instance: 36f8e098-a4b5-40a4-8f49-f341c5ad940c] Fetching instance by UUID {{(pid=120594) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:12:02.062103 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-66460bea-0ef6-4105-8ec9-2c7bbdc9062b tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:12:02.062584 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-66460bea-0ef6-4105-8ec9-2c7bbdc9062b tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:12:02.063022 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-66460bea-0ef6-4105-8ec9-2c7bbdc9062b tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:12:02.063714 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-66460bea-0ef6-4105-8ec9-2c7bbdc9062b tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:12:02.064165 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-66460bea-0ef6-4105-8ec9-2c7bbdc9062b tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:12:02.064590 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-66460bea-0ef6-4105-8ec9-2c7bbdc9062b tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:12:02.190131 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.policy [None req-66460bea-0ef6-4105-8ec9-2c7bbdc9062b tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0948754217fc4ff2ba0241fa35feaf90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1aaf20f480a423ea5feca81585aeeed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:12:02.198238 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.policy [None req-66460bea-0ef6-4105-8ec9-2c7bbdc9062b tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0948754217fc4ff2ba0241fa35feaf90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1aaf20f480a423ea5feca81585aeeed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:12:02.199693 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.policy [None req-66460bea-0ef6-4105-8ec9-2c7bbdc9062b tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0948754217fc4ff2ba0241fa35feaf90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1aaf20f480a423ea5feca81585aeeed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:12:02.200857 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [None req-66460bea-0ef6-4105-8ec9-2c7bbdc9062b tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] 10.222.0.50 "GET /compute/v2.1/servers/36f8e098-a4b5-40a4-8f49-f341c5ad940c" status: 200 len: 1731 microversion: 2.20 time: 0.149741 Sep 24 05:12:02.201414 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 596/1166] 10.222.0.50 () {60 vars in 1277 bytes} [Sat Sep 24 05:12:02 2022] GET /compute/v2.1/servers/36f8e098-a4b5-40a4-8f49-f341c5ad940c => generated 1731 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 24 05:12:02.201522 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-4423c982-e0d2-4acd-8d91-869cf23a9e6e tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Calling method '>' {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:12:02.202149 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.compute.api [None req-4423c982-e0d2-4acd-8d91-869cf23a9e6e tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] [instance: 459e75d4-67d0-437c-aad4-09523804e931] Fetching instance by UUID {{(pid=120593) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:12:02.208646 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-4423c982-e0d2-4acd-8d91-869cf23a9e6e tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:12:02.209606 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-4423c982-e0d2-4acd-8d91-869cf23a9e6e tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:12:02.210056 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-4423c982-e0d2-4acd-8d91-869cf23a9e6e tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:12:02.210745 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-4423c982-e0d2-4acd-8d91-869cf23a9e6e tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:12:02.211191 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-4423c982-e0d2-4acd-8d91-869cf23a9e6e tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:12:02.211610 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-4423c982-e0d2-4acd-8d91-869cf23a9e6e tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:12:02.346808 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-4423c982-e0d2-4acd-8d91-869cf23a9e6e tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74a8cc19ab204424ab23c62915ac2bab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87d5229e39fe4817b5187068d8acecc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:12:02.354362 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-4423c982-e0d2-4acd-8d91-869cf23a9e6e tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] 10.222.0.50 "GET /compute/v2.1/servers/459e75d4-67d0-437c-aad4-09523804e931" status: 200 len: 1366 microversion: 2.1 time: 0.156641 Sep 24 05:12:02.354922 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 571/1167] 10.222.0.50 () {58 vars in 1236 bytes} [Sat Sep 24 05:12:02 2022] GET /compute/v2.1/servers/459e75d4-67d0-437c-aad4-09523804e931 => generated 1366 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 24 05:12:03.226688 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-28cea861-80ca-477b-b32f-cac2ed5091f9 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Calling method '>' {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:12:03.227324 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.compute.api [None req-28cea861-80ca-477b-b32f-cac2ed5091f9 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] [instance: 36f8e098-a4b5-40a4-8f49-f341c5ad940c] Fetching instance by UUID {{(pid=120594) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:12:03.233734 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-28cea861-80ca-477b-b32f-cac2ed5091f9 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:12:03.234244 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-28cea861-80ca-477b-b32f-cac2ed5091f9 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:12:03.234680 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-28cea861-80ca-477b-b32f-cac2ed5091f9 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:12:03.235361 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-28cea861-80ca-477b-b32f-cac2ed5091f9 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:12:03.235807 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-28cea861-80ca-477b-b32f-cac2ed5091f9 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:12:03.236222 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-28cea861-80ca-477b-b32f-cac2ed5091f9 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:12:03.360466 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.policy [None req-28cea861-80ca-477b-b32f-cac2ed5091f9 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0948754217fc4ff2ba0241fa35feaf90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1aaf20f480a423ea5feca81585aeeed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:12:03.363855 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG dbcounter [-] [120594] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=120594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 05:12:03.370598 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.policy [None req-28cea861-80ca-477b-b32f-cac2ed5091f9 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0948754217fc4ff2ba0241fa35feaf90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1aaf20f480a423ea5feca81585aeeed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:12:03.372085 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.policy [None req-28cea861-80ca-477b-b32f-cac2ed5091f9 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0948754217fc4ff2ba0241fa35feaf90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1aaf20f480a423ea5feca81585aeeed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:12:03.373240 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [None req-28cea861-80ca-477b-b32f-cac2ed5091f9 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] 10.222.0.50 "GET /compute/v2.1/servers/36f8e098-a4b5-40a4-8f49-f341c5ad940c" status: 200 len: 1731 microversion: 2.20 time: 0.151027 Sep 24 05:12:03.373797 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 597/1168] 10.222.0.50 () {60 vars in 1277 bytes} [Sat Sep 24 05:12:03 2022] GET /compute/v2.1/servers/36f8e098-a4b5-40a4-8f49-f341c5ad940c => generated 1731 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 05:12:03.376666 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-f05f677e-1e21-4e02-9590-1abbac0dbaa8 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Calling method '>' {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:12:03.377272 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.compute.api [None req-f05f677e-1e21-4e02-9590-1abbac0dbaa8 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] [instance: 459e75d4-67d0-437c-aad4-09523804e931] Fetching instance by UUID {{(pid=120593) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:12:03.383704 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-f05f677e-1e21-4e02-9590-1abbac0dbaa8 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:12:03.384176 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-f05f677e-1e21-4e02-9590-1abbac0dbaa8 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:12:03.384608 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-f05f677e-1e21-4e02-9590-1abbac0dbaa8 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:12:03.385288 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-f05f677e-1e21-4e02-9590-1abbac0dbaa8 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:12:03.385733 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-f05f677e-1e21-4e02-9590-1abbac0dbaa8 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:12:03.386208 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-f05f677e-1e21-4e02-9590-1abbac0dbaa8 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:12:03.513642 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-f05f677e-1e21-4e02-9590-1abbac0dbaa8 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74a8cc19ab204424ab23c62915ac2bab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87d5229e39fe4817b5187068d8acecc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:12:03.521671 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-f05f677e-1e21-4e02-9590-1abbac0dbaa8 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] 10.222.0.50 "GET /compute/v2.1/servers/459e75d4-67d0-437c-aad4-09523804e931" status: 200 len: 1366 microversion: 2.1 time: 0.148356 Sep 24 05:12:03.522280 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 572/1169] 10.222.0.50 () {58 vars in 1236 bytes} [Sat Sep 24 05:12:03 2022] GET /compute/v2.1/servers/459e75d4-67d0-437c-aad4-09523804e931 => generated 1366 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 24 05:12:04.398976 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-505557b1-dd2f-4e58-bb47-873746e55b87 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Calling method '>' {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:12:04.399602 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.compute.api [None req-505557b1-dd2f-4e58-bb47-873746e55b87 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] [instance: 36f8e098-a4b5-40a4-8f49-f341c5ad940c] Fetching instance by UUID {{(pid=120594) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:12:04.406190 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-505557b1-dd2f-4e58-bb47-873746e55b87 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:12:04.406666 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-505557b1-dd2f-4e58-bb47-873746e55b87 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:12:04.407097 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-505557b1-dd2f-4e58-bb47-873746e55b87 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:12:04.407771 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-505557b1-dd2f-4e58-bb47-873746e55b87 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:12:04.408252 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-505557b1-dd2f-4e58-bb47-873746e55b87 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:12:04.408921 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-505557b1-dd2f-4e58-bb47-873746e55b87 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:12:04.536001 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.policy [None req-505557b1-dd2f-4e58-bb47-873746e55b87 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0948754217fc4ff2ba0241fa35feaf90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1aaf20f480a423ea5feca81585aeeed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:12:04.544191 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.policy [None req-505557b1-dd2f-4e58-bb47-873746e55b87 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0948754217fc4ff2ba0241fa35feaf90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1aaf20f480a423ea5feca81585aeeed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:12:04.544434 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-c29896e1-d38d-4922-973f-709197335c81 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Calling method '>' {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:12:04.545053 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.compute.api [None req-c29896e1-d38d-4922-973f-709197335c81 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] [instance: 459e75d4-67d0-437c-aad4-09523804e931] Fetching instance by UUID {{(pid=120593) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:12:04.545627 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.policy [None req-505557b1-dd2f-4e58-bb47-873746e55b87 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0948754217fc4ff2ba0241fa35feaf90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1aaf20f480a423ea5feca81585aeeed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:12:04.546803 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [None req-505557b1-dd2f-4e58-bb47-873746e55b87 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] 10.222.0.50 "GET /compute/v2.1/servers/36f8e098-a4b5-40a4-8f49-f341c5ad940c" status: 200 len: 1731 microversion: 2.20 time: 0.152632 Sep 24 05:12:04.547356 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 598/1170] 10.222.0.50 () {60 vars in 1277 bytes} [Sat Sep 24 05:12:04 2022] GET /compute/v2.1/servers/36f8e098-a4b5-40a4-8f49-f341c5ad940c => generated 1731 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 05:12:04.551639 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-c29896e1-d38d-4922-973f-709197335c81 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:12:04.552123 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-c29896e1-d38d-4922-973f-709197335c81 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:12:04.552565 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-c29896e1-d38d-4922-973f-709197335c81 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:12:04.553262 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-c29896e1-d38d-4922-973f-709197335c81 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:12:04.553720 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-c29896e1-d38d-4922-973f-709197335c81 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:12:04.554184 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-c29896e1-d38d-4922-973f-709197335c81 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:12:04.688239 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-c29896e1-d38d-4922-973f-709197335c81 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74a8cc19ab204424ab23c62915ac2bab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87d5229e39fe4817b5187068d8acecc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:12:04.696590 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-c29896e1-d38d-4922-973f-709197335c81 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] 10.222.0.50 "GET /compute/v2.1/servers/459e75d4-67d0-437c-aad4-09523804e931" status: 200 len: 1366 microversion: 2.1 time: 0.155962 Sep 24 05:12:04.711052 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 573/1171] 10.222.0.50 () {58 vars in 1236 bytes} [Sat Sep 24 05:12:04 2022] GET /compute/v2.1/servers/459e75d4-67d0-437c-aad4-09523804e931 => generated 1366 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 24 05:12:05.571909 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-e72c958b-bfa7-4725-b719-37cde88b5489 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Calling method '>' {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:12:05.572508 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.compute.api [None req-e72c958b-bfa7-4725-b719-37cde88b5489 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] [instance: 36f8e098-a4b5-40a4-8f49-f341c5ad940c] Fetching instance by UUID {{(pid=120594) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:12:05.578852 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-e72c958b-bfa7-4725-b719-37cde88b5489 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:12:05.579324 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-e72c958b-bfa7-4725-b719-37cde88b5489 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:12:05.579749 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-e72c958b-bfa7-4725-b719-37cde88b5489 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:12:05.580432 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-e72c958b-bfa7-4725-b719-37cde88b5489 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:12:05.580872 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-e72c958b-bfa7-4725-b719-37cde88b5489 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:12:05.581283 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-e72c958b-bfa7-4725-b719-37cde88b5489 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:12:05.708317 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.policy [None req-e72c958b-bfa7-4725-b719-37cde88b5489 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0948754217fc4ff2ba0241fa35feaf90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1aaf20f480a423ea5feca81585aeeed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:12:05.716559 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.policy [None req-e72c958b-bfa7-4725-b719-37cde88b5489 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0948754217fc4ff2ba0241fa35feaf90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1aaf20f480a423ea5feca81585aeeed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:12:05.718090 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.policy [None req-e72c958b-bfa7-4725-b719-37cde88b5489 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0948754217fc4ff2ba0241fa35feaf90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1aaf20f480a423ea5feca81585aeeed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:12:05.719154 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [None req-e72c958b-bfa7-4725-b719-37cde88b5489 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] 10.222.0.50 "GET /compute/v2.1/servers/36f8e098-a4b5-40a4-8f49-f341c5ad940c" status: 200 len: 1731 microversion: 2.20 time: 0.151651 Sep 24 05:12:05.719708 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 599/1172] 10.222.0.50 () {60 vars in 1277 bytes} [Sat Sep 24 05:12:05 2022] GET /compute/v2.1/servers/36f8e098-a4b5-40a4-8f49-f341c5ad940c => generated 1731 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 05:12:05.724072 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-26317d38-fb88-47ee-a1c0-94a70a9ffb8e tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Calling method '>' {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:12:05.724662 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.compute.api [None req-26317d38-fb88-47ee-a1c0-94a70a9ffb8e tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] [instance: 459e75d4-67d0-437c-aad4-09523804e931] Fetching instance by UUID {{(pid=120594) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:12:05.730591 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-26317d38-fb88-47ee-a1c0-94a70a9ffb8e tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:12:05.731141 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-26317d38-fb88-47ee-a1c0-94a70a9ffb8e tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:12:05.731669 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-26317d38-fb88-47ee-a1c0-94a70a9ffb8e tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:12:05.732356 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-26317d38-fb88-47ee-a1c0-94a70a9ffb8e tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:12:05.732805 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-26317d38-fb88-47ee-a1c0-94a70a9ffb8e tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:12:05.733218 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-26317d38-fb88-47ee-a1c0-94a70a9ffb8e tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:12:05.825113 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-39e4d29b-7296-4708-b856-1d8f3023cb5a tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Calling method '>' {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:12:05.825632 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.compute.api [None req-39e4d29b-7296-4708-b856-1d8f3023cb5a tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] [instance: b551478f-d1dc-4ab3-9e44-4e78b785b21f] Fetching instance by UUID {{(pid=120593) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:12:05.831446 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-39e4d29b-7296-4708-b856-1d8f3023cb5a tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:12:05.831918 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-39e4d29b-7296-4708-b856-1d8f3023cb5a tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:12:05.832346 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-39e4d29b-7296-4708-b856-1d8f3023cb5a tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:12:05.833029 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-39e4d29b-7296-4708-b856-1d8f3023cb5a tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:12:05.833477 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-39e4d29b-7296-4708-b856-1d8f3023cb5a tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:12:05.833895 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-39e4d29b-7296-4708-b856-1d8f3023cb5a tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:12:05.856598 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-39e4d29b-7296-4708-b856-1d8f3023cb5a tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] 10.222.0.50 "GET /compute/v2.1/servers/b551478f-d1dc-4ab3-9e44-4e78b785b21f/ips" status: 200 len: 144 microversion: 2.1 time: 0.179229 Sep 24 05:12:05.857162 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 574/1173] 10.222.0.50 () {58 vars in 1248 bytes} [Sat Sep 24 05:12:05 2022] GET /compute/v2.1/servers/b551478f-d1dc-4ab3-9e44-4e78b785b21f/ips => generated 144 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 24 05:12:05.862375 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.policy [None req-26317d38-fb88-47ee-a1c0-94a70a9ffb8e tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74a8cc19ab204424ab23c62915ac2bab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87d5229e39fe4817b5187068d8acecc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:12:05.870737 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [None req-26317d38-fb88-47ee-a1c0-94a70a9ffb8e tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] 10.222.0.50 "GET /compute/v2.1/servers/459e75d4-67d0-437c-aad4-09523804e931" status: 200 len: 1366 microversion: 2.1 time: 0.150082 Sep 24 05:12:05.871301 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 600/1174] 10.222.0.50 () {58 vars in 1236 bytes} [Sat Sep 24 05:12:05 2022] GET /compute/v2.1/servers/459e75d4-67d0-437c-aad4-09523804e931 => generated 1366 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 05:12:06.744460 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-473738b7-1733-42e5-ae3b-25cb027ed154 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Calling method '>' {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:12:06.745069 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.compute.api [None req-473738b7-1733-42e5-ae3b-25cb027ed154 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] [instance: 36f8e098-a4b5-40a4-8f49-f341c5ad940c] Fetching instance by UUID {{(pid=120593) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:12:06.751413 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-473738b7-1733-42e5-ae3b-25cb027ed154 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:12:06.751893 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-473738b7-1733-42e5-ae3b-25cb027ed154 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:12:06.752326 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-473738b7-1733-42e5-ae3b-25cb027ed154 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:12:06.753046 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-473738b7-1733-42e5-ae3b-25cb027ed154 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:12:06.753494 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-473738b7-1733-42e5-ae3b-25cb027ed154 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:12:06.753919 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-473738b7-1733-42e5-ae3b-25cb027ed154 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:12:06.883146 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-473738b7-1733-42e5-ae3b-25cb027ed154 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0948754217fc4ff2ba0241fa35feaf90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1aaf20f480a423ea5feca81585aeeed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:12:06.891306 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-473738b7-1733-42e5-ae3b-25cb027ed154 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0948754217fc4ff2ba0241fa35feaf90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1aaf20f480a423ea5feca81585aeeed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:12:06.892748 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-473738b7-1733-42e5-ae3b-25cb027ed154 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0948754217fc4ff2ba0241fa35feaf90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1aaf20f480a423ea5feca81585aeeed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:12:06.893717 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-0698eec0-1857-4559-a1de-d559c05e0d93 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Calling method '>' {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:12:06.894151 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-473738b7-1733-42e5-ae3b-25cb027ed154 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] 10.222.0.50 "GET /compute/v2.1/servers/36f8e098-a4b5-40a4-8f49-f341c5ad940c" status: 200 len: 1731 microversion: 2.20 time: 0.153921 Sep 24 05:12:06.894346 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.compute.api [None req-0698eec0-1857-4559-a1de-d559c05e0d93 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] [instance: 459e75d4-67d0-437c-aad4-09523804e931] Fetching instance by UUID {{(pid=120594) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:12:06.894721 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 575/1175] 10.222.0.50 () {60 vars in 1277 bytes} [Sat Sep 24 05:12:06 2022] GET /compute/v2.1/servers/36f8e098-a4b5-40a4-8f49-f341c5ad940c => generated 1731 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 05:12:06.901406 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-0698eec0-1857-4559-a1de-d559c05e0d93 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:12:06.901874 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-0698eec0-1857-4559-a1de-d559c05e0d93 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:12:06.902327 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-0698eec0-1857-4559-a1de-d559c05e0d93 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:12:06.903008 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-0698eec0-1857-4559-a1de-d559c05e0d93 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:12:06.903454 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-0698eec0-1857-4559-a1de-d559c05e0d93 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:12:06.903869 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-0698eec0-1857-4559-a1de-d559c05e0d93 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:12:07.032988 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.policy [None req-0698eec0-1857-4559-a1de-d559c05e0d93 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74a8cc19ab204424ab23c62915ac2bab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87d5229e39fe4817b5187068d8acecc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:12:07.044137 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [None req-0698eec0-1857-4559-a1de-d559c05e0d93 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] 10.222.0.50 "GET /compute/v2.1/servers/459e75d4-67d0-437c-aad4-09523804e931" status: 200 len: 1366 microversion: 2.1 time: 0.154135 Sep 24 05:12:07.044712 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 601/1176] 10.222.0.50 () {58 vars in 1236 bytes} [Sat Sep 24 05:12:06 2022] GET /compute/v2.1/servers/459e75d4-67d0-437c-aad4-09523804e931 => generated 1366 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 24 05:12:07.181410 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-17b7d4eb-2954-4d26-bd36-cd0e3b052a2b tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "066d4508-e90f-4bff-8aef-78f09133cf68"}} {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 05:12:07.183887 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.compute.api [None req-17b7d4eb-2954-4d26-bd36-cd0e3b052a2b tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] [instance: b551478f-d1dc-4ab3-9e44-4e78b785b21f] Fetching instance by UUID {{(pid=120593) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:12:07.189766 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-17b7d4eb-2954-4d26-bd36-cd0e3b052a2b tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:12:07.190280 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-17b7d4eb-2954-4d26-bd36-cd0e3b052a2b tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:12:07.190715 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-17b7d4eb-2954-4d26-bd36-cd0e3b052a2b tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:12:07.191397 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-17b7d4eb-2954-4d26-bd36-cd0e3b052a2b tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:12:07.191848 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-17b7d4eb-2954-4d26-bd36-cd0e3b052a2b tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:12:07.192269 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-17b7d4eb-2954-4d26-bd36-cd0e3b052a2b tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:12:07.853970 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-17b7d4eb-2954-4d26-bd36-cd0e3b052a2b tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] 10.222.0.50 "POST /compute/v2.1/servers/b551478f-d1dc-4ab3-9e44-4e78b785b21f/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.676284 Sep 24 05:12:07.854641 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 576/1177] 10.222.0.50 () {60 vars in 1323 bytes} [Sat Sep 24 05:12:07 2022] POST /compute/v2.1/servers/b551478f-d1dc-4ab3-9e44-4e78b785b21f/os-volume_attachments => generated 194 bytes in 678 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 05:12:07.921005 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-834f6bbf-4358-4dbe-a3de-09a239e8db79 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Calling method '>' {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:12:07.921594 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.compute.api [None req-834f6bbf-4358-4dbe-a3de-09a239e8db79 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] [instance: 36f8e098-a4b5-40a4-8f49-f341c5ad940c] Fetching instance by UUID {{(pid=120594) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:12:07.929559 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-834f6bbf-4358-4dbe-a3de-09a239e8db79 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:12:07.930380 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-834f6bbf-4358-4dbe-a3de-09a239e8db79 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:12:07.930846 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-834f6bbf-4358-4dbe-a3de-09a239e8db79 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:12:07.931667 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-834f6bbf-4358-4dbe-a3de-09a239e8db79 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:12:07.931974 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-834f6bbf-4358-4dbe-a3de-09a239e8db79 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:12:07.932964 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-834f6bbf-4358-4dbe-a3de-09a239e8db79 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:12:08.060395 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.policy [None req-834f6bbf-4358-4dbe-a3de-09a239e8db79 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0948754217fc4ff2ba0241fa35feaf90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1aaf20f480a423ea5feca81585aeeed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:12:08.067914 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-09adc8ac-33f4-4bbe-8d88-96743a0ba132 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Calling method '>' {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:12:08.068717 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.compute.api [None req-09adc8ac-33f4-4bbe-8d88-96743a0ba132 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] [instance: 459e75d4-67d0-437c-aad4-09523804e931] Fetching instance by UUID {{(pid=120593) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:12:08.070727 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.policy [None req-834f6bbf-4358-4dbe-a3de-09a239e8db79 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0948754217fc4ff2ba0241fa35feaf90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1aaf20f480a423ea5feca81585aeeed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:12:08.072179 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.policy [None req-834f6bbf-4358-4dbe-a3de-09a239e8db79 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0948754217fc4ff2ba0241fa35feaf90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1aaf20f480a423ea5feca81585aeeed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:12:08.073332 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [None req-834f6bbf-4358-4dbe-a3de-09a239e8db79 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] 10.222.0.50 "GET /compute/v2.1/servers/36f8e098-a4b5-40a4-8f49-f341c5ad940c" status: 200 len: 1731 microversion: 2.20 time: 0.156587 Sep 24 05:12:08.073894 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 602/1178] 10.222.0.50 () {60 vars in 1277 bytes} [Sat Sep 24 05:12:07 2022] GET /compute/v2.1/servers/36f8e098-a4b5-40a4-8f49-f341c5ad940c => generated 1731 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 05:12:08.078781 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-09adc8ac-33f4-4bbe-8d88-96743a0ba132 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:12:08.079321 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-09adc8ac-33f4-4bbe-8d88-96743a0ba132 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:12:08.079755 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-09adc8ac-33f4-4bbe-8d88-96743a0ba132 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:12:08.080454 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-09adc8ac-33f4-4bbe-8d88-96743a0ba132 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:12:08.080925 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-09adc8ac-33f4-4bbe-8d88-96743a0ba132 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:12:08.081345 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-09adc8ac-33f4-4bbe-8d88-96743a0ba132 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:12:08.213488 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-09adc8ac-33f4-4bbe-8d88-96743a0ba132 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74a8cc19ab204424ab23c62915ac2bab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87d5229e39fe4817b5187068d8acecc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:12:08.221121 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-09adc8ac-33f4-4bbe-8d88-96743a0ba132 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] 10.222.0.50 "GET /compute/v2.1/servers/459e75d4-67d0-437c-aad4-09523804e931" status: 200 len: 1366 microversion: 2.1 time: 0.157529 Sep 24 05:12:08.221678 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 577/1179] 10.222.0.50 () {58 vars in 1236 bytes} [Sat Sep 24 05:12:08 2022] GET /compute/v2.1/servers/459e75d4-67d0-437c-aad4-09523804e931 => generated 1366 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 05:12:09.098740 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-a6d46b72-0a78-4b93-8aae-d3722e4f742f tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Calling method '>' {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:12:09.099337 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.compute.api [None req-a6d46b72-0a78-4b93-8aae-d3722e4f742f tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] [instance: 36f8e098-a4b5-40a4-8f49-f341c5ad940c] Fetching instance by UUID {{(pid=120594) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:12:09.105220 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-a6d46b72-0a78-4b93-8aae-d3722e4f742f tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:12:09.105699 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-a6d46b72-0a78-4b93-8aae-d3722e4f742f tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:12:09.106165 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-a6d46b72-0a78-4b93-8aae-d3722e4f742f tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:12:09.106849 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-a6d46b72-0a78-4b93-8aae-d3722e4f742f tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:12:09.107300 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-a6d46b72-0a78-4b93-8aae-d3722e4f742f tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:12:09.107726 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-a6d46b72-0a78-4b93-8aae-d3722e4f742f tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:12:09.244933 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-c0611f3d-169e-4a9d-8f04-3e7961cfa5f9 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Calling method '>' {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:12:09.245578 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.compute.api [None req-c0611f3d-169e-4a9d-8f04-3e7961cfa5f9 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] [instance: 459e75d4-67d0-437c-aad4-09523804e931] Fetching instance by UUID {{(pid=120593) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:12:09.252001 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-c0611f3d-169e-4a9d-8f04-3e7961cfa5f9 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:12:09.252479 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-c0611f3d-169e-4a9d-8f04-3e7961cfa5f9 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:12:09.252913 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-c0611f3d-169e-4a9d-8f04-3e7961cfa5f9 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:12:09.253602 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-c0611f3d-169e-4a9d-8f04-3e7961cfa5f9 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:12:09.254076 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-c0611f3d-169e-4a9d-8f04-3e7961cfa5f9 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:12:09.254503 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-c0611f3d-169e-4a9d-8f04-3e7961cfa5f9 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:12:09.501047 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.policy [None req-a6d46b72-0a78-4b93-8aae-d3722e4f742f tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0948754217fc4ff2ba0241fa35feaf90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1aaf20f480a423ea5feca81585aeeed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:12:09.509921 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.policy [None req-a6d46b72-0a78-4b93-8aae-d3722e4f742f tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0948754217fc4ff2ba0241fa35feaf90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1aaf20f480a423ea5feca81585aeeed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:12:09.511373 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.policy [None req-a6d46b72-0a78-4b93-8aae-d3722e4f742f tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0948754217fc4ff2ba0241fa35feaf90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1aaf20f480a423ea5feca81585aeeed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:12:09.512517 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [None req-a6d46b72-0a78-4b93-8aae-d3722e4f742f tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] 10.222.0.50 "GET /compute/v2.1/servers/36f8e098-a4b5-40a4-8f49-f341c5ad940c" status: 200 len: 1731 microversion: 2.20 time: 0.417993 Sep 24 05:12:09.513075 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 603/1180] 10.222.0.50 () {60 vars in 1277 bytes} [Sat Sep 24 05:12:09 2022] GET /compute/v2.1/servers/36f8e098-a4b5-40a4-8f49-f341c5ad940c => generated 1731 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 05:12:09.608531 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-c0611f3d-169e-4a9d-8f04-3e7961cfa5f9 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74a8cc19ab204424ab23c62915ac2bab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87d5229e39fe4817b5187068d8acecc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:12:09.616990 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-c0611f3d-169e-4a9d-8f04-3e7961cfa5f9 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] 10.222.0.50 "GET /compute/v2.1/servers/459e75d4-67d0-437c-aad4-09523804e931" status: 200 len: 1366 microversion: 2.1 time: 0.375953 Sep 24 05:12:09.617562 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 578/1181] 10.222.0.50 () {58 vars in 1236 bytes} [Sat Sep 24 05:12:09 2022] GET /compute/v2.1/servers/459e75d4-67d0-437c-aad4-09523804e931 => generated 1366 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 24 05:12:10.316387 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [req-3efaa3f0-35da-4b13-9603-241c7a8aee89 req-5c972b0e-1e18-4cea-ac1c-0f02b960730f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "36f8e098-a4b5-40a4-8f49-f341c5ad940c", "name": "network-vif-plugged", "status": "completed", "tag": "e1514bf0-06bf-454f-bb1a-b1c69713927f"}]} {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 05:12:10.326694 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [req-3efaa3f0-35da-4b13-9603-241c7a8aee89 req-5c972b0e-1e18-4cea-ac1c-0f02b960730f service nova] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:12:10.327205 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [req-3efaa3f0-35da-4b13-9603-241c7a8aee89 req-5c972b0e-1e18-4cea-ac1c-0f02b960730f service nova] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:12:10.327642 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [req-3efaa3f0-35da-4b13-9603-241c7a8aee89 req-5c972b0e-1e18-4cea-ac1c-0f02b960730f service nova] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:12:10.339502 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: INFO nova.api.openstack.compute.server_external_events [req-3efaa3f0-35da-4b13-9603-241c7a8aee89 req-5c972b0e-1e18-4cea-ac1c-0f02b960730f service nova] Creating event network-vif-plugged:e1514bf0-06bf-454f-bb1a-b1c69713927f for instance 36f8e098-a4b5-40a4-8f49-f341c5ad940c on hv-cinder-85918 Sep 24 05:12:10.344441 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [req-3efaa3f0-35da-4b13-9603-241c7a8aee89 req-5c972b0e-1e18-4cea-ac1c-0f02b960730f service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031823 Sep 24 05:12:10.345036 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 604/1182] 10.222.0.50 () {64 vars in 1317 bytes} [Sat Sep 24 05:12:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 05:12:10.538867 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-22fa4567-8707-4e89-90bd-3d62bf02e27c tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Calling method '>' {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:12:10.539406 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.compute.api [None req-22fa4567-8707-4e89-90bd-3d62bf02e27c tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] [instance: 36f8e098-a4b5-40a4-8f49-f341c5ad940c] Fetching instance by UUID {{(pid=120593) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:12:10.545789 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-22fa4567-8707-4e89-90bd-3d62bf02e27c tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:12:10.546310 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-22fa4567-8707-4e89-90bd-3d62bf02e27c tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:12:10.546957 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-22fa4567-8707-4e89-90bd-3d62bf02e27c tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:12:10.547659 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-22fa4567-8707-4e89-90bd-3d62bf02e27c tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:12:10.548286 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-22fa4567-8707-4e89-90bd-3d62bf02e27c tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:12:10.548716 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-22fa4567-8707-4e89-90bd-3d62bf02e27c tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:12:10.641214 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-bb6b123b-8b5c-4162-bd4c-3e7aada309a3 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Calling method '>' {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:12:10.641911 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.compute.api [None req-bb6b123b-8b5c-4162-bd4c-3e7aada309a3 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] [instance: 459e75d4-67d0-437c-aad4-09523804e931] Fetching instance by UUID {{(pid=120594) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:12:10.649334 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-bb6b123b-8b5c-4162-bd4c-3e7aada309a3 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:12:10.650170 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-bb6b123b-8b5c-4162-bd4c-3e7aada309a3 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:12:10.650887 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-bb6b123b-8b5c-4162-bd4c-3e7aada309a3 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:12:10.652681 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-bb6b123b-8b5c-4162-bd4c-3e7aada309a3 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:12:10.653301 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-bb6b123b-8b5c-4162-bd4c-3e7aada309a3 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:12:10.654095 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-bb6b123b-8b5c-4162-bd4c-3e7aada309a3 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:12:10.771854 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-22fa4567-8707-4e89-90bd-3d62bf02e27c tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0948754217fc4ff2ba0241fa35feaf90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1aaf20f480a423ea5feca81585aeeed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:12:10.787273 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-22fa4567-8707-4e89-90bd-3d62bf02e27c tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0948754217fc4ff2ba0241fa35feaf90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1aaf20f480a423ea5feca81585aeeed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:12:10.790067 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-22fa4567-8707-4e89-90bd-3d62bf02e27c tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0948754217fc4ff2ba0241fa35feaf90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1aaf20f480a423ea5feca81585aeeed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:12:10.792230 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-22fa4567-8707-4e89-90bd-3d62bf02e27c tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] 10.222.0.50 "GET /compute/v2.1/servers/36f8e098-a4b5-40a4-8f49-f341c5ad940c" status: 200 len: 1731 microversion: 2.20 time: 0.257342 Sep 24 05:12:10.793160 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 579/1183] 10.222.0.50 () {60 vars in 1277 bytes} [Sat Sep 24 05:12:10 2022] GET /compute/v2.1/servers/36f8e098-a4b5-40a4-8f49-f341c5ad940c => generated 1731 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 05:12:10.845586 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.policy [None req-bb6b123b-8b5c-4162-bd4c-3e7aada309a3 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74a8cc19ab204424ab23c62915ac2bab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87d5229e39fe4817b5187068d8acecc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:12:10.853249 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [None req-bb6b123b-8b5c-4162-bd4c-3e7aada309a3 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] 10.222.0.50 "GET /compute/v2.1/servers/459e75d4-67d0-437c-aad4-09523804e931" status: 200 len: 1557 microversion: 2.1 time: 0.216442 Sep 24 05:12:10.853807 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 605/1184] 10.222.0.50 () {58 vars in 1236 bytes} [Sat Sep 24 05:12:10 2022] GET /compute/v2.1/servers/459e75d4-67d0-437c-aad4-09523804e931 => generated 1557 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 24 05:12:10.875082 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-185563b8-c1cb-428e-87df-e26ac561fd84 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Calling method '>' {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:12:10.875569 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.compute.api [None req-185563b8-c1cb-428e-87df-e26ac561fd84 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] [instance: 459e75d4-67d0-437c-aad4-09523804e931] Fetching instance by UUID {{(pid=120593) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:12:10.881433 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-185563b8-c1cb-428e-87df-e26ac561fd84 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:12:10.882464 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-185563b8-c1cb-428e-87df-e26ac561fd84 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:12:10.882895 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-185563b8-c1cb-428e-87df-e26ac561fd84 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:12:10.883573 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-185563b8-c1cb-428e-87df-e26ac561fd84 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:12:10.884019 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-185563b8-c1cb-428e-87df-e26ac561fd84 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:12:10.884432 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-185563b8-c1cb-428e-87df-e26ac561fd84 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:12:10.959578 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-185563b8-c1cb-428e-87df-e26ac561fd84 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] 10.222.0.50 "GET /compute/v2.1/servers/459e75d4-67d0-437c-aad4-09523804e931/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.088275 Sep 24 05:12:10.960209 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 580/1185] 10.222.0.50 () {58 vars in 1275 bytes} [Sat Sep 24 05:12:10 2022] GET /compute/v2.1/servers/459e75d4-67d0-437c-aad4-09523804e931/os-interface => generated 285 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 05:12:11.818795 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-35c17095-03fc-458d-b735-cd1018469e95 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Calling method '>' {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:12:11.819524 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.compute.api [None req-35c17095-03fc-458d-b735-cd1018469e95 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] [instance: 36f8e098-a4b5-40a4-8f49-f341c5ad940c] Fetching instance by UUID {{(pid=120594) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:12:11.825877 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-35c17095-03fc-458d-b735-cd1018469e95 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:12:11.826419 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-35c17095-03fc-458d-b735-cd1018469e95 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:12:11.826838 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-35c17095-03fc-458d-b735-cd1018469e95 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:12:11.827529 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-35c17095-03fc-458d-b735-cd1018469e95 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:12:11.827974 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-35c17095-03fc-458d-b735-cd1018469e95 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:12:11.828396 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-35c17095-03fc-458d-b735-cd1018469e95 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:12:11.905921 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [req-22bd5f8b-d62a-45d9-aa69-75590cb0a9a8 req-6801bd5c-90cb-41d6-9b83-9b985f82e879 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "459e75d4-67d0-437c-aad4-09523804e931", "tag": "ef9198dd-ee25-440b-bf14-75c1f892d961"}]} {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 05:12:11.917711 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [req-22bd5f8b-d62a-45d9-aa69-75590cb0a9a8 req-6801bd5c-90cb-41d6-9b83-9b985f82e879 service nova] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:12:11.918451 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [req-22bd5f8b-d62a-45d9-aa69-75590cb0a9a8 req-6801bd5c-90cb-41d6-9b83-9b985f82e879 service nova] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:12:11.918982 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [req-22bd5f8b-d62a-45d9-aa69-75590cb0a9a8 req-6801bd5c-90cb-41d6-9b83-9b985f82e879 service nova] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:12:11.931111 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.compute.server_external_events [req-22bd5f8b-d62a-45d9-aa69-75590cb0a9a8 req-6801bd5c-90cb-41d6-9b83-9b985f82e879 service nova] Creating event network-changed:ef9198dd-ee25-440b-bf14-75c1f892d961 for instance 459e75d4-67d0-437c-aad4-09523804e931 on hv-cinder-85918 Sep 24 05:12:11.936187 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [req-22bd5f8b-d62a-45d9-aa69-75590cb0a9a8 req-6801bd5c-90cb-41d6-9b83-9b985f82e879 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034947 Sep 24 05:12:11.937035 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 581/1186] 10.222.0.50 () {64 vars in 1317 bytes} [Sat Sep 24 05:12:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 24 05:12:11.975892 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.policy [None req-35c17095-03fc-458d-b735-cd1018469e95 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0948754217fc4ff2ba0241fa35feaf90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1aaf20f480a423ea5feca81585aeeed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:12:11.984328 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.policy [None req-35c17095-03fc-458d-b735-cd1018469e95 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0948754217fc4ff2ba0241fa35feaf90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1aaf20f480a423ea5feca81585aeeed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:12:11.985707 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.policy [None req-35c17095-03fc-458d-b735-cd1018469e95 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0948754217fc4ff2ba0241fa35feaf90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1aaf20f480a423ea5feca81585aeeed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:12:11.986893 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [None req-35c17095-03fc-458d-b735-cd1018469e95 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] 10.222.0.50 "GET /compute/v2.1/servers/36f8e098-a4b5-40a4-8f49-f341c5ad940c" status: 200 len: 1731 microversion: 2.20 time: 0.172074 Sep 24 05:12:11.987633 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 606/1187] 10.222.0.50 () {60 vars in 1277 bytes} [Sat Sep 24 05:12:11 2022] GET /compute/v2.1/servers/36f8e098-a4b5-40a4-8f49-f341c5ad940c => generated 1731 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 05:12:13.013774 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-a37e7bc9-b8eb-4b3a-bc50-8023744c6a16 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Calling method '>' {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:12:13.014659 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.compute.api [None req-a37e7bc9-b8eb-4b3a-bc50-8023744c6a16 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] [instance: 36f8e098-a4b5-40a4-8f49-f341c5ad940c] Fetching instance by UUID {{(pid=120593) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:12:13.016888 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG dbcounter [-] [120593] Writing DB stats nova_api:SELECT=59 {{(pid=120593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 05:12:13.024413 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-a37e7bc9-b8eb-4b3a-bc50-8023744c6a16 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:12:13.025195 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-a37e7bc9-b8eb-4b3a-bc50-8023744c6a16 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:12:13.026188 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-a37e7bc9-b8eb-4b3a-bc50-8023744c6a16 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:12:13.027673 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-a37e7bc9-b8eb-4b3a-bc50-8023744c6a16 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:12:13.028376 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-a37e7bc9-b8eb-4b3a-bc50-8023744c6a16 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:12:13.029128 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-a37e7bc9-b8eb-4b3a-bc50-8023744c6a16 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:12:13.177893 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-a37e7bc9-b8eb-4b3a-bc50-8023744c6a16 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0948754217fc4ff2ba0241fa35feaf90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1aaf20f480a423ea5feca81585aeeed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:12:13.187007 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-a37e7bc9-b8eb-4b3a-bc50-8023744c6a16 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0948754217fc4ff2ba0241fa35feaf90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1aaf20f480a423ea5feca81585aeeed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:12:13.190487 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-a37e7bc9-b8eb-4b3a-bc50-8023744c6a16 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0948754217fc4ff2ba0241fa35feaf90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1aaf20f480a423ea5feca81585aeeed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:12:13.192116 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-a37e7bc9-b8eb-4b3a-bc50-8023744c6a16 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] 10.222.0.50 "GET /compute/v2.1/servers/36f8e098-a4b5-40a4-8f49-f341c5ad940c" status: 200 len: 1731 microversion: 2.20 time: 0.183230 Sep 24 05:12:13.192501 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 582/1188] 10.222.0.50 () {60 vars in 1277 bytes} [Sat Sep 24 05:12:13 2022] GET /compute/v2.1/servers/36f8e098-a4b5-40a4-8f49-f341c5ad940c => generated 1731 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 05:12:14.220218 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-556a32e9-c537-460b-8032-683d7ed4859a tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Calling method '>' {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:12:14.220843 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.compute.api [None req-556a32e9-c537-460b-8032-683d7ed4859a tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] [instance: 36f8e098-a4b5-40a4-8f49-f341c5ad940c] Fetching instance by UUID {{(pid=120594) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:12:14.223450 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG dbcounter [-] [120594] Writing DB stats nova_api:SELECT=58,nova_api:UPDATE=1 {{(pid=120594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 05:12:14.230120 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-556a32e9-c537-460b-8032-683d7ed4859a tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:12:14.230603 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-556a32e9-c537-460b-8032-683d7ed4859a tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:12:14.231037 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-556a32e9-c537-460b-8032-683d7ed4859a tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:12:14.231725 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-556a32e9-c537-460b-8032-683d7ed4859a tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:12:14.232209 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-556a32e9-c537-460b-8032-683d7ed4859a tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:12:14.232629 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-556a32e9-c537-460b-8032-683d7ed4859a tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:12:14.361520 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.policy [None req-556a32e9-c537-460b-8032-683d7ed4859a tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0948754217fc4ff2ba0241fa35feaf90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1aaf20f480a423ea5feca81585aeeed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:12:14.369509 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.policy [None req-556a32e9-c537-460b-8032-683d7ed4859a tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0948754217fc4ff2ba0241fa35feaf90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1aaf20f480a423ea5feca81585aeeed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:12:14.370966 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.policy [None req-556a32e9-c537-460b-8032-683d7ed4859a tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0948754217fc4ff2ba0241fa35feaf90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1aaf20f480a423ea5feca81585aeeed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:12:14.372101 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [None req-556a32e9-c537-460b-8032-683d7ed4859a tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] 10.222.0.50 "GET /compute/v2.1/servers/36f8e098-a4b5-40a4-8f49-f341c5ad940c" status: 200 len: 1718 microversion: 2.20 time: 0.155792 Sep 24 05:12:14.372663 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 607/1189] 10.222.0.50 () {60 vars in 1277 bytes} [Sat Sep 24 05:12:14 2022] GET /compute/v2.1/servers/36f8e098-a4b5-40a4-8f49-f341c5ad940c => generated 1718 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 24 05:12:16.473267 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-bda642b4-90ad-4531-820c-9623d39980e3 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Calling method '>' {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:12:16.475493 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.compute.api [None req-bda642b4-90ad-4531-820c-9623d39980e3 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] [instance: b551478f-d1dc-4ab3-9e44-4e78b785b21f] Fetching instance by UUID {{(pid=120593) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:12:16.482424 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-bda642b4-90ad-4531-820c-9623d39980e3 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:12:16.482898 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-bda642b4-90ad-4531-820c-9623d39980e3 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:12:16.483328 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-bda642b4-90ad-4531-820c-9623d39980e3 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:12:16.484006 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-bda642b4-90ad-4531-820c-9623d39980e3 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:12:16.484451 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-bda642b4-90ad-4531-820c-9623d39980e3 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:12:16.484866 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-bda642b4-90ad-4531-820c-9623d39980e3 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:12:16.514323 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-bda642b4-90ad-4531-820c-9623d39980e3 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] 10.222.0.50 "GET /compute/v2.1/servers/b551478f-d1dc-4ab3-9e44-4e78b785b21f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044958 Sep 24 05:12:16.514870 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 583/1190] 10.222.0.50 () {58 vars in 1302 bytes} [Sat Sep 24 05:12:16 2022] GET /compute/v2.1/servers/b551478f-d1dc-4ab3-9e44-4e78b785b21f/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 05:12:16.525615 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-e7149375-d6df-4f73-a782-c00e66222ed2 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Calling method '>' {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:12:16.526221 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.compute.api [None req-e7149375-d6df-4f73-a782-c00e66222ed2 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] [instance: b551478f-d1dc-4ab3-9e44-4e78b785b21f] Fetching instance by UUID {{(pid=120594) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:12:16.533314 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-e7149375-d6df-4f73-a782-c00e66222ed2 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:12:16.533789 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-e7149375-d6df-4f73-a782-c00e66222ed2 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:12:16.534244 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-e7149375-d6df-4f73-a782-c00e66222ed2 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:12:16.534931 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-e7149375-d6df-4f73-a782-c00e66222ed2 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:12:16.535405 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-e7149375-d6df-4f73-a782-c00e66222ed2 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:12:16.535853 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-e7149375-d6df-4f73-a782-c00e66222ed2 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:12:16.566398 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [None req-e7149375-d6df-4f73-a782-c00e66222ed2 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] 10.222.0.50 "GET /compute/v2.1/servers/b551478f-d1dc-4ab3-9e44-4e78b785b21f/os-volume_attachments/066d4508-e90f-4bff-8aef-78f09133cf68" status: 200 len: 194 microversion: 2.1 time: 0.044924 Sep 24 05:12:16.566960 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 608/1191] 10.222.0.50 () {58 vars in 1413 bytes} [Sat Sep 24 05:12:16 2022] GET /compute/v2.1/servers/b551478f-d1dc-4ab3-9e44-4e78b785b21f/os-volume_attachments/066d4508-e90f-4bff-8aef-78f09133cf68 => generated 194 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 24 05:12:17.904911 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-928e2071-b51f-4c78-a9c9-bc470bc543c1 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "d64a2bb9-b4b1-442e-90a3-72b0da07d0d8"}} {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 05:12:17.907231 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.compute.api [None req-928e2071-b51f-4c78-a9c9-bc470bc543c1 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] [instance: b551478f-d1dc-4ab3-9e44-4e78b785b21f] Fetching instance by UUID {{(pid=120593) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:12:17.913857 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-928e2071-b51f-4c78-a9c9-bc470bc543c1 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:12:17.914373 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-928e2071-b51f-4c78-a9c9-bc470bc543c1 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:12:17.914816 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-928e2071-b51f-4c78-a9c9-bc470bc543c1 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:12:17.915503 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-928e2071-b51f-4c78-a9c9-bc470bc543c1 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:12:17.915961 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-928e2071-b51f-4c78-a9c9-bc470bc543c1 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:12:17.916396 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-928e2071-b51f-4c78-a9c9-bc470bc543c1 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:12:18.151880 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-928e2071-b51f-4c78-a9c9-bc470bc543c1 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] 10.222.0.50 "POST /compute/v2.1/servers/b551478f-d1dc-4ab3-9e44-4e78b785b21f/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.250871 Sep 24 05:12:18.152485 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 584/1192] 10.222.0.50 () {60 vars in 1323 bytes} [Sat Sep 24 05:12:17 2022] POST /compute/v2.1/servers/b551478f-d1dc-4ab3-9e44-4e78b785b21f/os-volume_attachments => generated 194 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 05:12:25.704693 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-bc985e00-52a9-4e1d-9c69-99c8f490e6c9 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Calling method '>' {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:12:25.706946 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.compute.api [None req-bc985e00-52a9-4e1d-9c69-99c8f490e6c9 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] [instance: b551478f-d1dc-4ab3-9e44-4e78b785b21f] Fetching instance by UUID {{(pid=120594) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:12:25.714232 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-bc985e00-52a9-4e1d-9c69-99c8f490e6c9 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:12:25.714723 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-bc985e00-52a9-4e1d-9c69-99c8f490e6c9 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:12:25.715162 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-bc985e00-52a9-4e1d-9c69-99c8f490e6c9 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:12:25.715851 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-bc985e00-52a9-4e1d-9c69-99c8f490e6c9 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:12:25.716309 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-bc985e00-52a9-4e1d-9c69-99c8f490e6c9 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:12:25.716737 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-bc985e00-52a9-4e1d-9c69-99c8f490e6c9 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:12:25.746991 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [None req-bc985e00-52a9-4e1d-9c69-99c8f490e6c9 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] 10.222.0.50 "GET /compute/v2.1/servers/b551478f-d1dc-4ab3-9e44-4e78b785b21f/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.046215 Sep 24 05:12:25.747546 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 609/1193] 10.222.0.50 () {58 vars in 1302 bytes} [Sat Sep 24 05:12:25 2022] GET /compute/v2.1/servers/b551478f-d1dc-4ab3-9e44-4e78b785b21f/os-volume_attachments => generated 371 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 05:12:25.854507 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-8898a9ef-83a5-4303-afec-c4f140fc68d1 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Calling method '>' {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:12:25.855011 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.compute.api [None req-8898a9ef-83a5-4303-afec-c4f140fc68d1 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] [instance: b551478f-d1dc-4ab3-9e44-4e78b785b21f] Fetching instance by UUID {{(pid=120593) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:12:25.861104 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-8898a9ef-83a5-4303-afec-c4f140fc68d1 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:12:25.861583 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-8898a9ef-83a5-4303-afec-c4f140fc68d1 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:12:25.862042 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-8898a9ef-83a5-4303-afec-c4f140fc68d1 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:12:25.862730 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-8898a9ef-83a5-4303-afec-c4f140fc68d1 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:12:25.863187 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-8898a9ef-83a5-4303-afec-c4f140fc68d1 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:12:25.863611 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-8898a9ef-83a5-4303-afec-c4f140fc68d1 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:12:25.865988 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG dbcounter [-] [120593] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=120593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 05:12:25.894092 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-8898a9ef-83a5-4303-afec-c4f140fc68d1 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] 10.222.0.50 "GET /compute/v2.1/servers/b551478f-d1dc-4ab3-9e44-4e78b785b21f/os-volume_attachments/066d4508-e90f-4bff-8aef-78f09133cf68" status: 200 len: 194 microversion: 2.1 time: 0.045249 Sep 24 05:12:25.894667 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 585/1194] 10.222.0.50 () {58 vars in 1413 bytes} [Sat Sep 24 05:12:25 2022] GET /compute/v2.1/servers/b551478f-d1dc-4ab3-9e44-4e78b785b21f/os-volume_attachments/066d4508-e90f-4bff-8aef-78f09133cf68 => generated 194 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 05:12:25.905119 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-70435845-e12f-4429-ae03-d7d731ee5fa1 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Calling method '>' {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:12:25.905611 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.compute.api [None req-70435845-e12f-4429-ae03-d7d731ee5fa1 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] [instance: b551478f-d1dc-4ab3-9e44-4e78b785b21f] Fetching instance by UUID {{(pid=120594) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:12:25.911704 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-70435845-e12f-4429-ae03-d7d731ee5fa1 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:12:25.912192 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-70435845-e12f-4429-ae03-d7d731ee5fa1 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:12:25.912630 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-70435845-e12f-4429-ae03-d7d731ee5fa1 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:12:25.913319 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-70435845-e12f-4429-ae03-d7d731ee5fa1 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:12:25.913783 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-70435845-e12f-4429-ae03-d7d731ee5fa1 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:12:25.914242 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-70435845-e12f-4429-ae03-d7d731ee5fa1 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:12:25.993418 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.objects.instance [None req-70435845-e12f-4429-ae03-d7d731ee5fa1 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Lazy-loading 'services' on Instance uuid b551478f-d1dc-4ab3-9e44-4e78b785b21f {{(pid=120594) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 24 05:12:26.064848 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [None req-70435845-e12f-4429-ae03-d7d731ee5fa1 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] 10.222.0.50 "DELETE /compute/v2.1/servers/b551478f-d1dc-4ab3-9e44-4e78b785b21f/os-volume_attachments/066d4508-e90f-4bff-8aef-78f09133cf68" status: 202 len: 0 microversion: 2.1 time: 0.163517 Sep 24 05:12:26.065432 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 610/1195] 10.222.0.50 () {58 vars in 1416 bytes} [Sat Sep 24 05:12:25 2022] DELETE /compute/v2.1/servers/b551478f-d1dc-4ab3-9e44-4e78b785b21f/os-volume_attachments/066d4508-e90f-4bff-8aef-78f09133cf68 => generated 0 bytes in 165 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 24 05:12:28.243060 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-9414c969-ca54-430f-ac6f-ee4089d97e29 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Calling method '>' {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:12:28.243568 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.compute.api [None req-9414c969-ca54-430f-ac6f-ee4089d97e29 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] [instance: b551478f-d1dc-4ab3-9e44-4e78b785b21f] Fetching instance by UUID {{(pid=120593) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:12:28.249851 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-9414c969-ca54-430f-ac6f-ee4089d97e29 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:12:28.250366 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-9414c969-ca54-430f-ac6f-ee4089d97e29 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:12:28.250800 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-9414c969-ca54-430f-ac6f-ee4089d97e29 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:12:28.251474 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-9414c969-ca54-430f-ac6f-ee4089d97e29 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:12:28.251918 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-9414c969-ca54-430f-ac6f-ee4089d97e29 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:12:28.252332 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-9414c969-ca54-430f-ac6f-ee4089d97e29 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:12:28.280532 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-9414c969-ca54-430f-ac6f-ee4089d97e29 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] 10.222.0.50 "GET /compute/v2.1/servers/b551478f-d1dc-4ab3-9e44-4e78b785b21f/os-volume_attachments/d64a2bb9-b4b1-442e-90a3-72b0da07d0d8" status: 200 len: 194 microversion: 2.1 time: 0.041441 Sep 24 05:12:28.281089 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 586/1196] 10.222.0.50 () {58 vars in 1413 bytes} [Sat Sep 24 05:12:28 2022] GET /compute/v2.1/servers/b551478f-d1dc-4ab3-9e44-4e78b785b21f/os-volume_attachments/d64a2bb9-b4b1-442e-90a3-72b0da07d0d8 => generated 194 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 05:12:28.293437 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-f7013c89-d649-4251-b440-903ba69d07a0 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Calling method '>' {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:12:28.294021 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.compute.api [None req-f7013c89-d649-4251-b440-903ba69d07a0 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] [instance: b551478f-d1dc-4ab3-9e44-4e78b785b21f] Fetching instance by UUID {{(pid=120594) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:12:28.300070 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-f7013c89-d649-4251-b440-903ba69d07a0 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:12:28.300541 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-f7013c89-d649-4251-b440-903ba69d07a0 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:12:28.300971 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-f7013c89-d649-4251-b440-903ba69d07a0 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:12:28.301649 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-f7013c89-d649-4251-b440-903ba69d07a0 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:12:28.302125 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-f7013c89-d649-4251-b440-903ba69d07a0 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:12:28.302542 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-f7013c89-d649-4251-b440-903ba69d07a0 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:12:28.379968 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.objects.instance [None req-f7013c89-d649-4251-b440-903ba69d07a0 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Lazy-loading 'services' on Instance uuid b551478f-d1dc-4ab3-9e44-4e78b785b21f {{(pid=120594) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 24 05:12:28.449459 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [None req-f7013c89-d649-4251-b440-903ba69d07a0 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] 10.222.0.50 "DELETE /compute/v2.1/servers/b551478f-d1dc-4ab3-9e44-4e78b785b21f/os-volume_attachments/d64a2bb9-b4b1-442e-90a3-72b0da07d0d8" status: 202 len: 0 microversion: 2.1 time: 0.161101 Sep 24 05:12:28.450215 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 611/1197] 10.222.0.50 () {58 vars in 1416 bytes} [Sat Sep 24 05:12:28 2022] DELETE /compute/v2.1/servers/b551478f-d1dc-4ab3-9e44-4e78b785b21f/os-volume_attachments/d64a2bb9-b4b1-442e-90a3-72b0da07d0d8 => generated 0 bytes in 163 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 24 05:12:29.635875 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-0df29f30-a37f-4e1b-94e0-df2a1b86a008 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Calling method '>' {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:12:29.638152 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.compute.api [None req-0df29f30-a37f-4e1b-94e0-df2a1b86a008 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] [instance: b551478f-d1dc-4ab3-9e44-4e78b785b21f] Fetching instance by UUID {{(pid=120593) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:12:29.644479 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-0df29f30-a37f-4e1b-94e0-df2a1b86a008 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:12:29.644950 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-0df29f30-a37f-4e1b-94e0-df2a1b86a008 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:12:29.645379 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-0df29f30-a37f-4e1b-94e0-df2a1b86a008 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:12:29.646085 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-0df29f30-a37f-4e1b-94e0-df2a1b86a008 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:12:29.646538 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-0df29f30-a37f-4e1b-94e0-df2a1b86a008 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:12:29.646954 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-0df29f30-a37f-4e1b-94e0-df2a1b86a008 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:12:29.678905 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-0df29f30-a37f-4e1b-94e0-df2a1b86a008 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] 10.222.0.50 "GET /compute/v2.1/servers/b551478f-d1dc-4ab3-9e44-4e78b785b21f/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.046911 Sep 24 05:12:29.679454 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 587/1198] 10.222.0.50 () {58 vars in 1302 bytes} [Sat Sep 24 05:12:29 2022] GET /compute/v2.1/servers/b551478f-d1dc-4ab3-9e44-4e78b785b21f/os-volume_attachments => generated 25 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 24 05:12:29.795271 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-e68fc8eb-74aa-4ab9-991a-17aee0d7dbbd tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Calling method '>' {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:12:29.797577 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.compute.api [None req-e68fc8eb-74aa-4ab9-991a-17aee0d7dbbd tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] [instance: b551478f-d1dc-4ab3-9e44-4e78b785b21f] Fetching instance by UUID {{(pid=120594) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:12:29.803610 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-e68fc8eb-74aa-4ab9-991a-17aee0d7dbbd tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:12:29.804023 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-e68fc8eb-74aa-4ab9-991a-17aee0d7dbbd tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:12:29.804452 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-e68fc8eb-74aa-4ab9-991a-17aee0d7dbbd tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:12:29.805129 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-e68fc8eb-74aa-4ab9-991a-17aee0d7dbbd tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:12:29.805571 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-e68fc8eb-74aa-4ab9-991a-17aee0d7dbbd tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:12:29.806018 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-e68fc8eb-74aa-4ab9-991a-17aee0d7dbbd tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:12:29.833365 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [None req-e68fc8eb-74aa-4ab9-991a-17aee0d7dbbd tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] 10.222.0.50 "GET /compute/v2.1/servers/b551478f-d1dc-4ab3-9e44-4e78b785b21f/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.043427 Sep 24 05:12:29.833902 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 612/1199] 10.222.0.50 () {58 vars in 1302 bytes} [Sat Sep 24 05:12:29 2022] GET /compute/v2.1/servers/b551478f-d1dc-4ab3-9e44-4e78b785b21f/os-volume_attachments => generated 25 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 24 05:12:29.896874 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-eb25c030-b5df-47ae-91db-41231e11b9aa tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Calling method '>' {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:12:29.897366 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.compute.api [None req-eb25c030-b5df-47ae-91db-41231e11b9aa tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] [instance: b551478f-d1dc-4ab3-9e44-4e78b785b21f] Fetching instance by UUID {{(pid=120593) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:12:29.903767 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-eb25c030-b5df-47ae-91db-41231e11b9aa tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:12:29.904248 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-eb25c030-b5df-47ae-91db-41231e11b9aa tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:12:29.904685 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-eb25c030-b5df-47ae-91db-41231e11b9aa tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:12:29.905370 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-eb25c030-b5df-47ae-91db-41231e11b9aa tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:12:29.905823 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-eb25c030-b5df-47ae-91db-41231e11b9aa tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:12:29.906276 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-eb25c030-b5df-47ae-91db-41231e11b9aa tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:12:29.931227 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.compute.api [None req-eb25c030-b5df-47ae-91db-41231e11b9aa tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] [instance: b551478f-d1dc-4ab3-9e44-4e78b785b21f] Going to try to terminate instance {{(pid=120593) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 24 05:12:30.005588 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-eb25c030-b5df-47ae-91db-41231e11b9aa tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] 10.222.0.50 "DELETE /compute/v2.1/servers/b551478f-d1dc-4ab3-9e44-4e78b785b21f" status: 204 len: 0 microversion: 2.1 time: 0.112204 Sep 24 05:12:30.006203 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 588/1200] 10.222.0.50 () {58 vars in 1239 bytes} [Sat Sep 24 05:12:29 2022] DELETE /compute/v2.1/servers/b551478f-d1dc-4ab3-9e44-4e78b785b21f => generated 0 bytes in 114 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 24 05:12:30.016435 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-95e2fb79-b493-4049-a5a8-6a4cf8ae8fae tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Calling method '>' {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:12:30.017050 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.compute.api [None req-95e2fb79-b493-4049-a5a8-6a4cf8ae8fae tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] [instance: b551478f-d1dc-4ab3-9e44-4e78b785b21f] Fetching instance by UUID {{(pid=120594) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:12:30.022913 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-95e2fb79-b493-4049-a5a8-6a4cf8ae8fae tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:12:30.023395 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-95e2fb79-b493-4049-a5a8-6a4cf8ae8fae tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:12:30.023832 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-95e2fb79-b493-4049-a5a8-6a4cf8ae8fae tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:12:30.024520 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-95e2fb79-b493-4049-a5a8-6a4cf8ae8fae tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:12:30.025543 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-95e2fb79-b493-4049-a5a8-6a4cf8ae8fae tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:12:30.025969 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-95e2fb79-b493-4049-a5a8-6a4cf8ae8fae tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:12:30.155764 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.policy [None req-95e2fb79-b493-4049-a5a8-6a4cf8ae8fae tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b1b0448e7f54e3aaae49e411699269e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66ec8bde739145dda504995dbea0914a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:12:30.159650 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG dbcounter [-] [120594] Writing DB stats nova_cell1:SELECT=98,nova_cell1:INSERT=2 {{(pid=120594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 05:12:30.165144 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [None req-95e2fb79-b493-4049-a5a8-6a4cf8ae8fae tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] 10.222.0.50 "GET /compute/v2.1/servers/b551478f-d1dc-4ab3-9e44-4e78b785b21f" status: 200 len: 1671 microversion: 2.1 time: 0.153459 Sep 24 05:12:30.165713 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 613/1201] 10.222.0.50 () {58 vars in 1236 bytes} [Sat Sep 24 05:12:30 2022] GET /compute/v2.1/servers/b551478f-d1dc-4ab3-9e44-4e78b785b21f => generated 1671 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 05:12:31.188947 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-1e865bd8-975b-445b-9b9b-c69508f31d7d tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Calling method '>' {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:12:31.189666 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.compute.api [None req-1e865bd8-975b-445b-9b9b-c69508f31d7d tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] [instance: b551478f-d1dc-4ab3-9e44-4e78b785b21f] Fetching instance by UUID {{(pid=120593) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:12:31.195987 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-1e865bd8-975b-445b-9b9b-c69508f31d7d tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:12:31.196465 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-1e865bd8-975b-445b-9b9b-c69508f31d7d tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:12:31.196896 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-1e865bd8-975b-445b-9b9b-c69508f31d7d tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:12:31.197575 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-1e865bd8-975b-445b-9b9b-c69508f31d7d tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:12:31.198078 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-1e865bd8-975b-445b-9b9b-c69508f31d7d tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:12:31.198499 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-1e865bd8-975b-445b-9b9b-c69508f31d7d tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:12:31.323085 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-1e865bd8-975b-445b-9b9b-c69508f31d7d tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b1b0448e7f54e3aaae49e411699269e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66ec8bde739145dda504995dbea0914a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:12:31.330644 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-1e865bd8-975b-445b-9b9b-c69508f31d7d tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] 10.222.0.50 "GET /compute/v2.1/servers/b551478f-d1dc-4ab3-9e44-4e78b785b21f" status: 200 len: 1671 microversion: 2.1 time: 0.145900 Sep 24 05:12:31.331144 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 589/1202] 10.222.0.50 () {58 vars in 1236 bytes} [Sat Sep 24 05:12:31 2022] GET /compute/v2.1/servers/b551478f-d1dc-4ab3-9e44-4e78b785b21f => generated 1671 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 05:12:32.354323 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-ea564115-4f04-491e-8d01-61e5eaecfbbe tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Calling method '>' {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:12:32.354931 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.compute.api [None req-ea564115-4f04-491e-8d01-61e5eaecfbbe tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] [instance: b551478f-d1dc-4ab3-9e44-4e78b785b21f] Fetching instance by UUID {{(pid=120594) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:12:32.362422 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-ea564115-4f04-491e-8d01-61e5eaecfbbe tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:12:32.362899 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-ea564115-4f04-491e-8d01-61e5eaecfbbe tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:12:32.363327 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-ea564115-4f04-491e-8d01-61e5eaecfbbe tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:12:32.364010 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-ea564115-4f04-491e-8d01-61e5eaecfbbe tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:12:32.364452 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-ea564115-4f04-491e-8d01-61e5eaecfbbe tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:12:32.364864 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-ea564115-4f04-491e-8d01-61e5eaecfbbe tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:12:32.573830 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.policy [None req-ea564115-4f04-491e-8d01-61e5eaecfbbe tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b1b0448e7f54e3aaae49e411699269e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66ec8bde739145dda504995dbea0914a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:12:32.581491 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [None req-ea564115-4f04-491e-8d01-61e5eaecfbbe tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] 10.222.0.50 "GET /compute/v2.1/servers/b551478f-d1dc-4ab3-9e44-4e78b785b21f" status: 200 len: 1671 microversion: 2.1 time: 0.231566 Sep 24 05:12:32.582070 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 614/1203] 10.222.0.50 () {58 vars in 1236 bytes} [Sat Sep 24 05:12:32 2022] GET /compute/v2.1/servers/b551478f-d1dc-4ab3-9e44-4e78b785b21f => generated 1671 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 05:12:33.469949 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [req-f6915602-802d-4667-a771-1e69251aae41 req-c63b78f4-00b7-4e21-8149-00af298a0bbe service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b551478f-d1dc-4ab3-9e44-4e78b785b21f", "name": "network-vif-deleted", "tag": "91027567-bf47-4165-9af7-f033dc54a3db"}]} {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 05:12:33.479597 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [req-f6915602-802d-4667-a771-1e69251aae41 req-c63b78f4-00b7-4e21-8149-00af298a0bbe service nova] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:12:33.480046 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [req-f6915602-802d-4667-a771-1e69251aae41 req-c63b78f4-00b7-4e21-8149-00af298a0bbe service nova] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:12:33.480476 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [req-f6915602-802d-4667-a771-1e69251aae41 req-c63b78f4-00b7-4e21-8149-00af298a0bbe service nova] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:12:33.492183 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.compute.server_external_events [req-f6915602-802d-4667-a771-1e69251aae41 req-c63b78f4-00b7-4e21-8149-00af298a0bbe service nova] Creating event network-vif-deleted:91027567-bf47-4165-9af7-f033dc54a3db for instance b551478f-d1dc-4ab3-9e44-4e78b785b21f on hv-cinder-85918 Sep 24 05:12:33.497652 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [req-f6915602-802d-4667-a771-1e69251aae41 req-c63b78f4-00b7-4e21-8149-00af298a0bbe service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031458 Sep 24 05:12:33.498348 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 590/1204] 10.222.0.50 () {64 vars in 1317 bytes} [Sat Sep 24 05:12:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 24 05:12:33.608327 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-e00f4d78-3674-4f38-8cca-cabd64186c57 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Calling method '>' {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:12:33.609659 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.compute.api [None req-e00f4d78-3674-4f38-8cca-cabd64186c57 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] [instance: b551478f-d1dc-4ab3-9e44-4e78b785b21f] Fetching instance by UUID {{(pid=120594) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:12:33.617911 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-e00f4d78-3674-4f38-8cca-cabd64186c57 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:12:33.619493 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-e00f4d78-3674-4f38-8cca-cabd64186c57 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:12:33.620140 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-e00f4d78-3674-4f38-8cca-cabd64186c57 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:12:33.621088 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-e00f4d78-3674-4f38-8cca-cabd64186c57 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:12:33.621761 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-e00f4d78-3674-4f38-8cca-cabd64186c57 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:12:33.622445 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-e00f4d78-3674-4f38-8cca-cabd64186c57 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:12:33.659926 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-e00f4d78-3674-4f38-8cca-cabd64186c57 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:12:33.661383 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-e00f4d78-3674-4f38-8cca-cabd64186c57 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:12:33.661931 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-e00f4d78-3674-4f38-8cca-cabd64186c57 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:12:33.662543 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.objects.instance [None req-e00f4d78-3674-4f38-8cca-cabd64186c57 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Lazy-loading 'fault' on Instance uuid b551478f-d1dc-4ab3-9e44-4e78b785b21f {{(pid=120594) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 24 05:12:33.705802 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.policy [None req-e00f4d78-3674-4f38-8cca-cabd64186c57 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b1b0448e7f54e3aaae49e411699269e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66ec8bde739145dda504995dbea0914a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:12:33.713443 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [None req-e00f4d78-3674-4f38-8cca-cabd64186c57 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] 10.222.0.50 "GET /compute/v2.1/servers/b551478f-d1dc-4ab3-9e44-4e78b785b21f" status: 200 len: 1327 microversion: 2.1 time: 0.111727 Sep 24 05:12:33.714292 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 615/1205] 10.222.0.50 () {58 vars in 1236 bytes} [Sat Sep 24 05:12:33 2022] GET /compute/v2.1/servers/b551478f-d1dc-4ab3-9e44-4e78b785b21f => generated 1327 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 05:12:34.738023 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-c613c200-3101-426b-9ca9-215fca723222 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Calling method '>' {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:12:34.738726 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.compute.api [None req-c613c200-3101-426b-9ca9-215fca723222 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] [instance: b551478f-d1dc-4ab3-9e44-4e78b785b21f] Fetching instance by UUID {{(pid=120593) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:12:34.744922 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-c613c200-3101-426b-9ca9-215fca723222 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:12:34.745400 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-c613c200-3101-426b-9ca9-215fca723222 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:12:34.745834 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-c613c200-3101-426b-9ca9-215fca723222 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:12:34.746550 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-c613c200-3101-426b-9ca9-215fca723222 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:12:34.747035 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-c613c200-3101-426b-9ca9-215fca723222 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:12:34.747458 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-c613c200-3101-426b-9ca9-215fca723222 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:12:34.761043 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.wsgi [None req-c613c200-3101-426b-9ca9-215fca723222 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] HTTP exception thrown: Instance b551478f-d1dc-4ab3-9e44-4e78b785b21f could not be found. Sep 24 05:12:34.762671 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-c613c200-3101-426b-9ca9-215fca723222 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Request method failure captured: Sep 24 05:12:34.762671 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: request: GET /compute/v2.1/servers/b551478f-d1dc-4ab3-9e44-4e78b785b21f HTTP/1.1 Sep 24 05:12:34.762671 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: Accept: application/json Sep 24 05:12:34.762671 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: Accept-Encoding: identity Sep 24 05:12:34.762671 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: Connection: close Sep 24 05:12:34.762671 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: Content-Length: 0 Sep 24 05:12:34.762671 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: Content-Type: application/json Sep 24 05:12:34.762671 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: Host: 10.222.0.50 Sep 24 05:12:34.762671 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: Openstack-System-Scope: None Sep 24 05:12:34.762671 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: User-Agent: python-urllib3/1.26.12 Sep 24 05:12:34.762671 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: X-Auth-Token: gAAAAABjLo8A_CV8_CcmOLJdbO1CHZ_VMsAEcpA541mM_Xx_bnEYb9KbQB8GkpDr_kW76CRgxi1HVxhwSWPV_l8j6w2MLcWnpsGWMgMDlRXPK4lnqHJLbW7N0ODeHl05uvEeeYUdVCWPx9rjn6MD1bgtDar8Ww4OaRkaEUlrdNMIOrO0dnM64TA Sep 24 05:12:34.762671 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: X-Domain-Id: None Sep 24 05:12:34.762671 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: X-Domain-Name: None Sep 24 05:12:34.762671 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: X-Identity-Status: Confirmed Sep 24 05:12:34.762671 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: X-Is-Admin-Project: True Sep 24 05:12:34.762671 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: X-Project-Domain-Id: default Sep 24 05:12:34.762671 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: X-Project-Domain-Name: Default Sep 24 05:12:34.762671 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: X-Project-Id: 66ec8bde739145dda504995dbea0914a Sep 24 05:12:34.762671 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: X-Project-Name: tempest-AttachVolumeTestJSON-1531469116 Sep 24 05:12:34.762671 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: X-Role: member,reader Sep 24 05:12:34.762671 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: X-Roles: member,reader Sep 24 05:12:34.764343 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/66ec8bde739145dda504995dbea0914a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/66ec8bde739145dda504995dbea0914a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/66ec8bde739145dda504995dbea0914a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.50:8080", "publicURL": "http://10.222.0.50:8080/v1/AUTH_66ec8bde739145dda504995dbea0914a"}]}] Sep 24 05:12:34.764343 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: X-Tenant: tempest-AttachVolumeTestJSON-1531469116 Sep 24 05:12:34.764343 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: X-Tenant-Id: 66ec8bde739145dda504995dbea0914a Sep 24 05:12:34.764343 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1531469116 Sep 24 05:12:34.764343 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: X-User: tempest-AttachVolumeTestJSON-1531469116-project Sep 24 05:12:34.764343 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: X-User-Domain-Id: default Sep 24 05:12:34.764343 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: X-User-Domain-Name: Default Sep 24 05:12:34.764343 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: X-User-Id: 4b1b0448e7f54e3aaae49e411699269e Sep 24 05:12:34.764343 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: X-User-Name: tempest-AttachVolumeTestJSON-1531469116-project Sep 24 05:12:34.764343 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: method: > Sep 24 05:12:34.764343 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: exception: Instance b551478f-d1dc-4ab3-9e44-4e78b785b21f could not be found. Sep 24 05:12:34.764343 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: action_args: {'id': 'b551478f-d1dc-4ab3-9e44-4e78b785b21f'} Sep 24 05:12:34.765355 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 24 05:12:34.765355 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 05:12:34.765355 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 24 05:12:34.765355 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 24 05:12:34.765355 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 24 05:12:34.765355 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 24 05:12:34.765355 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 24 05:12:34.765355 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 24 05:12:34.765355 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 24 05:12:34.765355 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 24 05:12:34.765355 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b551478f-d1dc-4ab3-9e44-4e78b785b21f could not be found. Sep 24 05:12:34.765355 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi Sep 24 05:12:34.765355 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 05:12:34.765355 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi Sep 24 05:12:34.765355 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 05:12:34.765355 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 05:12:34.765355 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 05:12:34.765355 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 24 05:12:34.765355 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 24 05:12:34.765355 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 24 05:12:34.767326 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 24 05:12:34.767326 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 24 05:12:34.767326 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 24 05:12:34.767326 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 24 05:12:34.767326 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 24 05:12:34.767326 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 24 05:12:34.767326 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 24 05:12:34.767326 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b551478f-d1dc-4ab3-9e44-4e78b785b21f could not be found. Sep 24 05:12:34.767326 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi Sep 24 05:12:34.767326 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 05:12:34.767326 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi Sep 24 05:12:34.767326 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 05:12:34.767326 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 05:12:34.767326 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 05:12:34.767326 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 24 05:12:34.767326 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 24 05:12:34.767326 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b551478f-d1dc-4ab3-9e44-4e78b785b21f could not be found. Sep 24 05:12:34.767326 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi Sep 24 05:12:34.768696 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-c613c200-3101-426b-9ca9-215fca723222 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Returning 404 to user: Instance b551478f-d1dc-4ab3-9e44-4e78b785b21f could not be found. {{(pid=120593) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 24 05:12:34.768696 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-c613c200-3101-426b-9ca9-215fca723222 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] 10.222.0.50 "GET /compute/v2.1/servers/b551478f-d1dc-4ab3-9e44-4e78b785b21f" status: 404 len: 111 microversion: 2.1 time: 0.030982 Sep 24 05:12:34.768696 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 591/1206] 10.222.0.50 () {58 vars in 1236 bytes} [Sat Sep 24 05:12:34 2022] GET /compute/v2.1/servers/b551478f-d1dc-4ab3-9e44-4e78b785b21f => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 24 05:12:34.772731 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-ae9e0dfe-1131-4588-8309-a6e8a6e524fb tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Calling method '.version_select at 0x7f7950951dc0>' {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:12:34.791381 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [None req-ae9e0dfe-1131-4588-8309-a6e8a6e524fb tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] 10.222.0.50 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1053484567" status: 202 len: 0 microversion: 2.1 time: 0.022354 Sep 24 05:12:34.791944 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 616/1207] 10.222.0.50 () {58 vars in 1221 bytes} [Sat Sep 24 05:12:34 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1053484567 => generated 0 bytes in 24 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 24 05:12:37.685649 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-02fc3106-8951-45de-9e78-f6ea52782db7 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Calling method '>' {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:12:37.686194 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.compute.api [None req-02fc3106-8951-45de-9e78-f6ea52782db7 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] [instance: b551478f-d1dc-4ab3-9e44-4e78b785b21f] Fetching instance by UUID {{(pid=120593) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:12:37.692696 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-02fc3106-8951-45de-9e78-f6ea52782db7 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:12:37.693174 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-02fc3106-8951-45de-9e78-f6ea52782db7 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:12:37.693612 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-02fc3106-8951-45de-9e78-f6ea52782db7 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:12:37.694329 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-02fc3106-8951-45de-9e78-f6ea52782db7 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:12:37.694786 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-02fc3106-8951-45de-9e78-f6ea52782db7 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:12:37.695211 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-02fc3106-8951-45de-9e78-f6ea52782db7 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:12:37.708508 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.wsgi [None req-02fc3106-8951-45de-9e78-f6ea52782db7 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] HTTP exception thrown: Instance b551478f-d1dc-4ab3-9e44-4e78b785b21f could not be found. Sep 24 05:12:37.710043 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-02fc3106-8951-45de-9e78-f6ea52782db7 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Request method failure captured: Sep 24 05:12:37.710043 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: request: DELETE /compute/v2.1/servers/b551478f-d1dc-4ab3-9e44-4e78b785b21f HTTP/1.1 Sep 24 05:12:37.710043 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: Accept: application/json Sep 24 05:12:37.710043 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: Accept-Encoding: identity Sep 24 05:12:37.710043 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: Connection: close Sep 24 05:12:37.710043 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: Content-Length: 0 Sep 24 05:12:37.710043 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: Content-Type: application/json Sep 24 05:12:37.710043 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: Host: 10.222.0.50 Sep 24 05:12:37.710043 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: Openstack-System-Scope: None Sep 24 05:12:37.710043 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: User-Agent: python-urllib3/1.26.12 Sep 24 05:12:37.710043 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: X-Auth-Token: gAAAAABjLo8A_CV8_CcmOLJdbO1CHZ_VMsAEcpA541mM_Xx_bnEYb9KbQB8GkpDr_kW76CRgxi1HVxhwSWPV_l8j6w2MLcWnpsGWMgMDlRXPK4lnqHJLbW7N0ODeHl05uvEeeYUdVCWPx9rjn6MD1bgtDar8Ww4OaRkaEUlrdNMIOrO0dnM64TA Sep 24 05:12:37.710043 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: X-Domain-Id: None Sep 24 05:12:37.710043 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: X-Domain-Name: None Sep 24 05:12:37.710043 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: X-Identity-Status: Confirmed Sep 24 05:12:37.710043 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: X-Is-Admin-Project: True Sep 24 05:12:37.710043 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: X-Project-Domain-Id: default Sep 24 05:12:37.710043 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: X-Project-Domain-Name: Default Sep 24 05:12:37.710043 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: X-Project-Id: 66ec8bde739145dda504995dbea0914a Sep 24 05:12:37.710043 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: X-Project-Name: tempest-AttachVolumeTestJSON-1531469116 Sep 24 05:12:37.710043 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: X-Role: member,reader Sep 24 05:12:37.710043 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: X-Roles: member,reader Sep 24 05:12:37.711675 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/66ec8bde739145dda504995dbea0914a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/66ec8bde739145dda504995dbea0914a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/66ec8bde739145dda504995dbea0914a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.50:8080", "publicURL": "http://10.222.0.50:8080/v1/AUTH_66ec8bde739145dda504995dbea0914a"}]}] Sep 24 05:12:37.711675 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: X-Tenant: tempest-AttachVolumeTestJSON-1531469116 Sep 24 05:12:37.711675 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: X-Tenant-Id: 66ec8bde739145dda504995dbea0914a Sep 24 05:12:37.711675 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1531469116 Sep 24 05:12:37.711675 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: X-User: tempest-AttachVolumeTestJSON-1531469116-project Sep 24 05:12:37.711675 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: X-User-Domain-Id: default Sep 24 05:12:37.711675 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: X-User-Domain-Name: Default Sep 24 05:12:37.711675 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: X-User-Id: 4b1b0448e7f54e3aaae49e411699269e Sep 24 05:12:37.711675 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: X-User-Name: tempest-AttachVolumeTestJSON-1531469116-project Sep 24 05:12:37.711675 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: method: > Sep 24 05:12:37.711675 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: exception: Instance b551478f-d1dc-4ab3-9e44-4e78b785b21f could not be found. Sep 24 05:12:37.711675 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: action_args: {'id': 'b551478f-d1dc-4ab3-9e44-4e78b785b21f'} Sep 24 05:12:37.712637 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 24 05:12:37.712637 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 05:12:37.712637 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 24 05:12:37.712637 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 24 05:12:37.712637 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 24 05:12:37.712637 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 24 05:12:37.712637 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 24 05:12:37.712637 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 24 05:12:37.712637 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 24 05:12:37.712637 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 24 05:12:37.712637 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b551478f-d1dc-4ab3-9e44-4e78b785b21f could not be found. Sep 24 05:12:37.712637 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi Sep 24 05:12:37.712637 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 05:12:37.712637 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi Sep 24 05:12:37.712637 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 05:12:37.712637 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 05:12:37.712637 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 05:12:37.712637 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 24 05:12:37.712637 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 24 05:12:37.712637 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 24 05:12:37.714146 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 24 05:12:37.714146 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 24 05:12:37.714146 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 24 05:12:37.714146 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 24 05:12:37.714146 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 24 05:12:37.714146 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 24 05:12:37.714146 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 24 05:12:37.714146 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 24 05:12:37.714146 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 24 05:12:37.714146 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b551478f-d1dc-4ab3-9e44-4e78b785b21f could not be found. Sep 24 05:12:37.714146 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi Sep 24 05:12:37.714146 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 05:12:37.714146 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi Sep 24 05:12:37.714146 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 05:12:37.714146 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 05:12:37.714146 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 05:12:37.714146 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 24 05:12:37.714146 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 24 05:12:37.714146 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b551478f-d1dc-4ab3-9e44-4e78b785b21f could not be found. Sep 24 05:12:37.714146 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi Sep 24 05:12:37.715571 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-02fc3106-8951-45de-9e78-f6ea52782db7 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Returning 404 to user: Instance b551478f-d1dc-4ab3-9e44-4e78b785b21f could not be found. {{(pid=120593) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 24 05:12:37.715571 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-02fc3106-8951-45de-9e78-f6ea52782db7 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] 10.222.0.50 "DELETE /compute/v2.1/servers/b551478f-d1dc-4ab3-9e44-4e78b785b21f" status: 404 len: 111 microversion: 2.1 time: 0.029693 Sep 24 05:12:37.715571 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 592/1208] 10.222.0.50 () {58 vars in 1239 bytes} [Sat Sep 24 05:12:37 2022] DELETE /compute/v2.1/servers/b551478f-d1dc-4ab3-9e44-4e78b785b21f => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 24 05:12:37.720342 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-5bbec8bc-0e2b-4eb3-8965-8002fb056f2c tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Calling method '>' {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:12:37.721006 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.compute.api [None req-5bbec8bc-0e2b-4eb3-8965-8002fb056f2c tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] [instance: b551478f-d1dc-4ab3-9e44-4e78b785b21f] Fetching instance by UUID {{(pid=120594) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:12:37.727958 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-5bbec8bc-0e2b-4eb3-8965-8002fb056f2c tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:12:37.728433 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-5bbec8bc-0e2b-4eb3-8965-8002fb056f2c tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:12:37.728868 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-5bbec8bc-0e2b-4eb3-8965-8002fb056f2c tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:12:37.729555 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-5bbec8bc-0e2b-4eb3-8965-8002fb056f2c tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:12:37.730039 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-5bbec8bc-0e2b-4eb3-8965-8002fb056f2c tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:12:37.730485 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-5bbec8bc-0e2b-4eb3-8965-8002fb056f2c tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:12:37.744073 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: INFO nova.api.openstack.wsgi [None req-5bbec8bc-0e2b-4eb3-8965-8002fb056f2c tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] HTTP exception thrown: Instance b551478f-d1dc-4ab3-9e44-4e78b785b21f could not be found. Sep 24 05:12:37.745683 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-5bbec8bc-0e2b-4eb3-8965-8002fb056f2c tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Request method failure captured: Sep 24 05:12:37.745683 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: request: GET /compute/v2.1/servers/b551478f-d1dc-4ab3-9e44-4e78b785b21f HTTP/1.1 Sep 24 05:12:37.745683 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: Accept: application/json Sep 24 05:12:37.745683 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: Accept-Encoding: identity Sep 24 05:12:37.745683 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: Connection: close Sep 24 05:12:37.745683 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: Content-Length: 0 Sep 24 05:12:37.745683 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: Content-Type: application/json Sep 24 05:12:37.745683 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: Host: 10.222.0.50 Sep 24 05:12:37.745683 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: Openstack-System-Scope: None Sep 24 05:12:37.745683 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: User-Agent: python-urllib3/1.26.12 Sep 24 05:12:37.745683 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: X-Auth-Token: gAAAAABjLo8A_CV8_CcmOLJdbO1CHZ_VMsAEcpA541mM_Xx_bnEYb9KbQB8GkpDr_kW76CRgxi1HVxhwSWPV_l8j6w2MLcWnpsGWMgMDlRXPK4lnqHJLbW7N0ODeHl05uvEeeYUdVCWPx9rjn6MD1bgtDar8Ww4OaRkaEUlrdNMIOrO0dnM64TA Sep 24 05:12:37.745683 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: X-Domain-Id: None Sep 24 05:12:37.745683 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: X-Domain-Name: None Sep 24 05:12:37.745683 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: X-Identity-Status: Confirmed Sep 24 05:12:37.745683 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: X-Is-Admin-Project: True Sep 24 05:12:37.745683 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: X-Project-Domain-Id: default Sep 24 05:12:37.745683 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: X-Project-Domain-Name: Default Sep 24 05:12:37.745683 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: X-Project-Id: 66ec8bde739145dda504995dbea0914a Sep 24 05:12:37.745683 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: X-Project-Name: tempest-AttachVolumeTestJSON-1531469116 Sep 24 05:12:37.745683 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: X-Role: member,reader Sep 24 05:12:37.745683 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: X-Roles: member,reader Sep 24 05:12:37.747324 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/66ec8bde739145dda504995dbea0914a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/66ec8bde739145dda504995dbea0914a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/66ec8bde739145dda504995dbea0914a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.50:8080", "publicURL": "http://10.222.0.50:8080/v1/AUTH_66ec8bde739145dda504995dbea0914a"}]}] Sep 24 05:12:37.747324 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: X-Tenant: tempest-AttachVolumeTestJSON-1531469116 Sep 24 05:12:37.747324 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: X-Tenant-Id: 66ec8bde739145dda504995dbea0914a Sep 24 05:12:37.747324 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1531469116 Sep 24 05:12:37.747324 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: X-User: tempest-AttachVolumeTestJSON-1531469116-project Sep 24 05:12:37.747324 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: X-User-Domain-Id: default Sep 24 05:12:37.747324 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: X-User-Domain-Name: Default Sep 24 05:12:37.747324 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: X-User-Id: 4b1b0448e7f54e3aaae49e411699269e Sep 24 05:12:37.747324 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: X-User-Name: tempest-AttachVolumeTestJSON-1531469116-project Sep 24 05:12:37.747324 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: method: > Sep 24 05:12:37.747324 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: exception: Instance b551478f-d1dc-4ab3-9e44-4e78b785b21f could not be found. Sep 24 05:12:37.747324 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: action_args: {'id': 'b551478f-d1dc-4ab3-9e44-4e78b785b21f'} Sep 24 05:12:37.748255 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 24 05:12:37.748255 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 05:12:37.748255 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 24 05:12:37.748255 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 24 05:12:37.748255 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 24 05:12:37.748255 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 24 05:12:37.748255 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 24 05:12:37.748255 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 24 05:12:37.748255 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 24 05:12:37.748255 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 24 05:12:37.748255 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b551478f-d1dc-4ab3-9e44-4e78b785b21f could not be found. Sep 24 05:12:37.748255 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi Sep 24 05:12:37.748255 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 05:12:37.748255 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi Sep 24 05:12:37.748255 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 05:12:37.748255 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 05:12:37.748255 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 05:12:37.748255 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 24 05:12:37.748255 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 24 05:12:37.748255 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 24 05:12:37.749825 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 24 05:12:37.749825 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 24 05:12:37.749825 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 24 05:12:37.749825 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 24 05:12:37.749825 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 24 05:12:37.749825 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 24 05:12:37.749825 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 24 05:12:37.749825 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b551478f-d1dc-4ab3-9e44-4e78b785b21f could not be found. Sep 24 05:12:37.749825 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi Sep 24 05:12:37.749825 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 05:12:37.749825 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi Sep 24 05:12:37.749825 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 05:12:37.749825 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 05:12:37.749825 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 05:12:37.749825 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 24 05:12:37.749825 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 24 05:12:37.749825 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b551478f-d1dc-4ab3-9e44-4e78b785b21f could not be found. Sep 24 05:12:37.749825 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi Sep 24 05:12:37.751428 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-5bbec8bc-0e2b-4eb3-8965-8002fb056f2c tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Returning 404 to user: Instance b551478f-d1dc-4ab3-9e44-4e78b785b21f could not be found. {{(pid=120594) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 24 05:12:37.751428 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [None req-5bbec8bc-0e2b-4eb3-8965-8002fb056f2c tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] 10.222.0.50 "GET /compute/v2.1/servers/b551478f-d1dc-4ab3-9e44-4e78b785b21f" status: 404 len: 111 microversion: 2.1 time: 0.031230 Sep 24 05:12:37.751428 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 617/1209] 10.222.0.50 () {58 vars in 1236 bytes} [Sat Sep 24 05:12:37 2022] GET /compute/v2.1/servers/b551478f-d1dc-4ab3-9e44-4e78b785b21f => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 24 05:12:38.887136 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-c8604f47-831e-4171-871a-64b1bc375a44 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Calling method '>' {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:12:38.887611 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.compute.api [None req-c8604f47-831e-4171-871a-64b1bc375a44 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] [instance: b2daebb8-dfea-4ab9-8253-008a21f906e1] Fetching instance by UUID {{(pid=120593) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:12:38.893907 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-c8604f47-831e-4171-871a-64b1bc375a44 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:12:38.894415 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-c8604f47-831e-4171-871a-64b1bc375a44 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:12:38.894843 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-c8604f47-831e-4171-871a-64b1bc375a44 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:12:38.895520 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-c8604f47-831e-4171-871a-64b1bc375a44 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:12:38.895967 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-c8604f47-831e-4171-871a-64b1bc375a44 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:12:38.896387 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-c8604f47-831e-4171-871a-64b1bc375a44 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:12:38.909828 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.wsgi [None req-c8604f47-831e-4171-871a-64b1bc375a44 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] HTTP exception thrown: Instance b2daebb8-dfea-4ab9-8253-008a21f906e1 could not be found. Sep 24 05:12:38.911294 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-c8604f47-831e-4171-871a-64b1bc375a44 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Request method failure captured: Sep 24 05:12:38.911294 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: request: DELETE /compute/v2.1/servers/b2daebb8-dfea-4ab9-8253-008a21f906e1 HTTP/1.1 Sep 24 05:12:38.911294 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: Accept: application/json Sep 24 05:12:38.911294 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: Accept-Encoding: identity Sep 24 05:12:38.911294 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: Connection: close Sep 24 05:12:38.911294 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: Content-Length: 0 Sep 24 05:12:38.911294 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: Content-Type: application/json Sep 24 05:12:38.911294 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: Host: 10.222.0.50 Sep 24 05:12:38.911294 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: Openstack-System-Scope: None Sep 24 05:12:38.911294 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: User-Agent: python-urllib3/1.26.12 Sep 24 05:12:38.911294 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: X-Auth-Token: gAAAAABjLo8A_CV8_CcmOLJdbO1CHZ_VMsAEcpA541mM_Xx_bnEYb9KbQB8GkpDr_kW76CRgxi1HVxhwSWPV_l8j6w2MLcWnpsGWMgMDlRXPK4lnqHJLbW7N0ODeHl05uvEeeYUdVCWPx9rjn6MD1bgtDar8Ww4OaRkaEUlrdNMIOrO0dnM64TA Sep 24 05:12:38.911294 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: X-Domain-Id: None Sep 24 05:12:38.911294 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: X-Domain-Name: None Sep 24 05:12:38.911294 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: X-Identity-Status: Confirmed Sep 24 05:12:38.911294 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: X-Is-Admin-Project: True Sep 24 05:12:38.911294 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: X-Project-Domain-Id: default Sep 24 05:12:38.911294 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: X-Project-Domain-Name: Default Sep 24 05:12:38.911294 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: X-Project-Id: 66ec8bde739145dda504995dbea0914a Sep 24 05:12:38.911294 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: X-Project-Name: tempest-AttachVolumeTestJSON-1531469116 Sep 24 05:12:38.911294 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: X-Role: member,reader Sep 24 05:12:38.911294 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: X-Roles: member,reader Sep 24 05:12:38.912893 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/66ec8bde739145dda504995dbea0914a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/66ec8bde739145dda504995dbea0914a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/66ec8bde739145dda504995dbea0914a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.50:8080", "publicURL": "http://10.222.0.50:8080/v1/AUTH_66ec8bde739145dda504995dbea0914a"}]}] Sep 24 05:12:38.912893 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: X-Tenant: tempest-AttachVolumeTestJSON-1531469116 Sep 24 05:12:38.912893 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: X-Tenant-Id: 66ec8bde739145dda504995dbea0914a Sep 24 05:12:38.912893 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1531469116 Sep 24 05:12:38.912893 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: X-User: tempest-AttachVolumeTestJSON-1531469116-project Sep 24 05:12:38.912893 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: X-User-Domain-Id: default Sep 24 05:12:38.912893 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: X-User-Domain-Name: Default Sep 24 05:12:38.912893 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: X-User-Id: 4b1b0448e7f54e3aaae49e411699269e Sep 24 05:12:38.912893 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: X-User-Name: tempest-AttachVolumeTestJSON-1531469116-project Sep 24 05:12:38.912893 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: method: > Sep 24 05:12:38.912893 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: exception: Instance b2daebb8-dfea-4ab9-8253-008a21f906e1 could not be found. Sep 24 05:12:38.912893 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: action_args: {'id': 'b2daebb8-dfea-4ab9-8253-008a21f906e1'} Sep 24 05:12:38.913789 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 24 05:12:38.913789 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 05:12:38.913789 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 24 05:12:38.913789 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 24 05:12:38.913789 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 24 05:12:38.913789 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 24 05:12:38.913789 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 24 05:12:38.913789 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 24 05:12:38.913789 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 24 05:12:38.913789 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 24 05:12:38.913789 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b2daebb8-dfea-4ab9-8253-008a21f906e1 could not be found. Sep 24 05:12:38.913789 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi Sep 24 05:12:38.913789 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 05:12:38.913789 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi Sep 24 05:12:38.913789 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 05:12:38.913789 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 05:12:38.913789 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 05:12:38.913789 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 24 05:12:38.913789 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 24 05:12:38.913789 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 24 05:12:38.915900 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 24 05:12:38.915900 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 24 05:12:38.915900 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 24 05:12:38.915900 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 24 05:12:38.915900 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 24 05:12:38.915900 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 24 05:12:38.915900 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 24 05:12:38.915900 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 24 05:12:38.915900 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 24 05:12:38.915900 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b2daebb8-dfea-4ab9-8253-008a21f906e1 could not be found. Sep 24 05:12:38.915900 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi Sep 24 05:12:38.915900 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 05:12:38.915900 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi Sep 24 05:12:38.915900 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 05:12:38.915900 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 05:12:38.915900 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 05:12:38.915900 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 24 05:12:38.915900 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 24 05:12:38.915900 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b2daebb8-dfea-4ab9-8253-008a21f906e1 could not be found. Sep 24 05:12:38.915900 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi Sep 24 05:12:38.917372 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-c8604f47-831e-4171-871a-64b1bc375a44 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Returning 404 to user: Instance b2daebb8-dfea-4ab9-8253-008a21f906e1 could not be found. {{(pid=120593) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 24 05:12:38.917372 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-c8604f47-831e-4171-871a-64b1bc375a44 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] 10.222.0.50 "DELETE /compute/v2.1/servers/b2daebb8-dfea-4ab9-8253-008a21f906e1" status: 404 len: 111 microversion: 2.1 time: 0.030033 Sep 24 05:12:38.917372 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 593/1210] 10.222.0.50 () {58 vars in 1239 bytes} [Sat Sep 24 05:12:38 2022] DELETE /compute/v2.1/servers/b2daebb8-dfea-4ab9-8253-008a21f906e1 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 24 05:12:38.921558 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-682f5608-359c-43eb-a6f4-e7a35c81eaf3 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Calling method '>' {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:12:38.922197 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.compute.api [None req-682f5608-359c-43eb-a6f4-e7a35c81eaf3 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] [instance: b2daebb8-dfea-4ab9-8253-008a21f906e1] Fetching instance by UUID {{(pid=120594) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:12:38.928117 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-682f5608-359c-43eb-a6f4-e7a35c81eaf3 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:12:38.928595 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-682f5608-359c-43eb-a6f4-e7a35c81eaf3 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:12:38.929032 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-682f5608-359c-43eb-a6f4-e7a35c81eaf3 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:12:38.929718 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-682f5608-359c-43eb-a6f4-e7a35c81eaf3 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:12:38.930203 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-682f5608-359c-43eb-a6f4-e7a35c81eaf3 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:12:38.931254 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-682f5608-359c-43eb-a6f4-e7a35c81eaf3 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:12:38.944292 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: INFO nova.api.openstack.wsgi [None req-682f5608-359c-43eb-a6f4-e7a35c81eaf3 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] HTTP exception thrown: Instance b2daebb8-dfea-4ab9-8253-008a21f906e1 could not be found. Sep 24 05:12:38.945808 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-682f5608-359c-43eb-a6f4-e7a35c81eaf3 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Request method failure captured: Sep 24 05:12:38.945808 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: request: GET /compute/v2.1/servers/b2daebb8-dfea-4ab9-8253-008a21f906e1 HTTP/1.1 Sep 24 05:12:38.945808 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: Accept: application/json Sep 24 05:12:38.945808 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: Accept-Encoding: identity Sep 24 05:12:38.945808 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: Connection: close Sep 24 05:12:38.945808 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: Content-Length: 0 Sep 24 05:12:38.945808 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: Content-Type: application/json Sep 24 05:12:38.945808 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: Host: 10.222.0.50 Sep 24 05:12:38.945808 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: Openstack-System-Scope: None Sep 24 05:12:38.945808 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: User-Agent: python-urllib3/1.26.12 Sep 24 05:12:38.945808 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: X-Auth-Token: gAAAAABjLo8A_CV8_CcmOLJdbO1CHZ_VMsAEcpA541mM_Xx_bnEYb9KbQB8GkpDr_kW76CRgxi1HVxhwSWPV_l8j6w2MLcWnpsGWMgMDlRXPK4lnqHJLbW7N0ODeHl05uvEeeYUdVCWPx9rjn6MD1bgtDar8Ww4OaRkaEUlrdNMIOrO0dnM64TA Sep 24 05:12:38.945808 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: X-Domain-Id: None Sep 24 05:12:38.945808 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: X-Domain-Name: None Sep 24 05:12:38.945808 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: X-Identity-Status: Confirmed Sep 24 05:12:38.945808 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: X-Is-Admin-Project: True Sep 24 05:12:38.945808 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: X-Project-Domain-Id: default Sep 24 05:12:38.945808 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: X-Project-Domain-Name: Default Sep 24 05:12:38.945808 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: X-Project-Id: 66ec8bde739145dda504995dbea0914a Sep 24 05:12:38.945808 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: X-Project-Name: tempest-AttachVolumeTestJSON-1531469116 Sep 24 05:12:38.945808 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: X-Role: member,reader Sep 24 05:12:38.945808 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: X-Roles: member,reader Sep 24 05:12:38.947431 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/66ec8bde739145dda504995dbea0914a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/66ec8bde739145dda504995dbea0914a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/66ec8bde739145dda504995dbea0914a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.50:8080", "publicURL": "http://10.222.0.50:8080/v1/AUTH_66ec8bde739145dda504995dbea0914a"}]}] Sep 24 05:12:38.947431 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: X-Tenant: tempest-AttachVolumeTestJSON-1531469116 Sep 24 05:12:38.947431 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: X-Tenant-Id: 66ec8bde739145dda504995dbea0914a Sep 24 05:12:38.947431 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1531469116 Sep 24 05:12:38.947431 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: X-User: tempest-AttachVolumeTestJSON-1531469116-project Sep 24 05:12:38.947431 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: X-User-Domain-Id: default Sep 24 05:12:38.947431 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: X-User-Domain-Name: Default Sep 24 05:12:38.947431 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: X-User-Id: 4b1b0448e7f54e3aaae49e411699269e Sep 24 05:12:38.947431 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: X-User-Name: tempest-AttachVolumeTestJSON-1531469116-project Sep 24 05:12:38.947431 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: method: > Sep 24 05:12:38.947431 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: exception: Instance b2daebb8-dfea-4ab9-8253-008a21f906e1 could not be found. Sep 24 05:12:38.947431 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: action_args: {'id': 'b2daebb8-dfea-4ab9-8253-008a21f906e1'} Sep 24 05:12:38.951531 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 24 05:12:38.951531 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 05:12:38.951531 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 24 05:12:38.951531 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 24 05:12:38.951531 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 24 05:12:38.951531 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 24 05:12:38.951531 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 24 05:12:38.951531 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 24 05:12:38.951531 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 24 05:12:38.951531 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 24 05:12:38.951531 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b2daebb8-dfea-4ab9-8253-008a21f906e1 could not be found. Sep 24 05:12:38.951531 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi Sep 24 05:12:38.951531 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 05:12:38.951531 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi Sep 24 05:12:38.951531 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 05:12:38.951531 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 05:12:38.951531 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 05:12:38.951531 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 24 05:12:38.951531 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 24 05:12:38.951531 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 24 05:12:38.953467 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 24 05:12:38.953467 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 24 05:12:38.953467 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 24 05:12:38.953467 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 24 05:12:38.953467 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 24 05:12:38.953467 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 24 05:12:38.953467 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 24 05:12:38.953467 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b2daebb8-dfea-4ab9-8253-008a21f906e1 could not be found. Sep 24 05:12:38.953467 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi Sep 24 05:12:38.953467 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 05:12:38.953467 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi Sep 24 05:12:38.953467 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 05:12:38.953467 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 05:12:38.953467 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 05:12:38.953467 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 24 05:12:38.953467 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 24 05:12:38.953467 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b2daebb8-dfea-4ab9-8253-008a21f906e1 could not be found. Sep 24 05:12:38.953467 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi Sep 24 05:12:38.954809 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-682f5608-359c-43eb-a6f4-e7a35c81eaf3 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] Returning 404 to user: Instance b2daebb8-dfea-4ab9-8253-008a21f906e1 could not be found. {{(pid=120594) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 24 05:12:38.954809 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [None req-682f5608-359c-43eb-a6f4-e7a35c81eaf3 tempest-AttachVolumeTestJSON-1531469116 tempest-AttachVolumeTestJSON-1531469116-project] 10.222.0.50 "GET /compute/v2.1/servers/b2daebb8-dfea-4ab9-8253-008a21f906e1" status: 404 len: 111 microversion: 2.1 time: 0.029657 Sep 24 05:12:38.954809 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 618/1211] 10.222.0.50 () {58 vars in 1236 bytes} [Sat Sep 24 05:12:38 2022] GET /compute/v2.1/servers/b2daebb8-dfea-4ab9-8253-008a21f906e1 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 24 05:12:41.111094 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-69f9e880-1ff3-45fb-91b7-fca94fd1210f tempest-TestMinimumBasicScenario-2093795776 tempest-TestMinimumBasicScenario-2093795776-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 05:12:41.113462 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.compute.api [None req-69f9e880-1ff3-45fb-91b7-fca94fd1210f tempest-TestMinimumBasicScenario-2093795776 tempest-TestMinimumBasicScenario-2093795776-project] [instance: c8dc693a-12ca-40a8-8ce8-4f5cb342fb8f] Fetching instance by UUID {{(pid=120593) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:12:41.120022 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-69f9e880-1ff3-45fb-91b7-fca94fd1210f tempest-TestMinimumBasicScenario-2093795776 tempest-TestMinimumBasicScenario-2093795776-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:12:41.120495 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-69f9e880-1ff3-45fb-91b7-fca94fd1210f tempest-TestMinimumBasicScenario-2093795776 tempest-TestMinimumBasicScenario-2093795776-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:12:41.120927 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-69f9e880-1ff3-45fb-91b7-fca94fd1210f tempest-TestMinimumBasicScenario-2093795776 tempest-TestMinimumBasicScenario-2093795776-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:12:41.121607 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-69f9e880-1ff3-45fb-91b7-fca94fd1210f tempest-TestMinimumBasicScenario-2093795776 tempest-TestMinimumBasicScenario-2093795776-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:12:41.122085 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-69f9e880-1ff3-45fb-91b7-fca94fd1210f tempest-TestMinimumBasicScenario-2093795776 tempest-TestMinimumBasicScenario-2093795776-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:12:41.122505 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-69f9e880-1ff3-45fb-91b7-fca94fd1210f tempest-TestMinimumBasicScenario-2093795776 tempest-TestMinimumBasicScenario-2093795776-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:12:41.196707 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-69f9e880-1ff3-45fb-91b7-fca94fd1210f tempest-TestMinimumBasicScenario-2093795776 tempest-TestMinimumBasicScenario-2093795776-project] 10.222.0.50 "POST /compute/v2.1/servers/c8dc693a-12ca-40a8-8ce8-4f5cb342fb8f/action" status: 202 len: 0 microversion: 2.1 time: 0.088785 Sep 24 05:12:41.197588 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 594/1212] 10.222.0.50 () {60 vars in 1278 bytes} [Sat Sep 24 05:12:41 2022] POST /compute/v2.1/servers/c8dc693a-12ca-40a8-8ce8-4f5cb342fb8f/action => generated 0 bytes in 91 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 24 05:12:41.207165 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-82cdb73a-892a-4ce9-a813-02f032eab686 tempest-TestMinimumBasicScenario-2093795776 tempest-TestMinimumBasicScenario-2093795776-project] Calling method '>' {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:12:41.207853 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.compute.api [None req-82cdb73a-892a-4ce9-a813-02f032eab686 tempest-TestMinimumBasicScenario-2093795776 tempest-TestMinimumBasicScenario-2093795776-project] [instance: c8dc693a-12ca-40a8-8ce8-4f5cb342fb8f] Fetching instance by UUID {{(pid=120594) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:12:41.214917 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-82cdb73a-892a-4ce9-a813-02f032eab686 tempest-TestMinimumBasicScenario-2093795776 tempest-TestMinimumBasicScenario-2093795776-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:12:41.215473 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-82cdb73a-892a-4ce9-a813-02f032eab686 tempest-TestMinimumBasicScenario-2093795776 tempest-TestMinimumBasicScenario-2093795776-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:12:41.215994 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-82cdb73a-892a-4ce9-a813-02f032eab686 tempest-TestMinimumBasicScenario-2093795776 tempest-TestMinimumBasicScenario-2093795776-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:12:41.216763 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-82cdb73a-892a-4ce9-a813-02f032eab686 tempest-TestMinimumBasicScenario-2093795776 tempest-TestMinimumBasicScenario-2093795776-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:12:41.217399 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-82cdb73a-892a-4ce9-a813-02f032eab686 tempest-TestMinimumBasicScenario-2093795776 tempest-TestMinimumBasicScenario-2093795776-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:12:41.217871 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-82cdb73a-892a-4ce9-a813-02f032eab686 tempest-TestMinimumBasicScenario-2093795776 tempest-TestMinimumBasicScenario-2093795776-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:12:41.700147 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.policy [None req-82cdb73a-892a-4ce9-a813-02f032eab686 tempest-TestMinimumBasicScenario-2093795776 tempest-TestMinimumBasicScenario-2093795776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f67fe549bae6447f8b24219becb3bf97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85c73f9a74da4079a54a503e0b42ca2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:12:41.708743 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [None req-82cdb73a-892a-4ce9-a813-02f032eab686 tempest-TestMinimumBasicScenario-2093795776 tempest-TestMinimumBasicScenario-2093795776-project] 10.222.0.50 "GET /compute/v2.1/servers/c8dc693a-12ca-40a8-8ce8-4f5cb342fb8f" status: 200 len: 1752 microversion: 2.1 time: 0.506251 Sep 24 05:12:41.712923 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 619/1213] 10.222.0.50 () {58 vars in 1236 bytes} [Sat Sep 24 05:12:41 2022] GET /compute/v2.1/servers/c8dc693a-12ca-40a8-8ce8-4f5cb342fb8f => generated 1752 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 05:12:42.733610 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-23c4a4d0-ce6f-482d-aab8-113dd0c2483a tempest-TestMinimumBasicScenario-2093795776 tempest-TestMinimumBasicScenario-2093795776-project] Calling method '>' {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:12:42.734342 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.compute.api [None req-23c4a4d0-ce6f-482d-aab8-113dd0c2483a tempest-TestMinimumBasicScenario-2093795776 tempest-TestMinimumBasicScenario-2093795776-project] [instance: c8dc693a-12ca-40a8-8ce8-4f5cb342fb8f] Fetching instance by UUID {{(pid=120593) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:12:42.740632 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-23c4a4d0-ce6f-482d-aab8-113dd0c2483a tempest-TestMinimumBasicScenario-2093795776 tempest-TestMinimumBasicScenario-2093795776-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:12:42.741126 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-23c4a4d0-ce6f-482d-aab8-113dd0c2483a tempest-TestMinimumBasicScenario-2093795776 tempest-TestMinimumBasicScenario-2093795776-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:12:42.741565 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-23c4a4d0-ce6f-482d-aab8-113dd0c2483a tempest-TestMinimumBasicScenario-2093795776 tempest-TestMinimumBasicScenario-2093795776-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:12:42.742767 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-23c4a4d0-ce6f-482d-aab8-113dd0c2483a tempest-TestMinimumBasicScenario-2093795776 tempest-TestMinimumBasicScenario-2093795776-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:12:42.743460 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-23c4a4d0-ce6f-482d-aab8-113dd0c2483a tempest-TestMinimumBasicScenario-2093795776 tempest-TestMinimumBasicScenario-2093795776-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:12:42.744021 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-23c4a4d0-ce6f-482d-aab8-113dd0c2483a tempest-TestMinimumBasicScenario-2093795776 tempest-TestMinimumBasicScenario-2093795776-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:12:42.908949 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-23c4a4d0-ce6f-482d-aab8-113dd0c2483a tempest-TestMinimumBasicScenario-2093795776 tempest-TestMinimumBasicScenario-2093795776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f67fe549bae6447f8b24219becb3bf97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85c73f9a74da4079a54a503e0b42ca2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:12:42.917492 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-23c4a4d0-ce6f-482d-aab8-113dd0c2483a tempest-TestMinimumBasicScenario-2093795776 tempest-TestMinimumBasicScenario-2093795776-project] 10.222.0.50 "GET /compute/v2.1/servers/c8dc693a-12ca-40a8-8ce8-4f5cb342fb8f" status: 200 len: 1757 microversion: 2.1 time: 0.188493 Sep 24 05:12:42.918080 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 595/1214] 10.222.0.50 () {58 vars in 1236 bytes} [Sat Sep 24 05:12:42 2022] GET /compute/v2.1/servers/c8dc693a-12ca-40a8-8ce8-4f5cb342fb8f => generated 1757 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 05:12:43.940394 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-5eca896a-434b-43e7-b6c2-cca145ef6603 tempest-TestMinimumBasicScenario-2093795776 tempest-TestMinimumBasicScenario-2093795776-project] Calling method '>' {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:12:43.941084 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.compute.api [None req-5eca896a-434b-43e7-b6c2-cca145ef6603 tempest-TestMinimumBasicScenario-2093795776 tempest-TestMinimumBasicScenario-2093795776-project] [instance: c8dc693a-12ca-40a8-8ce8-4f5cb342fb8f] Fetching instance by UUID {{(pid=120594) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:12:43.948575 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-5eca896a-434b-43e7-b6c2-cca145ef6603 tempest-TestMinimumBasicScenario-2093795776 tempest-TestMinimumBasicScenario-2093795776-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:12:43.949093 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-5eca896a-434b-43e7-b6c2-cca145ef6603 tempest-TestMinimumBasicScenario-2093795776 tempest-TestMinimumBasicScenario-2093795776-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:12:43.949548 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-5eca896a-434b-43e7-b6c2-cca145ef6603 tempest-TestMinimumBasicScenario-2093795776 tempest-TestMinimumBasicScenario-2093795776-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:12:43.950257 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-5eca896a-434b-43e7-b6c2-cca145ef6603 tempest-TestMinimumBasicScenario-2093795776 tempest-TestMinimumBasicScenario-2093795776-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:12:43.950701 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-5eca896a-434b-43e7-b6c2-cca145ef6603 tempest-TestMinimumBasicScenario-2093795776 tempest-TestMinimumBasicScenario-2093795776-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:12:43.951112 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-5eca896a-434b-43e7-b6c2-cca145ef6603 tempest-TestMinimumBasicScenario-2093795776 tempest-TestMinimumBasicScenario-2093795776-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:12:44.100333 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.policy [None req-5eca896a-434b-43e7-b6c2-cca145ef6603 tempest-TestMinimumBasicScenario-2093795776 tempest-TestMinimumBasicScenario-2093795776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f67fe549bae6447f8b24219becb3bf97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85c73f9a74da4079a54a503e0b42ca2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:12:44.109336 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [None req-5eca896a-434b-43e7-b6c2-cca145ef6603 tempest-TestMinimumBasicScenario-2093795776 tempest-TestMinimumBasicScenario-2093795776-project] 10.222.0.50 "GET /compute/v2.1/servers/c8dc693a-12ca-40a8-8ce8-4f5cb342fb8f" status: 200 len: 1757 microversion: 2.1 time: 0.172772 Sep 24 05:12:44.109893 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 620/1215] 10.222.0.50 () {58 vars in 1236 bytes} [Sat Sep 24 05:12:43 2022] GET /compute/v2.1/servers/c8dc693a-12ca-40a8-8ce8-4f5cb342fb8f => generated 1757 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 05:12:45.132184 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-e280e581-9b6a-4f12-b374-f8a9e8e4fba2 tempest-TestMinimumBasicScenario-2093795776 tempest-TestMinimumBasicScenario-2093795776-project] Calling method '>' {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:12:45.132790 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.compute.api [None req-e280e581-9b6a-4f12-b374-f8a9e8e4fba2 tempest-TestMinimumBasicScenario-2093795776 tempest-TestMinimumBasicScenario-2093795776-project] [instance: c8dc693a-12ca-40a8-8ce8-4f5cb342fb8f] Fetching instance by UUID {{(pid=120593) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:12:45.135704 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG dbcounter [-] [120593] Writing DB stats nova_api:SELECT=33,nova_api:UPDATE=1 {{(pid=120593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 05:12:45.141540 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-e280e581-9b6a-4f12-b374-f8a9e8e4fba2 tempest-TestMinimumBasicScenario-2093795776 tempest-TestMinimumBasicScenario-2093795776-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:12:45.142828 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-e280e581-9b6a-4f12-b374-f8a9e8e4fba2 tempest-TestMinimumBasicScenario-2093795776 tempest-TestMinimumBasicScenario-2093795776-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:12:45.143507 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-e280e581-9b6a-4f12-b374-f8a9e8e4fba2 tempest-TestMinimumBasicScenario-2093795776 tempest-TestMinimumBasicScenario-2093795776-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:12:45.144067 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-e280e581-9b6a-4f12-b374-f8a9e8e4fba2 tempest-TestMinimumBasicScenario-2093795776 tempest-TestMinimumBasicScenario-2093795776-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:12:45.144585 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-e280e581-9b6a-4f12-b374-f8a9e8e4fba2 tempest-TestMinimumBasicScenario-2093795776 tempest-TestMinimumBasicScenario-2093795776-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:12:45.144948 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-e280e581-9b6a-4f12-b374-f8a9e8e4fba2 tempest-TestMinimumBasicScenario-2093795776 tempest-TestMinimumBasicScenario-2093795776-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:12:45.295411 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-e280e581-9b6a-4f12-b374-f8a9e8e4fba2 tempest-TestMinimumBasicScenario-2093795776 tempest-TestMinimumBasicScenario-2093795776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f67fe549bae6447f8b24219becb3bf97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85c73f9a74da4079a54a503e0b42ca2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:12:45.303803 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-e280e581-9b6a-4f12-b374-f8a9e8e4fba2 tempest-TestMinimumBasicScenario-2093795776 tempest-TestMinimumBasicScenario-2093795776-project] 10.222.0.50 "GET /compute/v2.1/servers/c8dc693a-12ca-40a8-8ce8-4f5cb342fb8f" status: 200 len: 1757 microversion: 2.1 time: 0.175549 Sep 24 05:12:45.304437 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 596/1216] 10.222.0.50 () {58 vars in 1236 bytes} [Sat Sep 24 05:12:45 2022] GET /compute/v2.1/servers/c8dc693a-12ca-40a8-8ce8-4f5cb342fb8f => generated 1757 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 24 05:12:46.327488 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-02097850-41bb-485a-9fdc-b757934cecf0 tempest-TestMinimumBasicScenario-2093795776 tempest-TestMinimumBasicScenario-2093795776-project] Calling method '>' {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:12:46.328105 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.compute.api [None req-02097850-41bb-485a-9fdc-b757934cecf0 tempest-TestMinimumBasicScenario-2093795776 tempest-TestMinimumBasicScenario-2093795776-project] [instance: c8dc693a-12ca-40a8-8ce8-4f5cb342fb8f] Fetching instance by UUID {{(pid=120594) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:12:46.330441 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG dbcounter [-] [120594] Writing DB stats nova_api:SELECT=31,nova_api:DELETE=1 {{(pid=120594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 05:12:46.335842 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-02097850-41bb-485a-9fdc-b757934cecf0 tempest-TestMinimumBasicScenario-2093795776 tempest-TestMinimumBasicScenario-2093795776-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:12:46.336163 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-02097850-41bb-485a-9fdc-b757934cecf0 tempest-TestMinimumBasicScenario-2093795776 tempest-TestMinimumBasicScenario-2093795776-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:12:46.336609 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-02097850-41bb-485a-9fdc-b757934cecf0 tempest-TestMinimumBasicScenario-2093795776 tempest-TestMinimumBasicScenario-2093795776-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:12:46.337397 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-02097850-41bb-485a-9fdc-b757934cecf0 tempest-TestMinimumBasicScenario-2093795776 tempest-TestMinimumBasicScenario-2093795776-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:12:46.337855 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-02097850-41bb-485a-9fdc-b757934cecf0 tempest-TestMinimumBasicScenario-2093795776 tempest-TestMinimumBasicScenario-2093795776-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:12:46.338326 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-02097850-41bb-485a-9fdc-b757934cecf0 tempest-TestMinimumBasicScenario-2093795776 tempest-TestMinimumBasicScenario-2093795776-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:12:46.481074 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.policy [None req-02097850-41bb-485a-9fdc-b757934cecf0 tempest-TestMinimumBasicScenario-2093795776 tempest-TestMinimumBasicScenario-2093795776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f67fe549bae6447f8b24219becb3bf97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85c73f9a74da4079a54a503e0b42ca2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:12:46.489505 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [None req-02097850-41bb-485a-9fdc-b757934cecf0 tempest-TestMinimumBasicScenario-2093795776 tempest-TestMinimumBasicScenario-2093795776-project] 10.222.0.50 "GET /compute/v2.1/servers/c8dc693a-12ca-40a8-8ce8-4f5cb342fb8f" status: 200 len: 1757 microversion: 2.1 time: 0.165944 Sep 24 05:12:46.490105 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 621/1217] 10.222.0.50 () {58 vars in 1236 bytes} [Sat Sep 24 05:12:46 2022] GET /compute/v2.1/servers/c8dc693a-12ca-40a8-8ce8-4f5cb342fb8f => generated 1757 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 05:12:47.512792 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-26add014-29d6-400d-be89-b4ce03b45651 tempest-TestMinimumBasicScenario-2093795776 tempest-TestMinimumBasicScenario-2093795776-project] Calling method '>' {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:12:47.513537 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.compute.api [None req-26add014-29d6-400d-be89-b4ce03b45651 tempest-TestMinimumBasicScenario-2093795776 tempest-TestMinimumBasicScenario-2093795776-project] [instance: c8dc693a-12ca-40a8-8ce8-4f5cb342fb8f] Fetching instance by UUID {{(pid=120593) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:12:47.520354 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-26add014-29d6-400d-be89-b4ce03b45651 tempest-TestMinimumBasicScenario-2093795776 tempest-TestMinimumBasicScenario-2093795776-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:12:47.520830 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-26add014-29d6-400d-be89-b4ce03b45651 tempest-TestMinimumBasicScenario-2093795776 tempest-TestMinimumBasicScenario-2093795776-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:12:47.521265 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-26add014-29d6-400d-be89-b4ce03b45651 tempest-TestMinimumBasicScenario-2093795776 tempest-TestMinimumBasicScenario-2093795776-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:12:47.521947 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-26add014-29d6-400d-be89-b4ce03b45651 tempest-TestMinimumBasicScenario-2093795776 tempest-TestMinimumBasicScenario-2093795776-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:12:47.522423 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-26add014-29d6-400d-be89-b4ce03b45651 tempest-TestMinimumBasicScenario-2093795776 tempest-TestMinimumBasicScenario-2093795776-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:12:47.522842 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-26add014-29d6-400d-be89-b4ce03b45651 tempest-TestMinimumBasicScenario-2093795776 tempest-TestMinimumBasicScenario-2093795776-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:12:47.670795 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-26add014-29d6-400d-be89-b4ce03b45651 tempest-TestMinimumBasicScenario-2093795776 tempest-TestMinimumBasicScenario-2093795776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f67fe549bae6447f8b24219becb3bf97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85c73f9a74da4079a54a503e0b42ca2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:12:47.679292 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-26add014-29d6-400d-be89-b4ce03b45651 tempest-TestMinimumBasicScenario-2093795776 tempest-TestMinimumBasicScenario-2093795776-project] 10.222.0.50 "GET /compute/v2.1/servers/c8dc693a-12ca-40a8-8ce8-4f5cb342fb8f" status: 200 len: 1757 microversion: 2.1 time: 0.170321 Sep 24 05:12:47.679916 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 597/1218] 10.222.0.50 () {58 vars in 1236 bytes} [Sat Sep 24 05:12:47 2022] GET /compute/v2.1/servers/c8dc693a-12ca-40a8-8ce8-4f5cb342fb8f => generated 1757 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 05:12:48.702362 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-001532eb-38e7-471f-b917-4f0db90edd5a tempest-TestMinimumBasicScenario-2093795776 tempest-TestMinimumBasicScenario-2093795776-project] Calling method '>' {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:12:48.702969 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.compute.api [None req-001532eb-38e7-471f-b917-4f0db90edd5a tempest-TestMinimumBasicScenario-2093795776 tempest-TestMinimumBasicScenario-2093795776-project] [instance: c8dc693a-12ca-40a8-8ce8-4f5cb342fb8f] Fetching instance by UUID {{(pid=120594) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:12:48.709580 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-001532eb-38e7-471f-b917-4f0db90edd5a tempest-TestMinimumBasicScenario-2093795776 tempest-TestMinimumBasicScenario-2093795776-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:12:48.710090 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-001532eb-38e7-471f-b917-4f0db90edd5a tempest-TestMinimumBasicScenario-2093795776 tempest-TestMinimumBasicScenario-2093795776-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:12:48.710525 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-001532eb-38e7-471f-b917-4f0db90edd5a tempest-TestMinimumBasicScenario-2093795776 tempest-TestMinimumBasicScenario-2093795776-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:12:48.711205 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-001532eb-38e7-471f-b917-4f0db90edd5a tempest-TestMinimumBasicScenario-2093795776 tempest-TestMinimumBasicScenario-2093795776-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:12:48.711654 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-001532eb-38e7-471f-b917-4f0db90edd5a tempest-TestMinimumBasicScenario-2093795776 tempest-TestMinimumBasicScenario-2093795776-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:12:48.712069 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-001532eb-38e7-471f-b917-4f0db90edd5a tempest-TestMinimumBasicScenario-2093795776 tempest-TestMinimumBasicScenario-2093795776-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:12:48.850363 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.policy [None req-001532eb-38e7-471f-b917-4f0db90edd5a tempest-TestMinimumBasicScenario-2093795776 tempest-TestMinimumBasicScenario-2093795776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f67fe549bae6447f8b24219becb3bf97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85c73f9a74da4079a54a503e0b42ca2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:12:48.858969 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [None req-001532eb-38e7-471f-b917-4f0db90edd5a tempest-TestMinimumBasicScenario-2093795776 tempest-TestMinimumBasicScenario-2093795776-project] 10.222.0.50 "GET /compute/v2.1/servers/c8dc693a-12ca-40a8-8ce8-4f5cb342fb8f" status: 200 len: 1757 microversion: 2.1 time: 0.160415 Sep 24 05:12:48.859535 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 622/1219] 10.222.0.50 () {58 vars in 1236 bytes} [Sat Sep 24 05:12:48 2022] GET /compute/v2.1/servers/c8dc693a-12ca-40a8-8ce8-4f5cb342fb8f => generated 1757 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 05:12:49.882689 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-8d62ef4d-454e-4a9a-ab23-0823d2ef969b tempest-TestMinimumBasicScenario-2093795776 tempest-TestMinimumBasicScenario-2093795776-project] Calling method '>' {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:12:49.884306 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.compute.api [None req-8d62ef4d-454e-4a9a-ab23-0823d2ef969b tempest-TestMinimumBasicScenario-2093795776 tempest-TestMinimumBasicScenario-2093795776-project] [instance: c8dc693a-12ca-40a8-8ce8-4f5cb342fb8f] Fetching instance by UUID {{(pid=120593) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:12:49.890484 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-8d62ef4d-454e-4a9a-ab23-0823d2ef969b tempest-TestMinimumBasicScenario-2093795776 tempest-TestMinimumBasicScenario-2093795776-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:12:49.890967 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-8d62ef4d-454e-4a9a-ab23-0823d2ef969b tempest-TestMinimumBasicScenario-2093795776 tempest-TestMinimumBasicScenario-2093795776-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:12:49.891414 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-8d62ef4d-454e-4a9a-ab23-0823d2ef969b tempest-TestMinimumBasicScenario-2093795776 tempest-TestMinimumBasicScenario-2093795776-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:12:49.892082 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-8d62ef4d-454e-4a9a-ab23-0823d2ef969b tempest-TestMinimumBasicScenario-2093795776 tempest-TestMinimumBasicScenario-2093795776-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:12:49.892532 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-8d62ef4d-454e-4a9a-ab23-0823d2ef969b tempest-TestMinimumBasicScenario-2093795776 tempest-TestMinimumBasicScenario-2093795776-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:12:49.892958 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-8d62ef4d-454e-4a9a-ab23-0823d2ef969b tempest-TestMinimumBasicScenario-2093795776 tempest-TestMinimumBasicScenario-2093795776-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:12:50.044782 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-8d62ef4d-454e-4a9a-ab23-0823d2ef969b tempest-TestMinimumBasicScenario-2093795776 tempest-TestMinimumBasicScenario-2093795776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f67fe549bae6447f8b24219becb3bf97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85c73f9a74da4079a54a503e0b42ca2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:12:50.053351 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-8d62ef4d-454e-4a9a-ab23-0823d2ef969b tempest-TestMinimumBasicScenario-2093795776 tempest-TestMinimumBasicScenario-2093795776-project] 10.222.0.50 "GET /compute/v2.1/servers/c8dc693a-12ca-40a8-8ce8-4f5cb342fb8f" status: 200 len: 1757 microversion: 2.1 time: 0.174790 Sep 24 05:12:50.054053 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 598/1220] 10.222.0.50 () {58 vars in 1236 bytes} [Sat Sep 24 05:12:49 2022] GET /compute/v2.1/servers/c8dc693a-12ca-40a8-8ce8-4f5cb342fb8f => generated 1757 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 05:12:51.077501 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-9fdf39f4-272c-4546-b681-05cfb3eafcb1 tempest-TestMinimumBasicScenario-2093795776 tempest-TestMinimumBasicScenario-2093795776-project] Calling method '>' {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:12:51.078142 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.compute.api [None req-9fdf39f4-272c-4546-b681-05cfb3eafcb1 tempest-TestMinimumBasicScenario-2093795776 tempest-TestMinimumBasicScenario-2093795776-project] [instance: c8dc693a-12ca-40a8-8ce8-4f5cb342fb8f] Fetching instance by UUID {{(pid=120594) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:12:51.084350 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-9fdf39f4-272c-4546-b681-05cfb3eafcb1 tempest-TestMinimumBasicScenario-2093795776 tempest-TestMinimumBasicScenario-2093795776-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:12:51.084821 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-9fdf39f4-272c-4546-b681-05cfb3eafcb1 tempest-TestMinimumBasicScenario-2093795776 tempest-TestMinimumBasicScenario-2093795776-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:12:51.085252 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-9fdf39f4-272c-4546-b681-05cfb3eafcb1 tempest-TestMinimumBasicScenario-2093795776 tempest-TestMinimumBasicScenario-2093795776-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:12:51.085936 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-9fdf39f4-272c-4546-b681-05cfb3eafcb1 tempest-TestMinimumBasicScenario-2093795776 tempest-TestMinimumBasicScenario-2093795776-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:12:51.086410 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-9fdf39f4-272c-4546-b681-05cfb3eafcb1 tempest-TestMinimumBasicScenario-2093795776 tempest-TestMinimumBasicScenario-2093795776-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:12:51.087387 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-9fdf39f4-272c-4546-b681-05cfb3eafcb1 tempest-TestMinimumBasicScenario-2093795776 tempest-TestMinimumBasicScenario-2093795776-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:12:51.242739 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.policy [None req-9fdf39f4-272c-4546-b681-05cfb3eafcb1 tempest-TestMinimumBasicScenario-2093795776 tempest-TestMinimumBasicScenario-2093795776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f67fe549bae6447f8b24219becb3bf97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85c73f9a74da4079a54a503e0b42ca2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:12:51.251237 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [None req-9fdf39f4-272c-4546-b681-05cfb3eafcb1 tempest-TestMinimumBasicScenario-2093795776 tempest-TestMinimumBasicScenario-2093795776-project] 10.222.0.50 "GET /compute/v2.1/servers/c8dc693a-12ca-40a8-8ce8-4f5cb342fb8f" status: 200 len: 1757 microversion: 2.1 time: 0.177498 Sep 24 05:12:51.251775 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 623/1221] 10.222.0.50 () {58 vars in 1236 bytes} [Sat Sep 24 05:12:51 2022] GET /compute/v2.1/servers/c8dc693a-12ca-40a8-8ce8-4f5cb342fb8f => generated 1757 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 05:12:52.274291 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-f9df5a96-8ef5-42a2-9bd4-f52ab71dfe80 tempest-TestMinimumBasicScenario-2093795776 tempest-TestMinimumBasicScenario-2093795776-project] Calling method '>' {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:12:52.274908 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.compute.api [None req-f9df5a96-8ef5-42a2-9bd4-f52ab71dfe80 tempest-TestMinimumBasicScenario-2093795776 tempest-TestMinimumBasicScenario-2093795776-project] [instance: c8dc693a-12ca-40a8-8ce8-4f5cb342fb8f] Fetching instance by UUID {{(pid=120593) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:12:52.281360 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-f9df5a96-8ef5-42a2-9bd4-f52ab71dfe80 tempest-TestMinimumBasicScenario-2093795776 tempest-TestMinimumBasicScenario-2093795776-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:12:52.281842 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-f9df5a96-8ef5-42a2-9bd4-f52ab71dfe80 tempest-TestMinimumBasicScenario-2093795776 tempest-TestMinimumBasicScenario-2093795776-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:12:52.282568 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-f9df5a96-8ef5-42a2-9bd4-f52ab71dfe80 tempest-TestMinimumBasicScenario-2093795776 tempest-TestMinimumBasicScenario-2093795776-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:12:52.283269 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-f9df5a96-8ef5-42a2-9bd4-f52ab71dfe80 tempest-TestMinimumBasicScenario-2093795776 tempest-TestMinimumBasicScenario-2093795776-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:12:52.283725 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-f9df5a96-8ef5-42a2-9bd4-f52ab71dfe80 tempest-TestMinimumBasicScenario-2093795776 tempest-TestMinimumBasicScenario-2093795776-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:12:52.284150 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-f9df5a96-8ef5-42a2-9bd4-f52ab71dfe80 tempest-TestMinimumBasicScenario-2093795776 tempest-TestMinimumBasicScenario-2093795776-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:12:52.436231 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-f9df5a96-8ef5-42a2-9bd4-f52ab71dfe80 tempest-TestMinimumBasicScenario-2093795776 tempest-TestMinimumBasicScenario-2093795776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f67fe549bae6447f8b24219becb3bf97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85c73f9a74da4079a54a503e0b42ca2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:12:52.444690 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-f9df5a96-8ef5-42a2-9bd4-f52ab71dfe80 tempest-TestMinimumBasicScenario-2093795776 tempest-TestMinimumBasicScenario-2093795776-project] 10.222.0.50 "GET /compute/v2.1/servers/c8dc693a-12ca-40a8-8ce8-4f5cb342fb8f" status: 200 len: 1757 microversion: 2.1 time: 0.174582 Sep 24 05:12:52.445241 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 599/1222] 10.222.0.50 () {58 vars in 1236 bytes} [Sat Sep 24 05:12:52 2022] GET /compute/v2.1/servers/c8dc693a-12ca-40a8-8ce8-4f5cb342fb8f => generated 1757 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 05:12:53.468530 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-410469ee-0828-43a8-b15b-ff8597700c2c tempest-TestMinimumBasicScenario-2093795776 tempest-TestMinimumBasicScenario-2093795776-project] Calling method '>' {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:12:53.469140 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.compute.api [None req-410469ee-0828-43a8-b15b-ff8597700c2c tempest-TestMinimumBasicScenario-2093795776 tempest-TestMinimumBasicScenario-2093795776-project] [instance: c8dc693a-12ca-40a8-8ce8-4f5cb342fb8f] Fetching instance by UUID {{(pid=120594) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:12:53.475584 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-410469ee-0828-43a8-b15b-ff8597700c2c tempest-TestMinimumBasicScenario-2093795776 tempest-TestMinimumBasicScenario-2093795776-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:12:53.476071 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-410469ee-0828-43a8-b15b-ff8597700c2c tempest-TestMinimumBasicScenario-2093795776 tempest-TestMinimumBasicScenario-2093795776-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:12:53.476509 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-410469ee-0828-43a8-b15b-ff8597700c2c tempest-TestMinimumBasicScenario-2093795776 tempest-TestMinimumBasicScenario-2093795776-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:12:53.477716 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-410469ee-0828-43a8-b15b-ff8597700c2c tempest-TestMinimumBasicScenario-2093795776 tempest-TestMinimumBasicScenario-2093795776-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:12:53.478192 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-410469ee-0828-43a8-b15b-ff8597700c2c tempest-TestMinimumBasicScenario-2093795776 tempest-TestMinimumBasicScenario-2093795776-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:12:53.478619 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-410469ee-0828-43a8-b15b-ff8597700c2c tempest-TestMinimumBasicScenario-2093795776 tempest-TestMinimumBasicScenario-2093795776-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:12:53.689088 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.policy [None req-410469ee-0828-43a8-b15b-ff8597700c2c tempest-TestMinimumBasicScenario-2093795776 tempest-TestMinimumBasicScenario-2093795776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f67fe549bae6447f8b24219becb3bf97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85c73f9a74da4079a54a503e0b42ca2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:12:53.697730 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [None req-410469ee-0828-43a8-b15b-ff8597700c2c tempest-TestMinimumBasicScenario-2093795776 tempest-TestMinimumBasicScenario-2093795776-project] 10.222.0.50 "GET /compute/v2.1/servers/c8dc693a-12ca-40a8-8ce8-4f5cb342fb8f" status: 200 len: 1760 microversion: 2.1 time: 0.234085 Sep 24 05:12:53.698294 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 624/1223] 10.222.0.50 () {58 vars in 1236 bytes} [Sat Sep 24 05:12:53 2022] GET /compute/v2.1/servers/c8dc693a-12ca-40a8-8ce8-4f5cb342fb8f => generated 1760 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 05:13:41.443773 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-873a826b-4c4d-4bb4-8914-c07b0358fd9e tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Calling method '>' {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:13:41.446420 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.compute.api [None req-873a826b-4c4d-4bb4-8914-c07b0358fd9e tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] [instance: 36f8e098-a4b5-40a4-8f49-f341c5ad940c] Fetching instance by UUID {{(pid=120593) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:13:41.448393 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG dbcounter [-] [120593] Writing DB stats nova_api:SELECT=7 {{(pid=120593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 05:13:41.449038 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG dbcounter [-] [120593] Writing DB stats nova_cell1:SELECT=85,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 05:13:41.454922 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-873a826b-4c4d-4bb4-8914-c07b0358fd9e tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:13:41.455397 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-873a826b-4c4d-4bb4-8914-c07b0358fd9e tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:13:41.455824 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-873a826b-4c4d-4bb4-8914-c07b0358fd9e tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:13:41.456502 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-873a826b-4c4d-4bb4-8914-c07b0358fd9e tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:13:41.456947 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-873a826b-4c4d-4bb4-8914-c07b0358fd9e tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:13:41.457364 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-873a826b-4c4d-4bb4-8914-c07b0358fd9e tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:13:41.486900 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-873a826b-4c4d-4bb4-8914-c07b0358fd9e tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] 10.222.0.50 "GET /compute/v2.1/servers/36f8e098-a4b5-40a4-8f49-f341c5ad940c/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.047171 Sep 24 05:13:41.487437 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 600/1224] 10.222.0.50 () {60 vars in 1343 bytes} [Sat Sep 24 05:13:41 2022] GET /compute/v2.1/servers/36f8e098-a4b5-40a4-8f49-f341c5ad940c/os-volume_attachments => generated 25 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 05:13:41.550931 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-8b30c51a-a3ae-4fa5-bc9b-bcb62414968e tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Calling method '>' {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:13:41.551425 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.compute.api [None req-8b30c51a-a3ae-4fa5-bc9b-bcb62414968e tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] [instance: 36f8e098-a4b5-40a4-8f49-f341c5ad940c] Fetching instance by UUID {{(pid=120594) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:13:41.553873 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG dbcounter [-] [120594] Writing DB stats nova_api:SELECT=7 {{(pid=120594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 05:13:41.555053 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG dbcounter [-] [120594] Writing DB stats nova_cell1:SELECT=54 {{(pid=120594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 05:13:41.560858 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-8b30c51a-a3ae-4fa5-bc9b-bcb62414968e tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:13:41.561334 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-8b30c51a-a3ae-4fa5-bc9b-bcb62414968e tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:13:41.561772 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-8b30c51a-a3ae-4fa5-bc9b-bcb62414968e tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:13:41.562489 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-8b30c51a-a3ae-4fa5-bc9b-bcb62414968e tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:13:41.562941 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-8b30c51a-a3ae-4fa5-bc9b-bcb62414968e tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:13:41.563367 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-8b30c51a-a3ae-4fa5-bc9b-bcb62414968e tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:13:41.594261 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.compute.api [None req-8b30c51a-a3ae-4fa5-bc9b-bcb62414968e tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] [instance: 36f8e098-a4b5-40a4-8f49-f341c5ad940c] Going to try to terminate instance {{(pid=120594) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 24 05:13:41.668273 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [None req-8b30c51a-a3ae-4fa5-bc9b-bcb62414968e tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] 10.222.0.50 "DELETE /compute/v2.1/servers/36f8e098-a4b5-40a4-8f49-f341c5ad940c" status: 204 len: 0 microversion: 2.20 time: 0.120828 Sep 24 05:13:41.668917 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 625/1225] 10.222.0.50 () {60 vars in 1280 bytes} [Sat Sep 24 05:13:41 2022] DELETE /compute/v2.1/servers/36f8e098-a4b5-40a4-8f49-f341c5ad940c => generated 0 bytes in 122 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Sep 24 05:13:41.677565 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-521f6f36-47c6-4838-91fc-47de1e1d1b90 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Calling method '>' {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:13:41.678204 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.compute.api [None req-521f6f36-47c6-4838-91fc-47de1e1d1b90 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] [instance: 36f8e098-a4b5-40a4-8f49-f341c5ad940c] Fetching instance by UUID {{(pid=120593) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:13:41.684538 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-521f6f36-47c6-4838-91fc-47de1e1d1b90 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:13:41.685021 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-521f6f36-47c6-4838-91fc-47de1e1d1b90 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:13:41.685453 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-521f6f36-47c6-4838-91fc-47de1e1d1b90 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:13:41.686238 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-521f6f36-47c6-4838-91fc-47de1e1d1b90 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:13:41.686700 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-521f6f36-47c6-4838-91fc-47de1e1d1b90 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:13:41.687122 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-521f6f36-47c6-4838-91fc-47de1e1d1b90 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:13:41.811890 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-521f6f36-47c6-4838-91fc-47de1e1d1b90 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0948754217fc4ff2ba0241fa35feaf90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1aaf20f480a423ea5feca81585aeeed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:13:41.820641 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-521f6f36-47c6-4838-91fc-47de1e1d1b90 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0948754217fc4ff2ba0241fa35feaf90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1aaf20f480a423ea5feca81585aeeed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:13:41.822113 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-521f6f36-47c6-4838-91fc-47de1e1d1b90 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0948754217fc4ff2ba0241fa35feaf90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1aaf20f480a423ea5feca81585aeeed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:13:41.823270 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-521f6f36-47c6-4838-91fc-47de1e1d1b90 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] 10.222.0.50 "GET /compute/v2.1/servers/36f8e098-a4b5-40a4-8f49-f341c5ad940c" status: 200 len: 1724 microversion: 2.20 time: 0.149573 Sep 24 05:13:41.823822 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 601/1226] 10.222.0.50 () {60 vars in 1277 bytes} [Sat Sep 24 05:13:41 2022] GET /compute/v2.1/servers/36f8e098-a4b5-40a4-8f49-f341c5ad940c => generated 1724 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 05:13:42.849183 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-2af6476c-783c-42f3-8564-f81a93ed7bc0 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Calling method '>' {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:13:42.849931 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.compute.api [None req-2af6476c-783c-42f3-8564-f81a93ed7bc0 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] [instance: 36f8e098-a4b5-40a4-8f49-f341c5ad940c] Fetching instance by UUID {{(pid=120594) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:13:42.856571 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-2af6476c-783c-42f3-8564-f81a93ed7bc0 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:13:42.857049 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-2af6476c-783c-42f3-8564-f81a93ed7bc0 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:13:42.857484 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-2af6476c-783c-42f3-8564-f81a93ed7bc0 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:13:42.858199 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-2af6476c-783c-42f3-8564-f81a93ed7bc0 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:13:42.858650 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-2af6476c-783c-42f3-8564-f81a93ed7bc0 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:13:42.859074 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-2af6476c-783c-42f3-8564-f81a93ed7bc0 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:13:42.988117 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.policy [None req-2af6476c-783c-42f3-8564-f81a93ed7bc0 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0948754217fc4ff2ba0241fa35feaf90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1aaf20f480a423ea5feca81585aeeed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:13:42.997057 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.policy [None req-2af6476c-783c-42f3-8564-f81a93ed7bc0 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0948754217fc4ff2ba0241fa35feaf90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1aaf20f480a423ea5feca81585aeeed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:13:42.998575 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.policy [None req-2af6476c-783c-42f3-8564-f81a93ed7bc0 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0948754217fc4ff2ba0241fa35feaf90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1aaf20f480a423ea5feca81585aeeed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:13:43.000039 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [None req-2af6476c-783c-42f3-8564-f81a93ed7bc0 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] 10.222.0.50 "GET /compute/v2.1/servers/36f8e098-a4b5-40a4-8f49-f341c5ad940c" status: 200 len: 1724 microversion: 2.20 time: 0.155407 Sep 24 05:13:43.001007 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 626/1227] 10.222.0.50 () {60 vars in 1277 bytes} [Sat Sep 24 05:13:42 2022] GET /compute/v2.1/servers/36f8e098-a4b5-40a4-8f49-f341c5ad940c => generated 1724 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 05:13:44.026545 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-8014c703-6ecb-4220-bdf1-88803a21597f tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Calling method '>' {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:13:44.027262 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.compute.api [None req-8014c703-6ecb-4220-bdf1-88803a21597f tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] [instance: 36f8e098-a4b5-40a4-8f49-f341c5ad940c] Fetching instance by UUID {{(pid=120593) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:13:44.034141 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-8014c703-6ecb-4220-bdf1-88803a21597f tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:13:44.034642 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-8014c703-6ecb-4220-bdf1-88803a21597f tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:13:44.035142 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-8014c703-6ecb-4220-bdf1-88803a21597f tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:13:44.035899 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-8014c703-6ecb-4220-bdf1-88803a21597f tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:13:44.036422 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-8014c703-6ecb-4220-bdf1-88803a21597f tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:13:44.036922 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-8014c703-6ecb-4220-bdf1-88803a21597f tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:13:44.101681 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-8014c703-6ecb-4220-bdf1-88803a21597f tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0948754217fc4ff2ba0241fa35feaf90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1aaf20f480a423ea5feca81585aeeed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:13:44.110186 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-8014c703-6ecb-4220-bdf1-88803a21597f tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0948754217fc4ff2ba0241fa35feaf90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1aaf20f480a423ea5feca81585aeeed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:13:44.111623 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-8014c703-6ecb-4220-bdf1-88803a21597f tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0948754217fc4ff2ba0241fa35feaf90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1aaf20f480a423ea5feca81585aeeed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:13:44.112774 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-8014c703-6ecb-4220-bdf1-88803a21597f tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] 10.222.0.50 "GET /compute/v2.1/servers/36f8e098-a4b5-40a4-8f49-f341c5ad940c" status: 200 len: 1656 microversion: 2.20 time: 0.090242 Sep 24 05:13:44.113375 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 602/1228] 10.222.0.50 () {60 vars in 1277 bytes} [Sat Sep 24 05:13:44 2022] GET /compute/v2.1/servers/36f8e098-a4b5-40a4-8f49-f341c5ad940c => generated 1656 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 24 05:13:44.270732 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [req-eb0cd2df-58bf-47b2-ac2d-ee2adebfa7fa req-f9ea1d69-0d7c-4f56-8cd2-46b15ec91ac9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "36f8e098-a4b5-40a4-8f49-f341c5ad940c", "name": "network-vif-deleted", "tag": "e1514bf0-06bf-454f-bb1a-b1c69713927f"}]} {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 05:13:44.283777 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [req-eb0cd2df-58bf-47b2-ac2d-ee2adebfa7fa req-f9ea1d69-0d7c-4f56-8cd2-46b15ec91ac9 service nova] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:13:44.284314 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [req-eb0cd2df-58bf-47b2-ac2d-ee2adebfa7fa req-f9ea1d69-0d7c-4f56-8cd2-46b15ec91ac9 service nova] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:13:44.287672 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [req-eb0cd2df-58bf-47b2-ac2d-ee2adebfa7fa req-f9ea1d69-0d7c-4f56-8cd2-46b15ec91ac9 service nova] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:13:44.311092 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: INFO nova.api.openstack.compute.server_external_events [req-eb0cd2df-58bf-47b2-ac2d-ee2adebfa7fa req-f9ea1d69-0d7c-4f56-8cd2-46b15ec91ac9 service nova] Creating event network-vif-deleted:e1514bf0-06bf-454f-bb1a-b1c69713927f for instance 36f8e098-a4b5-40a4-8f49-f341c5ad940c on hv-cinder-85918 Sep 24 05:13:44.316841 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [req-eb0cd2df-58bf-47b2-ac2d-ee2adebfa7fa req-f9ea1d69-0d7c-4f56-8cd2-46b15ec91ac9 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050272 Sep 24 05:13:44.317470 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 627/1229] 10.222.0.50 () {64 vars in 1317 bytes} [Sat Sep 24 05:13:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 05:13:45.138988 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-2c87fbde-583a-46e0-8ab6-52121cbbcda2 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Calling method '>' {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:13:45.139708 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.compute.api [None req-2c87fbde-583a-46e0-8ab6-52121cbbcda2 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] [instance: 36f8e098-a4b5-40a4-8f49-f341c5ad940c] Fetching instance by UUID {{(pid=120593) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:13:45.146306 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-2c87fbde-583a-46e0-8ab6-52121cbbcda2 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:13:45.146862 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-2c87fbde-583a-46e0-8ab6-52121cbbcda2 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:13:45.147362 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-2c87fbde-583a-46e0-8ab6-52121cbbcda2 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:13:45.148153 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-2c87fbde-583a-46e0-8ab6-52121cbbcda2 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:13:45.148675 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-2c87fbde-583a-46e0-8ab6-52121cbbcda2 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:13:45.149104 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-2c87fbde-583a-46e0-8ab6-52121cbbcda2 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:13:45.162986 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.wsgi [None req-2c87fbde-583a-46e0-8ab6-52121cbbcda2 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] HTTP exception thrown: Instance 36f8e098-a4b5-40a4-8f49-f341c5ad940c could not be found. Sep 24 05:13:45.165208 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-2c87fbde-583a-46e0-8ab6-52121cbbcda2 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Request method failure captured: Sep 24 05:13:45.165208 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: request: GET /compute/v2.1/servers/36f8e098-a4b5-40a4-8f49-f341c5ad940c HTTP/1.1 Sep 24 05:13:45.165208 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: Accept: application/json Sep 24 05:13:45.165208 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: Accept-Encoding: identity Sep 24 05:13:45.165208 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: Connection: close Sep 24 05:13:45.165208 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: Content-Length: 0 Sep 24 05:13:45.165208 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: Content-Type: application/json Sep 24 05:13:45.165208 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: Host: 10.222.0.50 Sep 24 05:13:45.165208 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: Openstack-System-Scope: None Sep 24 05:13:45.165208 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: User-Agent: python-urllib3/1.26.12 Sep 24 05:13:45.165208 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: X-Auth-Token: gAAAAABjLo8CSqMBxyhNVmFfsk1NTNzkp3_H84-yvN05Ky7OFnK0t-nxnJBueA__huZ344wnh8Vgbhzz-9W-5uWxnI6OuOG1n5FI0v0-wZbKR5_XkTPKM_bg5qB-KOvDkCr7huR5h5agVEcNYY1eBri4A8emzuD-hDI9bCM3DOTdHzYEghA5EZ8 Sep 24 05:13:45.165208 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: X-Domain-Id: None Sep 24 05:13:45.165208 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: X-Domain-Name: None Sep 24 05:13:45.165208 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: X-Identity-Status: Confirmed Sep 24 05:13:45.165208 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: X-Is-Admin-Project: True Sep 24 05:13:45.165208 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: X-Openstack-Nova-Api-Version: 2.20 Sep 24 05:13:45.165208 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: X-Project-Domain-Id: default Sep 24 05:13:45.165208 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: X-Project-Domain-Name: Default Sep 24 05:13:45.165208 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: X-Project-Id: c1aaf20f480a423ea5feca81585aeeed Sep 24 05:13:45.165208 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1434580538 Sep 24 05:13:45.165208 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: X-Role: member,reader Sep 24 05:13:45.165208 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: X-Roles: member,reader Sep 24 05:13:45.167105 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/c1aaf20f480a423ea5feca81585aeeed"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/c1aaf20f480a423ea5feca81585aeeed"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/c1aaf20f480a423ea5feca81585aeeed"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.50:8080", "publicURL": "http://10.222.0.50:8080/v1/AUTH_c1aaf20f480a423ea5feca81585aeeed"}]}] Sep 24 05:13:45.167105 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1434580538 Sep 24 05:13:45.167105 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: X-Tenant-Id: c1aaf20f480a423ea5feca81585aeeed Sep 24 05:13:45.167105 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1434580538 Sep 24 05:13:45.167105 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: X-User: tempest-AttachVolumeShelveTestJSON-1434580538-project Sep 24 05:13:45.167105 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: X-User-Domain-Id: default Sep 24 05:13:45.167105 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: X-User-Domain-Name: Default Sep 24 05:13:45.167105 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: X-User-Id: 0948754217fc4ff2ba0241fa35feaf90 Sep 24 05:13:45.167105 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1434580538-project Sep 24 05:13:45.167105 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: method: > Sep 24 05:13:45.167105 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: exception: Instance 36f8e098-a4b5-40a4-8f49-f341c5ad940c could not be found. Sep 24 05:13:45.167105 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: action_args: {'id': '36f8e098-a4b5-40a4-8f49-f341c5ad940c'} Sep 24 05:13:45.168019 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 24 05:13:45.168019 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 05:13:45.168019 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 24 05:13:45.168019 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 24 05:13:45.168019 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 24 05:13:45.168019 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 24 05:13:45.168019 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 24 05:13:45.168019 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 24 05:13:45.168019 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 24 05:13:45.168019 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 24 05:13:45.168019 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 36f8e098-a4b5-40a4-8f49-f341c5ad940c could not be found. Sep 24 05:13:45.168019 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi Sep 24 05:13:45.168019 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 05:13:45.168019 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi Sep 24 05:13:45.168019 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 05:13:45.168019 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 05:13:45.168019 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 05:13:45.168019 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 24 05:13:45.168019 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 24 05:13:45.168019 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 24 05:13:45.169648 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 24 05:13:45.169648 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 24 05:13:45.169648 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 24 05:13:45.169648 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 24 05:13:45.169648 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 24 05:13:45.169648 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 24 05:13:45.169648 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 24 05:13:45.169648 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 36f8e098-a4b5-40a4-8f49-f341c5ad940c could not be found. Sep 24 05:13:45.169648 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi Sep 24 05:13:45.169648 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 05:13:45.169648 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi Sep 24 05:13:45.169648 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 05:13:45.169648 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 05:13:45.169648 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 05:13:45.169648 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 24 05:13:45.169648 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 24 05:13:45.169648 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 36f8e098-a4b5-40a4-8f49-f341c5ad940c could not be found. Sep 24 05:13:45.169648 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi Sep 24 05:13:45.171161 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-2c87fbde-583a-46e0-8ab6-52121cbbcda2 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Returning 404 to user: Instance 36f8e098-a4b5-40a4-8f49-f341c5ad940c could not be found. {{(pid=120593) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 24 05:13:45.171161 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-2c87fbde-583a-46e0-8ab6-52121cbbcda2 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] 10.222.0.50 "GET /compute/v2.1/servers/36f8e098-a4b5-40a4-8f49-f341c5ad940c" status: 404 len: 111 microversion: 2.20 time: 0.031577 Sep 24 05:13:45.171161 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 603/1230] 10.222.0.50 () {60 vars in 1277 bytes} [Sat Sep 24 05:13:45 2022] GET /compute/v2.1/servers/36f8e098-a4b5-40a4-8f49-f341c5ad940c => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 24 05:13:45.176704 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-40aa93a3-c179-4b34-a0c5-66d4d1093b9f tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Calling method '.version_select at 0x7f7950754430>' {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:13:45.196268 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [None req-40aa93a3-c179-4b34-a0c5-66d4d1093b9f tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] 10.222.0.50 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-627260924" status: 204 len: 0 microversion: 2.20 time: 0.023796 Sep 24 05:13:45.196840 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 628/1231] 10.222.0.50 () {60 vars in 1259 bytes} [Sat Sep 24 05:13:45 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-627260924 => generated 0 bytes in 26 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 24 05:13:46.943525 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-bc9dd418-9c65-4aa3-aff9-a012a7247131 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Calling method '>' {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:13:46.944053 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.compute.api [None req-bc9dd418-9c65-4aa3-aff9-a012a7247131 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] [instance: 36f8e098-a4b5-40a4-8f49-f341c5ad940c] Fetching instance by UUID {{(pid=120593) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:13:46.950356 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-bc9dd418-9c65-4aa3-aff9-a012a7247131 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:13:46.950834 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-bc9dd418-9c65-4aa3-aff9-a012a7247131 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:13:46.951270 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-bc9dd418-9c65-4aa3-aff9-a012a7247131 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:13:46.951951 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-bc9dd418-9c65-4aa3-aff9-a012a7247131 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:13:46.952405 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-bc9dd418-9c65-4aa3-aff9-a012a7247131 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:13:46.952825 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-bc9dd418-9c65-4aa3-aff9-a012a7247131 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:13:46.966514 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.wsgi [None req-bc9dd418-9c65-4aa3-aff9-a012a7247131 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] HTTP exception thrown: Instance 36f8e098-a4b5-40a4-8f49-f341c5ad940c could not be found. Sep 24 05:13:46.968039 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-bc9dd418-9c65-4aa3-aff9-a012a7247131 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Request method failure captured: Sep 24 05:13:46.968039 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: request: DELETE /compute/v2.1/servers/36f8e098-a4b5-40a4-8f49-f341c5ad940c HTTP/1.1 Sep 24 05:13:46.968039 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: Accept: application/json Sep 24 05:13:46.968039 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: Accept-Encoding: identity Sep 24 05:13:46.968039 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: Connection: close Sep 24 05:13:46.968039 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: Content-Length: 0 Sep 24 05:13:46.968039 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: Content-Type: application/json Sep 24 05:13:46.968039 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: Host: 10.222.0.50 Sep 24 05:13:46.968039 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: Openstack-System-Scope: None Sep 24 05:13:46.968039 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: User-Agent: python-urllib3/1.26.12 Sep 24 05:13:46.968039 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: X-Auth-Token: gAAAAABjLo8CSqMBxyhNVmFfsk1NTNzkp3_H84-yvN05Ky7OFnK0t-nxnJBueA__huZ344wnh8Vgbhzz-9W-5uWxnI6OuOG1n5FI0v0-wZbKR5_XkTPKM_bg5qB-KOvDkCr7huR5h5agVEcNYY1eBri4A8emzuD-hDI9bCM3DOTdHzYEghA5EZ8 Sep 24 05:13:46.968039 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: X-Domain-Id: None Sep 24 05:13:46.968039 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: X-Domain-Name: None Sep 24 05:13:46.968039 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: X-Identity-Status: Confirmed Sep 24 05:13:46.968039 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: X-Is-Admin-Project: True Sep 24 05:13:46.968039 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: X-Openstack-Nova-Api-Version: 2.20 Sep 24 05:13:46.968039 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: X-Project-Domain-Id: default Sep 24 05:13:46.968039 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: X-Project-Domain-Name: Default Sep 24 05:13:46.968039 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: X-Project-Id: c1aaf20f480a423ea5feca81585aeeed Sep 24 05:13:46.968039 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1434580538 Sep 24 05:13:46.968039 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: X-Role: member,reader Sep 24 05:13:46.968039 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: X-Roles: member,reader Sep 24 05:13:46.969718 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/c1aaf20f480a423ea5feca81585aeeed"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/c1aaf20f480a423ea5feca81585aeeed"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/c1aaf20f480a423ea5feca81585aeeed"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.50:8080", "publicURL": "http://10.222.0.50:8080/v1/AUTH_c1aaf20f480a423ea5feca81585aeeed"}]}] Sep 24 05:13:46.969718 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1434580538 Sep 24 05:13:46.969718 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: X-Tenant-Id: c1aaf20f480a423ea5feca81585aeeed Sep 24 05:13:46.969718 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1434580538 Sep 24 05:13:46.969718 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: X-User: tempest-AttachVolumeShelveTestJSON-1434580538-project Sep 24 05:13:46.969718 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: X-User-Domain-Id: default Sep 24 05:13:46.969718 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: X-User-Domain-Name: Default Sep 24 05:13:46.969718 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: X-User-Id: 0948754217fc4ff2ba0241fa35feaf90 Sep 24 05:13:46.969718 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1434580538-project Sep 24 05:13:46.969718 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: method: > Sep 24 05:13:46.969718 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: exception: Instance 36f8e098-a4b5-40a4-8f49-f341c5ad940c could not be found. Sep 24 05:13:46.969718 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: action_args: {'id': '36f8e098-a4b5-40a4-8f49-f341c5ad940c'} Sep 24 05:13:46.970707 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 24 05:13:46.970707 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 05:13:46.970707 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 24 05:13:46.970707 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 24 05:13:46.970707 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 24 05:13:46.970707 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 24 05:13:46.970707 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 24 05:13:46.970707 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 24 05:13:46.970707 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 24 05:13:46.970707 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 24 05:13:46.970707 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 36f8e098-a4b5-40a4-8f49-f341c5ad940c could not be found. Sep 24 05:13:46.970707 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi Sep 24 05:13:46.970707 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 05:13:46.970707 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi Sep 24 05:13:46.970707 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 05:13:46.970707 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 05:13:46.970707 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 05:13:46.970707 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 24 05:13:46.970707 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 24 05:13:46.970707 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 24 05:13:46.972182 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 24 05:13:46.972182 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 24 05:13:46.972182 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 24 05:13:46.972182 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 24 05:13:46.972182 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 24 05:13:46.972182 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 24 05:13:46.972182 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 24 05:13:46.972182 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 24 05:13:46.972182 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 24 05:13:46.972182 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 36f8e098-a4b5-40a4-8f49-f341c5ad940c could not be found. Sep 24 05:13:46.972182 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi Sep 24 05:13:46.972182 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 05:13:46.972182 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi Sep 24 05:13:46.972182 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 05:13:46.972182 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 05:13:46.972182 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 05:13:46.972182 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 24 05:13:46.972182 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 24 05:13:46.972182 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 36f8e098-a4b5-40a4-8f49-f341c5ad940c could not be found. Sep 24 05:13:46.972182 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi Sep 24 05:13:46.973685 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-bc9dd418-9c65-4aa3-aff9-a012a7247131 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Returning 404 to user: Instance 36f8e098-a4b5-40a4-8f49-f341c5ad940c could not be found. {{(pid=120593) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 24 05:13:46.973685 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-bc9dd418-9c65-4aa3-aff9-a012a7247131 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] 10.222.0.50 "DELETE /compute/v2.1/servers/36f8e098-a4b5-40a4-8f49-f341c5ad940c" status: 404 len: 111 microversion: 2.20 time: 0.029771 Sep 24 05:13:46.973685 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 604/1232] 10.222.0.50 () {60 vars in 1280 bytes} [Sat Sep 24 05:13:46 2022] DELETE /compute/v2.1/servers/36f8e098-a4b5-40a4-8f49-f341c5ad940c => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 24 05:13:46.978744 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-0a9bb22e-39c9-4366-9815-4c62df2e98a6 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Calling method '>' {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:13:46.979465 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.compute.api [None req-0a9bb22e-39c9-4366-9815-4c62df2e98a6 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] [instance: 36f8e098-a4b5-40a4-8f49-f341c5ad940c] Fetching instance by UUID {{(pid=120594) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:13:46.985906 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-0a9bb22e-39c9-4366-9815-4c62df2e98a6 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:13:46.986420 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-0a9bb22e-39c9-4366-9815-4c62df2e98a6 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:13:46.986859 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-0a9bb22e-39c9-4366-9815-4c62df2e98a6 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:13:46.987541 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-0a9bb22e-39c9-4366-9815-4c62df2e98a6 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:13:46.987998 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-0a9bb22e-39c9-4366-9815-4c62df2e98a6 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:13:46.988421 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-0a9bb22e-39c9-4366-9815-4c62df2e98a6 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:13:47.003603 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: INFO nova.api.openstack.wsgi [None req-0a9bb22e-39c9-4366-9815-4c62df2e98a6 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] HTTP exception thrown: Instance 36f8e098-a4b5-40a4-8f49-f341c5ad940c could not be found. Sep 24 05:13:47.005260 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-0a9bb22e-39c9-4366-9815-4c62df2e98a6 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Request method failure captured: Sep 24 05:13:47.005260 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: request: GET /compute/v2.1/servers/36f8e098-a4b5-40a4-8f49-f341c5ad940c HTTP/1.1 Sep 24 05:13:47.005260 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: Accept: application/json Sep 24 05:13:47.005260 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: Accept-Encoding: identity Sep 24 05:13:47.005260 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: Connection: close Sep 24 05:13:47.005260 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: Content-Length: 0 Sep 24 05:13:47.005260 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: Content-Type: application/json Sep 24 05:13:47.005260 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: Host: 10.222.0.50 Sep 24 05:13:47.005260 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: Openstack-System-Scope: None Sep 24 05:13:47.005260 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: User-Agent: python-urllib3/1.26.12 Sep 24 05:13:47.005260 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: X-Auth-Token: gAAAAABjLo8CSqMBxyhNVmFfsk1NTNzkp3_H84-yvN05Ky7OFnK0t-nxnJBueA__huZ344wnh8Vgbhzz-9W-5uWxnI6OuOG1n5FI0v0-wZbKR5_XkTPKM_bg5qB-KOvDkCr7huR5h5agVEcNYY1eBri4A8emzuD-hDI9bCM3DOTdHzYEghA5EZ8 Sep 24 05:13:47.005260 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: X-Domain-Id: None Sep 24 05:13:47.005260 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: X-Domain-Name: None Sep 24 05:13:47.005260 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: X-Identity-Status: Confirmed Sep 24 05:13:47.005260 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: X-Is-Admin-Project: True Sep 24 05:13:47.005260 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: X-Openstack-Nova-Api-Version: 2.20 Sep 24 05:13:47.005260 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: X-Project-Domain-Id: default Sep 24 05:13:47.005260 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: X-Project-Domain-Name: Default Sep 24 05:13:47.005260 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: X-Project-Id: c1aaf20f480a423ea5feca81585aeeed Sep 24 05:13:47.005260 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1434580538 Sep 24 05:13:47.005260 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: X-Role: member,reader Sep 24 05:13:47.005260 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: X-Roles: member,reader Sep 24 05:13:47.007105 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/c1aaf20f480a423ea5feca81585aeeed"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/c1aaf20f480a423ea5feca81585aeeed"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/c1aaf20f480a423ea5feca81585aeeed"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.50:8080", "publicURL": "http://10.222.0.50:8080/v1/AUTH_c1aaf20f480a423ea5feca81585aeeed"}]}] Sep 24 05:13:47.007105 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1434580538 Sep 24 05:13:47.007105 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: X-Tenant-Id: c1aaf20f480a423ea5feca81585aeeed Sep 24 05:13:47.007105 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1434580538 Sep 24 05:13:47.007105 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: X-User: tempest-AttachVolumeShelveTestJSON-1434580538-project Sep 24 05:13:47.007105 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: X-User-Domain-Id: default Sep 24 05:13:47.007105 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: X-User-Domain-Name: Default Sep 24 05:13:47.007105 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: X-User-Id: 0948754217fc4ff2ba0241fa35feaf90 Sep 24 05:13:47.007105 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1434580538-project Sep 24 05:13:47.007105 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: method: > Sep 24 05:13:47.007105 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: exception: Instance 36f8e098-a4b5-40a4-8f49-f341c5ad940c could not be found. Sep 24 05:13:47.007105 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: action_args: {'id': '36f8e098-a4b5-40a4-8f49-f341c5ad940c'} Sep 24 05:13:47.008052 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 24 05:13:47.008052 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 05:13:47.008052 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 24 05:13:47.008052 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 24 05:13:47.008052 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 24 05:13:47.008052 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 24 05:13:47.008052 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 24 05:13:47.008052 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 24 05:13:47.008052 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 24 05:13:47.008052 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 24 05:13:47.008052 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 36f8e098-a4b5-40a4-8f49-f341c5ad940c could not be found. Sep 24 05:13:47.008052 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi Sep 24 05:13:47.008052 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 05:13:47.008052 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi Sep 24 05:13:47.008052 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 05:13:47.008052 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 05:13:47.008052 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 05:13:47.008052 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 24 05:13:47.008052 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 24 05:13:47.008052 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 24 05:13:47.009541 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 24 05:13:47.009541 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 24 05:13:47.009541 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 24 05:13:47.009541 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 24 05:13:47.009541 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 24 05:13:47.009541 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 24 05:13:47.009541 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 24 05:13:47.009541 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 36f8e098-a4b5-40a4-8f49-f341c5ad940c could not be found. Sep 24 05:13:47.009541 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi Sep 24 05:13:47.009541 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 05:13:47.009541 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi Sep 24 05:13:47.009541 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 05:13:47.009541 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 05:13:47.009541 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 05:13:47.009541 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 24 05:13:47.009541 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 24 05:13:47.009541 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 36f8e098-a4b5-40a4-8f49-f341c5ad940c could not be found. Sep 24 05:13:47.009541 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi Sep 24 05:13:47.010844 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-0a9bb22e-39c9-4366-9815-4c62df2e98a6 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Returning 404 to user: Instance 36f8e098-a4b5-40a4-8f49-f341c5ad940c could not be found. {{(pid=120594) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 24 05:13:47.010844 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [None req-0a9bb22e-39c9-4366-9815-4c62df2e98a6 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] 10.222.0.50 "GET /compute/v2.1/servers/36f8e098-a4b5-40a4-8f49-f341c5ad940c" status: 404 len: 111 microversion: 2.20 time: 0.032963 Sep 24 05:13:47.010844 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 629/1233] 10.222.0.50 () {60 vars in 1277 bytes} [Sat Sep 24 05:13:46 2022] GET /compute/v2.1/servers/36f8e098-a4b5-40a4-8f49-f341c5ad940c => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 24 05:13:48.159140 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-625d9fea-1326-4c96-aa4c-077a75fcb2a5 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Calling method '>' {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:13:48.159645 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.compute.api [None req-625d9fea-1326-4c96-aa4c-077a75fcb2a5 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] [instance: 08fb826b-e891-46c4-990d-ca03cf3f4222] Fetching instance by UUID {{(pid=120593) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:13:48.165937 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-625d9fea-1326-4c96-aa4c-077a75fcb2a5 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:13:48.166580 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-625d9fea-1326-4c96-aa4c-077a75fcb2a5 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:13:48.167022 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-625d9fea-1326-4c96-aa4c-077a75fcb2a5 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:13:48.167713 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-625d9fea-1326-4c96-aa4c-077a75fcb2a5 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:13:48.168161 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-625d9fea-1326-4c96-aa4c-077a75fcb2a5 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:13:48.168583 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-625d9fea-1326-4c96-aa4c-077a75fcb2a5 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:13:48.182345 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.wsgi [None req-625d9fea-1326-4c96-aa4c-077a75fcb2a5 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] HTTP exception thrown: Instance 08fb826b-e891-46c4-990d-ca03cf3f4222 could not be found. Sep 24 05:13:48.183954 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-625d9fea-1326-4c96-aa4c-077a75fcb2a5 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Request method failure captured: Sep 24 05:13:48.183954 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: request: DELETE /compute/v2.1/servers/08fb826b-e891-46c4-990d-ca03cf3f4222 HTTP/1.1 Sep 24 05:13:48.183954 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: Accept: application/json Sep 24 05:13:48.183954 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: Accept-Encoding: identity Sep 24 05:13:48.183954 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: Connection: close Sep 24 05:13:48.183954 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: Content-Length: 0 Sep 24 05:13:48.183954 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: Content-Type: application/json Sep 24 05:13:48.183954 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: Host: 10.222.0.50 Sep 24 05:13:48.183954 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: Openstack-System-Scope: None Sep 24 05:13:48.183954 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: User-Agent: python-urllib3/1.26.12 Sep 24 05:13:48.183954 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: X-Auth-Token: gAAAAABjLo8CSqMBxyhNVmFfsk1NTNzkp3_H84-yvN05Ky7OFnK0t-nxnJBueA__huZ344wnh8Vgbhzz-9W-5uWxnI6OuOG1n5FI0v0-wZbKR5_XkTPKM_bg5qB-KOvDkCr7huR5h5agVEcNYY1eBri4A8emzuD-hDI9bCM3DOTdHzYEghA5EZ8 Sep 24 05:13:48.183954 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: X-Domain-Id: None Sep 24 05:13:48.183954 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: X-Domain-Name: None Sep 24 05:13:48.183954 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: X-Identity-Status: Confirmed Sep 24 05:13:48.183954 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: X-Is-Admin-Project: True Sep 24 05:13:48.183954 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: X-Openstack-Nova-Api-Version: 2.20 Sep 24 05:13:48.183954 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: X-Project-Domain-Id: default Sep 24 05:13:48.183954 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: X-Project-Domain-Name: Default Sep 24 05:13:48.183954 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: X-Project-Id: c1aaf20f480a423ea5feca81585aeeed Sep 24 05:13:48.183954 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1434580538 Sep 24 05:13:48.183954 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: X-Role: member,reader Sep 24 05:13:48.183954 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: X-Roles: member,reader Sep 24 05:13:48.185774 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/c1aaf20f480a423ea5feca81585aeeed"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/c1aaf20f480a423ea5feca81585aeeed"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/c1aaf20f480a423ea5feca81585aeeed"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.50:8080", "publicURL": "http://10.222.0.50:8080/v1/AUTH_c1aaf20f480a423ea5feca81585aeeed"}]}] Sep 24 05:13:48.185774 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1434580538 Sep 24 05:13:48.185774 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: X-Tenant-Id: c1aaf20f480a423ea5feca81585aeeed Sep 24 05:13:48.185774 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1434580538 Sep 24 05:13:48.185774 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: X-User: tempest-AttachVolumeShelveTestJSON-1434580538-project Sep 24 05:13:48.185774 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: X-User-Domain-Id: default Sep 24 05:13:48.185774 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: X-User-Domain-Name: Default Sep 24 05:13:48.185774 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: X-User-Id: 0948754217fc4ff2ba0241fa35feaf90 Sep 24 05:13:48.185774 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1434580538-project Sep 24 05:13:48.185774 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: method: > Sep 24 05:13:48.185774 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: exception: Instance 08fb826b-e891-46c4-990d-ca03cf3f4222 could not be found. Sep 24 05:13:48.185774 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: action_args: {'id': '08fb826b-e891-46c4-990d-ca03cf3f4222'} Sep 24 05:13:48.186754 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 24 05:13:48.186754 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 05:13:48.186754 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 24 05:13:48.186754 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 24 05:13:48.186754 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 24 05:13:48.186754 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 24 05:13:48.186754 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 24 05:13:48.186754 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 24 05:13:48.186754 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 24 05:13:48.186754 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 24 05:13:48.186754 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 08fb826b-e891-46c4-990d-ca03cf3f4222 could not be found. Sep 24 05:13:48.186754 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi Sep 24 05:13:48.186754 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 05:13:48.186754 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi Sep 24 05:13:48.186754 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 05:13:48.186754 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 05:13:48.186754 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 05:13:48.186754 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 24 05:13:48.186754 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 24 05:13:48.186754 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 24 05:13:48.188371 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 24 05:13:48.188371 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 24 05:13:48.188371 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 24 05:13:48.188371 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 24 05:13:48.188371 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 24 05:13:48.188371 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 24 05:13:48.188371 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 24 05:13:48.188371 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 24 05:13:48.188371 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 24 05:13:48.188371 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 08fb826b-e891-46c4-990d-ca03cf3f4222 could not be found. Sep 24 05:13:48.188371 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi Sep 24 05:13:48.188371 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 05:13:48.188371 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi Sep 24 05:13:48.188371 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 05:13:48.188371 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 05:13:48.188371 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 05:13:48.188371 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 24 05:13:48.188371 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 24 05:13:48.188371 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 08fb826b-e891-46c4-990d-ca03cf3f4222 could not be found. Sep 24 05:13:48.188371 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi Sep 24 05:13:48.189931 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-625d9fea-1326-4c96-aa4c-077a75fcb2a5 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Returning 404 to user: Instance 08fb826b-e891-46c4-990d-ca03cf3f4222 could not be found. {{(pid=120593) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 24 05:13:48.189931 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-625d9fea-1326-4c96-aa4c-077a75fcb2a5 tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] 10.222.0.50 "DELETE /compute/v2.1/servers/08fb826b-e891-46c4-990d-ca03cf3f4222" status: 404 len: 111 microversion: 2.20 time: 0.030269 Sep 24 05:13:48.189931 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 605/1234] 10.222.0.50 () {60 vars in 1280 bytes} [Sat Sep 24 05:13:48 2022] DELETE /compute/v2.1/servers/08fb826b-e891-46c4-990d-ca03cf3f4222 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Sep 24 05:13:48.193705 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-33491abf-e113-4eb8-a8a7-c1cb056e81ea tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Calling method '>' {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:13:48.194364 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.compute.api [None req-33491abf-e113-4eb8-a8a7-c1cb056e81ea tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] [instance: 08fb826b-e891-46c4-990d-ca03cf3f4222] Fetching instance by UUID {{(pid=120594) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:13:48.201292 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-33491abf-e113-4eb8-a8a7-c1cb056e81ea tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:13:48.201774 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-33491abf-e113-4eb8-a8a7-c1cb056e81ea tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:13:48.202253 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-33491abf-e113-4eb8-a8a7-c1cb056e81ea tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:13:48.202946 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-33491abf-e113-4eb8-a8a7-c1cb056e81ea tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:13:48.203398 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-33491abf-e113-4eb8-a8a7-c1cb056e81ea tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:13:48.203824 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-33491abf-e113-4eb8-a8a7-c1cb056e81ea tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:13:48.216880 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: INFO nova.api.openstack.wsgi [None req-33491abf-e113-4eb8-a8a7-c1cb056e81ea tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] HTTP exception thrown: Instance 08fb826b-e891-46c4-990d-ca03cf3f4222 could not be found. Sep 24 05:13:48.218443 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-33491abf-e113-4eb8-a8a7-c1cb056e81ea tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Request method failure captured: Sep 24 05:13:48.218443 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: request: GET /compute/v2.1/servers/08fb826b-e891-46c4-990d-ca03cf3f4222 HTTP/1.1 Sep 24 05:13:48.218443 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: Accept: application/json Sep 24 05:13:48.218443 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: Accept-Encoding: identity Sep 24 05:13:48.218443 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: Connection: close Sep 24 05:13:48.218443 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: Content-Length: 0 Sep 24 05:13:48.218443 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: Content-Type: application/json Sep 24 05:13:48.218443 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: Host: 10.222.0.50 Sep 24 05:13:48.218443 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: Openstack-System-Scope: None Sep 24 05:13:48.218443 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: User-Agent: python-urllib3/1.26.12 Sep 24 05:13:48.218443 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: X-Auth-Token: gAAAAABjLo8CSqMBxyhNVmFfsk1NTNzkp3_H84-yvN05Ky7OFnK0t-nxnJBueA__huZ344wnh8Vgbhzz-9W-5uWxnI6OuOG1n5FI0v0-wZbKR5_XkTPKM_bg5qB-KOvDkCr7huR5h5agVEcNYY1eBri4A8emzuD-hDI9bCM3DOTdHzYEghA5EZ8 Sep 24 05:13:48.218443 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: X-Domain-Id: None Sep 24 05:13:48.218443 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: X-Domain-Name: None Sep 24 05:13:48.218443 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: X-Identity-Status: Confirmed Sep 24 05:13:48.218443 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: X-Is-Admin-Project: True Sep 24 05:13:48.218443 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: X-Openstack-Nova-Api-Version: 2.20 Sep 24 05:13:48.218443 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: X-Project-Domain-Id: default Sep 24 05:13:48.218443 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: X-Project-Domain-Name: Default Sep 24 05:13:48.218443 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: X-Project-Id: c1aaf20f480a423ea5feca81585aeeed Sep 24 05:13:48.218443 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1434580538 Sep 24 05:13:48.218443 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: X-Role: member,reader Sep 24 05:13:48.218443 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: X-Roles: member,reader Sep 24 05:13:48.220175 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/c1aaf20f480a423ea5feca81585aeeed"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/c1aaf20f480a423ea5feca81585aeeed"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/c1aaf20f480a423ea5feca81585aeeed"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.50:8080", "publicURL": "http://10.222.0.50:8080/v1/AUTH_c1aaf20f480a423ea5feca81585aeeed"}]}] Sep 24 05:13:48.220175 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1434580538 Sep 24 05:13:48.220175 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: X-Tenant-Id: c1aaf20f480a423ea5feca81585aeeed Sep 24 05:13:48.220175 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1434580538 Sep 24 05:13:48.220175 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: X-User: tempest-AttachVolumeShelveTestJSON-1434580538-project Sep 24 05:13:48.220175 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: X-User-Domain-Id: default Sep 24 05:13:48.220175 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: X-User-Domain-Name: Default Sep 24 05:13:48.220175 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: X-User-Id: 0948754217fc4ff2ba0241fa35feaf90 Sep 24 05:13:48.220175 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1434580538-project Sep 24 05:13:48.220175 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: method: > Sep 24 05:13:48.220175 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: exception: Instance 08fb826b-e891-46c4-990d-ca03cf3f4222 could not be found. Sep 24 05:13:48.220175 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: action_args: {'id': '08fb826b-e891-46c4-990d-ca03cf3f4222'} Sep 24 05:13:48.221078 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 24 05:13:48.221078 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 05:13:48.221078 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 24 05:13:48.221078 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 24 05:13:48.221078 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 24 05:13:48.221078 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 24 05:13:48.221078 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 24 05:13:48.221078 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 24 05:13:48.221078 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 24 05:13:48.221078 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 24 05:13:48.221078 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 08fb826b-e891-46c4-990d-ca03cf3f4222 could not be found. Sep 24 05:13:48.221078 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi Sep 24 05:13:48.221078 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 05:13:48.221078 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi Sep 24 05:13:48.221078 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 05:13:48.221078 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 05:13:48.221078 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 05:13:48.221078 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 24 05:13:48.221078 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 24 05:13:48.221078 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 24 05:13:48.222585 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 24 05:13:48.222585 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 24 05:13:48.222585 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 24 05:13:48.222585 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 24 05:13:48.222585 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 24 05:13:48.222585 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 24 05:13:48.222585 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 24 05:13:48.222585 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 08fb826b-e891-46c4-990d-ca03cf3f4222 could not be found. Sep 24 05:13:48.222585 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi Sep 24 05:13:48.222585 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 05:13:48.222585 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi Sep 24 05:13:48.222585 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 05:13:48.222585 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 05:13:48.222585 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 05:13:48.222585 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 24 05:13:48.222585 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 24 05:13:48.222585 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 08fb826b-e891-46c4-990d-ca03cf3f4222 could not be found. Sep 24 05:13:48.222585 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi Sep 24 05:13:48.224096 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-33491abf-e113-4eb8-a8a7-c1cb056e81ea tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] Returning 404 to user: Instance 08fb826b-e891-46c4-990d-ca03cf3f4222 could not be found. {{(pid=120594) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 24 05:13:48.224096 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [None req-33491abf-e113-4eb8-a8a7-c1cb056e81ea tempest-AttachVolumeShelveTestJSON-1434580538 tempest-AttachVolumeShelveTestJSON-1434580538-project] 10.222.0.50 "GET /compute/v2.1/servers/08fb826b-e891-46c4-990d-ca03cf3f4222" status: 404 len: 111 microversion: 2.20 time: 0.029999 Sep 24 05:13:48.224096 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 630/1235] 10.222.0.50 () {60 vars in 1277 bytes} [Sat Sep 24 05:13:48 2022] GET /compute/v2.1/servers/08fb826b-e891-46c4-990d-ca03cf3f4222 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 24 05:13:54.302526 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-59b9f9b0-02c5-401a-9265-1a560c9ab8a0 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Calling method '>' {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:13:54.303054 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.compute.api [None req-59b9f9b0-02c5-401a-9265-1a560c9ab8a0 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] [instance: 459e75d4-67d0-437c-aad4-09523804e931] Fetching instance by UUID {{(pid=120593) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:13:54.309741 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-59b9f9b0-02c5-401a-9265-1a560c9ab8a0 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:13:54.310578 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-59b9f9b0-02c5-401a-9265-1a560c9ab8a0 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:13:54.311018 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-59b9f9b0-02c5-401a-9265-1a560c9ab8a0 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:13:54.311703 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-59b9f9b0-02c5-401a-9265-1a560c9ab8a0 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:13:54.312153 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-59b9f9b0-02c5-401a-9265-1a560c9ab8a0 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:13:54.312571 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-59b9f9b0-02c5-401a-9265-1a560c9ab8a0 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:13:54.339512 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-59b9f9b0-02c5-401a-9265-1a560c9ab8a0 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] 10.222.0.50 "GET /compute/v2.1/servers/459e75d4-67d0-437c-aad4-09523804e931/ips" status: 200 len: 151 microversion: 2.1 time: 0.040802 Sep 24 05:13:54.340096 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 606/1236] 10.222.0.50 () {58 vars in 1248 bytes} [Sat Sep 24 05:13:54 2022] GET /compute/v2.1/servers/459e75d4-67d0-437c-aad4-09523804e931/ips => generated 151 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 05:13:55.686763 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-eb1ebe1b-dfdf-4749-8e97-608788a189f5 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "11c7cbb2-e15b-4704-8117-98254c381ee4"}} {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 05:13:55.689238 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.compute.api [None req-eb1ebe1b-dfdf-4749-8e97-608788a189f5 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] [instance: 459e75d4-67d0-437c-aad4-09523804e931] Fetching instance by UUID {{(pid=120594) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:13:55.696097 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-eb1ebe1b-dfdf-4749-8e97-608788a189f5 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:13:55.696611 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-eb1ebe1b-dfdf-4749-8e97-608788a189f5 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:13:55.697107 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-eb1ebe1b-dfdf-4749-8e97-608788a189f5 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:13:55.697852 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-eb1ebe1b-dfdf-4749-8e97-608788a189f5 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:13:55.698404 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-eb1ebe1b-dfdf-4749-8e97-608788a189f5 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:13:55.699005 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-eb1ebe1b-dfdf-4749-8e97-608788a189f5 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:13:56.046269 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [None req-eb1ebe1b-dfdf-4749-8e97-608788a189f5 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] 10.222.0.50 "POST /compute/v2.1/servers/459e75d4-67d0-437c-aad4-09523804e931/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.363298 Sep 24 05:13:56.047179 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 631/1237] 10.222.0.50 () {60 vars in 1323 bytes} [Sat Sep 24 05:13:55 2022] POST /compute/v2.1/servers/459e75d4-67d0-437c-aad4-09523804e931/os-volume_attachments => generated 194 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 05:14:07.238093 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-7c1ef1f9-4df6-49c0-a00e-38eb9850b3da tempest-TestVolumeBootPattern-1339481357 tempest-TestVolumeBootPattern-1339481357-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-918052982", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-418909133", "security_groups": [{"name": "tempest-secgroup-smoke-1562507068"}], "block_device_mapping_v2": [{"uuid": "f02e1d1a-8623-47fa-9903-f5b6c0c034cf", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "fcf1ce32-3017-4bcb-b05f-9527ef64d665"}]}} {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 05:14:07.249320 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG dbcounter [-] [120593] Writing DB stats nova_api:SELECT=14 {{(pid=120593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 05:14:07.250285 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG dbcounter [-] [120593] Writing DB stats nova_cell1:SELECT=28 {{(pid=120593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 05:14:07.363087 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.network.neutron [None req-7c1ef1f9-4df6-49c0-a00e-38eb9850b3da tempest-TestVolumeBootPattern-1339481357 tempest-TestVolumeBootPattern-1339481357-project] validate_networks() for [('fcf1ce32-3017-4bcb-b05f-9527ef64d665', None, None, None, None, None)] {{(pid=120593) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 24 05:14:07.799111 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.virt.hardware [None req-7c1ef1f9-4df6-49c0-a00e-38eb9850b3da tempest-TestVolumeBootPattern-1339481357 tempest-TestVolumeBootPattern-1339481357-project] Flavor limits 0:0:0 {{(pid=120593) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 24 05:14:07.799542 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.virt.hardware [None req-7c1ef1f9-4df6-49c0-a00e-38eb9850b3da tempest-TestVolumeBootPattern-1339481357 tempest-TestVolumeBootPattern-1339481357-project] Image limits 0:0:0 {{(pid=120593) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 24 05:14:07.800021 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.virt.hardware [None req-7c1ef1f9-4df6-49c0-a00e-38eb9850b3da tempest-TestVolumeBootPattern-1339481357 tempest-TestVolumeBootPattern-1339481357-project] Flavor pref 0:0:0 {{(pid=120593) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 24 05:14:07.800464 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.virt.hardware [None req-7c1ef1f9-4df6-49c0-a00e-38eb9850b3da tempest-TestVolumeBootPattern-1339481357 tempest-TestVolumeBootPattern-1339481357-project] Image pref 0:0:0 {{(pid=120593) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 24 05:14:07.800908 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.virt.hardware [None req-7c1ef1f9-4df6-49c0-a00e-38eb9850b3da tempest-TestVolumeBootPattern-1339481357 tempest-TestVolumeBootPattern-1339481357-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120593) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 24 05:14:07.810295 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-7c1ef1f9-4df6-49c0-a00e-38eb9850b3da tempest-TestVolumeBootPattern-1339481357 tempest-TestVolumeBootPattern-1339481357-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:14:07.811003 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-7c1ef1f9-4df6-49c0-a00e-38eb9850b3da tempest-TestVolumeBootPattern-1339481357 tempest-TestVolumeBootPattern-1339481357-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:14:07.811442 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-7c1ef1f9-4df6-49c0-a00e-38eb9850b3da tempest-TestVolumeBootPattern-1339481357 tempest-TestVolumeBootPattern-1339481357-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:14:07.812171 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-7c1ef1f9-4df6-49c0-a00e-38eb9850b3da tempest-TestVolumeBootPattern-1339481357 tempest-TestVolumeBootPattern-1339481357-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:14:07.812622 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-7c1ef1f9-4df6-49c0-a00e-38eb9850b3da tempest-TestVolumeBootPattern-1339481357 tempest-TestVolumeBootPattern-1339481357-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:14:07.813047 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-7c1ef1f9-4df6-49c0-a00e-38eb9850b3da tempest-TestVolumeBootPattern-1339481357 tempest-TestVolumeBootPattern-1339481357-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:14:07.829464 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.quota [None req-7c1ef1f9-4df6-49c0-a00e-38eb9850b3da tempest-TestVolumeBootPattern-1339481357 tempest-TestVolumeBootPattern-1339481357-project] Getting quotas for project fef19544ec414094953daea6d545a361. Resources: {'instances', 'ram', 'cores'} {{(pid=120593) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 24 05:14:07.833421 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.quota [None req-7c1ef1f9-4df6-49c0-a00e-38eb9850b3da tempest-TestVolumeBootPattern-1339481357 tempest-TestVolumeBootPattern-1339481357-project] Getting quotas for user 60edcebcccaa4da99ffddadd3e27c1c0 and project fef19544ec414094953daea6d545a361. Resources: {'instances', 'ram', 'cores'} {{(pid=120593) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 24 05:14:07.891536 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.compute.api [None req-7c1ef1f9-4df6-49c0-a00e-38eb9850b3da tempest-TestVolumeBootPattern-1339481357 tempest-TestVolumeBootPattern-1339481357-project] Going to run 1 instances... {{(pid=120593) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 24 05:14:07.893688 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.compute.api [None req-7c1ef1f9-4df6-49c0-a00e-38eb9850b3da tempest-TestVolumeBootPattern-1339481357 tempest-TestVolumeBootPattern-1339481357-project] [instance: af77c184-6aa4-4f31-b736-bf19ec7c1482] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='f02e1d1a-8623-47fa-9903-f5b6c0c034cf',volume_size=None,volume_type=None)] {{(pid=120593) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 24 05:14:07.957966 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG dbcounter [-] [120594] Writing DB stats nova_api:SELECT=20,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=120594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 05:14:07.959278 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG dbcounter [-] [120594] Writing DB stats nova_cell1:SELECT=37,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=120594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 05:14:07.964508 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-7c66311e-a3d2-48ac-ae05-41fd17b065c3 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Calling method '>' {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:14:07.965091 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.compute.api [None req-7c66311e-a3d2-48ac-ae05-41fd17b065c3 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] [instance: 459e75d4-67d0-437c-aad4-09523804e931] Fetching instance by UUID {{(pid=120594) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:14:07.972789 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-7c66311e-a3d2-48ac-ae05-41fd17b065c3 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:14:07.973333 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-7c66311e-a3d2-48ac-ae05-41fd17b065c3 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:14:07.973727 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-7c66311e-a3d2-48ac-ae05-41fd17b065c3 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:14:07.974443 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-7c66311e-a3d2-48ac-ae05-41fd17b065c3 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:14:07.974892 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-7c66311e-a3d2-48ac-ae05-41fd17b065c3 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:14:07.975319 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-7c66311e-a3d2-48ac-ae05-41fd17b065c3 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:14:08.035966 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR oslo.messaging._drivers.impl_rabbit [None req-7c1ef1f9-4df6-49c0-a00e-38eb9850b3da tempest-TestVolumeBootPattern-1339481357 tempest-TestVolumeBootPattern-1339481357-project] [32786bf9-9482-4d69-9edd-8377dde62128] AMQP server on 10.222.0.50:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Sep 24 05:14:08.063143 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.objects.instance [None req-7c66311e-a3d2-48ac-ae05-41fd17b065c3 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Lazy-loading 'services' on Instance uuid 459e75d4-67d0-437c-aad4-09523804e931 {{(pid=120594) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 24 05:14:08.133937 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [None req-7c66311e-a3d2-48ac-ae05-41fd17b065c3 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] 10.222.0.50 "DELETE /compute/v2.1/servers/459e75d4-67d0-437c-aad4-09523804e931/os-volume_attachments/11c7cbb2-e15b-4704-8117-98254c381ee4" status: 202 len: 0 microversion: 2.1 time: 0.177442 Sep 24 05:14:08.134725 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 632/1238] 10.222.0.50 () {58 vars in 1416 bytes} [Sat Sep 24 05:14:07 2022] DELETE /compute/v2.1/servers/459e75d4-67d0-437c-aad4-09523804e931/os-volume_attachments/11c7cbb2-e15b-4704-8117-98254c381ee4 => generated 0 bytes in 179 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 24 05:14:08.143800 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-e49573a1-999e-498e-b447-9188516cad7f tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Calling method '>' {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:14:08.145988 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.compute.api [None req-e49573a1-999e-498e-b447-9188516cad7f tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] [instance: 459e75d4-67d0-437c-aad4-09523804e931] Fetching instance by UUID {{(pid=120594) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:14:08.153206 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-e49573a1-999e-498e-b447-9188516cad7f tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:14:08.153695 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-e49573a1-999e-498e-b447-9188516cad7f tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:14:08.154153 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-e49573a1-999e-498e-b447-9188516cad7f tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:14:08.155012 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-e49573a1-999e-498e-b447-9188516cad7f tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:14:08.155716 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-e49573a1-999e-498e-b447-9188516cad7f tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:14:08.156132 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-e49573a1-999e-498e-b447-9188516cad7f tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:14:08.188246 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [None req-e49573a1-999e-498e-b447-9188516cad7f tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] 10.222.0.50 "GET /compute/v2.1/servers/459e75d4-67d0-437c-aad4-09523804e931/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048583 Sep 24 05:14:08.188795 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 633/1239] 10.222.0.50 () {58 vars in 1302 bytes} [Sat Sep 24 05:14:08 2022] GET /compute/v2.1/servers/459e75d4-67d0-437c-aad4-09523804e931/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 24 05:14:09.045024 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: INFO oslo.messaging._drivers.impl_rabbit [None req-7c1ef1f9-4df6-49c0-a00e-38eb9850b3da tempest-TestVolumeBootPattern-1339481357 tempest-TestVolumeBootPattern-1339481357-project] [32786bf9-9482-4d69-9edd-8377dde62128] Reconnected to AMQP server on 10.222.0.50:5672 via [amqp] client with port 49820. Sep 24 05:14:09.049705 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-7c1ef1f9-4df6-49c0-a00e-38eb9850b3da tempest-TestVolumeBootPattern-1339481357 tempest-TestVolumeBootPattern-1339481357-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.816118 Sep 24 05:14:09.050518 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 607/1240] 10.222.0.50 () {60 vars in 1147 bytes} [Sat Sep 24 05:14:07 2022] POST /compute/v2.1/servers => generated 406 bytes in 1817 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 24 05:14:09.064148 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-f7e95213-ddd8-40b4-953a-786efcf87a2f tempest-TestVolumeBootPattern-1339481357 tempest-TestVolumeBootPattern-1339481357-project] Calling method '>' {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:14:09.064939 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.compute.api [None req-f7e95213-ddd8-40b4-953a-786efcf87a2f tempest-TestVolumeBootPattern-1339481357 tempest-TestVolumeBootPattern-1339481357-project] [instance: af77c184-6aa4-4f31-b736-bf19ec7c1482] Fetching instance by UUID {{(pid=120594) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:14:09.122502 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.policy [None req-f7e95213-ddd8-40b4-953a-786efcf87a2f tempest-TestVolumeBootPattern-1339481357 tempest-TestVolumeBootPattern-1339481357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60edcebcccaa4da99ffddadd3e27c1c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fef19544ec414094953daea6d545a361', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:14:09.129287 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [None req-f7e95213-ddd8-40b4-953a-786efcf87a2f tempest-TestVolumeBootPattern-1339481357 tempest-TestVolumeBootPattern-1339481357-project] 10.222.0.50 "GET /compute/v2.1/servers/af77c184-6aa4-4f31-b736-bf19ec7c1482" status: 200 len: 1093 microversion: 2.1 time: 0.071172 Sep 24 05:14:09.129846 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 634/1241] 10.222.0.50 () {58 vars in 1236 bytes} [Sat Sep 24 05:14:09 2022] GET /compute/v2.1/servers/af77c184-6aa4-4f31-b736-bf19ec7c1482 => generated 1093 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 24 05:14:09.204575 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-3b5bfcac-1b52-433b-93f2-5a3fc66db5cb tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Calling method '>' {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:14:09.206477 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.compute.api [None req-3b5bfcac-1b52-433b-93f2-5a3fc66db5cb tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] [instance: 459e75d4-67d0-437c-aad4-09523804e931] Fetching instance by UUID {{(pid=120593) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:14:09.212627 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-3b5bfcac-1b52-433b-93f2-5a3fc66db5cb tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:14:09.213618 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-3b5bfcac-1b52-433b-93f2-5a3fc66db5cb tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:14:09.214087 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-3b5bfcac-1b52-433b-93f2-5a3fc66db5cb tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:14:09.214789 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-3b5bfcac-1b52-433b-93f2-5a3fc66db5cb tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:14:09.215248 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-3b5bfcac-1b52-433b-93f2-5a3fc66db5cb tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:14:09.215677 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-3b5bfcac-1b52-433b-93f2-5a3fc66db5cb tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:14:09.245699 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-3b5bfcac-1b52-433b-93f2-5a3fc66db5cb tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] 10.222.0.50 "GET /compute/v2.1/servers/459e75d4-67d0-437c-aad4-09523804e931/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.049024 Sep 24 05:14:09.246463 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 608/1242] 10.222.0.50 () {58 vars in 1302 bytes} [Sat Sep 24 05:14:09 2022] GET /compute/v2.1/servers/459e75d4-67d0-437c-aad4-09523804e931/os-volume_attachments => generated 25 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 24 05:14:09.309769 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-77f84dfc-0d1b-4fd6-9488-32d5856f639d tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Calling method '>' {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:14:09.310381 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.compute.api [None req-77f84dfc-0d1b-4fd6-9488-32d5856f639d tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] [instance: 459e75d4-67d0-437c-aad4-09523804e931] Fetching instance by UUID {{(pid=120594) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:14:09.317699 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-77f84dfc-0d1b-4fd6-9488-32d5856f639d tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:14:09.318444 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-77f84dfc-0d1b-4fd6-9488-32d5856f639d tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:14:09.319032 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-77f84dfc-0d1b-4fd6-9488-32d5856f639d tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:14:09.319721 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-77f84dfc-0d1b-4fd6-9488-32d5856f639d tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:14:09.320168 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-77f84dfc-0d1b-4fd6-9488-32d5856f639d tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:14:09.320578 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-77f84dfc-0d1b-4fd6-9488-32d5856f639d tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:14:09.345518 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.compute.api [None req-77f84dfc-0d1b-4fd6-9488-32d5856f639d tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] [instance: 459e75d4-67d0-437c-aad4-09523804e931] Going to try to terminate instance {{(pid=120594) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 24 05:14:09.421378 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [None req-77f84dfc-0d1b-4fd6-9488-32d5856f639d tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] 10.222.0.50 "DELETE /compute/v2.1/servers/459e75d4-67d0-437c-aad4-09523804e931" status: 204 len: 0 microversion: 2.1 time: 0.114870 Sep 24 05:14:09.421979 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 635/1243] 10.222.0.50 () {58 vars in 1239 bytes} [Sat Sep 24 05:14:09 2022] DELETE /compute/v2.1/servers/459e75d4-67d0-437c-aad4-09523804e931 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 24 05:14:09.430755 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-269be9e6-bf26-4448-8a9d-7acfed95b170 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Calling method '>' {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:14:09.431363 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.compute.api [None req-269be9e6-bf26-4448-8a9d-7acfed95b170 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] [instance: 459e75d4-67d0-437c-aad4-09523804e931] Fetching instance by UUID {{(pid=120593) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:14:09.437698 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-269be9e6-bf26-4448-8a9d-7acfed95b170 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:14:09.438214 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-269be9e6-bf26-4448-8a9d-7acfed95b170 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:14:09.438646 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-269be9e6-bf26-4448-8a9d-7acfed95b170 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:14:09.439334 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-269be9e6-bf26-4448-8a9d-7acfed95b170 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:14:09.439783 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-269be9e6-bf26-4448-8a9d-7acfed95b170 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:14:09.440230 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-269be9e6-bf26-4448-8a9d-7acfed95b170 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:14:09.574077 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-269be9e6-bf26-4448-8a9d-7acfed95b170 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74a8cc19ab204424ab23c62915ac2bab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87d5229e39fe4817b5187068d8acecc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:14:09.581848 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-269be9e6-bf26-4448-8a9d-7acfed95b170 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] 10.222.0.50 "GET /compute/v2.1/servers/459e75d4-67d0-437c-aad4-09523804e931" status: 200 len: 1682 microversion: 2.1 time: 0.155258 Sep 24 05:14:09.582441 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 609/1244] 10.222.0.50 () {58 vars in 1236 bytes} [Sat Sep 24 05:14:09 2022] GET /compute/v2.1/servers/459e75d4-67d0-437c-aad4-09523804e931 => generated 1682 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 05:14:10.151897 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-5685ba2a-b8bc-458d-82ea-c13f314d3c66 tempest-TestVolumeBootPattern-1339481357 tempest-TestVolumeBootPattern-1339481357-project] Calling method '>' {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:14:10.152593 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.compute.api [None req-5685ba2a-b8bc-458d-82ea-c13f314d3c66 tempest-TestVolumeBootPattern-1339481357 tempest-TestVolumeBootPattern-1339481357-project] [instance: af77c184-6aa4-4f31-b736-bf19ec7c1482] Fetching instance by UUID {{(pid=120594) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:14:10.204945 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.policy [None req-5685ba2a-b8bc-458d-82ea-c13f314d3c66 tempest-TestVolumeBootPattern-1339481357 tempest-TestVolumeBootPattern-1339481357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60edcebcccaa4da99ffddadd3e27c1c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fef19544ec414094953daea6d545a361', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:14:10.212447 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [None req-5685ba2a-b8bc-458d-82ea-c13f314d3c66 tempest-TestVolumeBootPattern-1339481357 tempest-TestVolumeBootPattern-1339481357-project] 10.222.0.50 "GET /compute/v2.1/servers/af77c184-6aa4-4f31-b736-bf19ec7c1482" status: 200 len: 1093 microversion: 2.1 time: 0.064704 Sep 24 05:14:10.213037 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 636/1245] 10.222.0.50 () {58 vars in 1236 bytes} [Sat Sep 24 05:14:10 2022] GET /compute/v2.1/servers/af77c184-6aa4-4f31-b736-bf19ec7c1482 => generated 1093 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 05:14:10.606153 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-a157572d-abbe-4be2-8ba1-b2cf72cbcd33 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Calling method '>' {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:14:10.606769 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.compute.api [None req-a157572d-abbe-4be2-8ba1-b2cf72cbcd33 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] [instance: 459e75d4-67d0-437c-aad4-09523804e931] Fetching instance by UUID {{(pid=120593) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:14:10.613147 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-a157572d-abbe-4be2-8ba1-b2cf72cbcd33 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:14:10.613631 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-a157572d-abbe-4be2-8ba1-b2cf72cbcd33 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:14:10.614097 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-a157572d-abbe-4be2-8ba1-b2cf72cbcd33 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:14:10.614790 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-a157572d-abbe-4be2-8ba1-b2cf72cbcd33 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:14:10.615248 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-a157572d-abbe-4be2-8ba1-b2cf72cbcd33 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:14:10.615675 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-a157572d-abbe-4be2-8ba1-b2cf72cbcd33 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:14:10.755456 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-a157572d-abbe-4be2-8ba1-b2cf72cbcd33 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74a8cc19ab204424ab23c62915ac2bab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87d5229e39fe4817b5187068d8acecc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:14:10.763126 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-a157572d-abbe-4be2-8ba1-b2cf72cbcd33 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] 10.222.0.50 "GET /compute/v2.1/servers/459e75d4-67d0-437c-aad4-09523804e931" status: 200 len: 1682 microversion: 2.1 time: 0.161391 Sep 24 05:14:10.763693 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 610/1246] 10.222.0.50 () {58 vars in 1236 bytes} [Sat Sep 24 05:14:10 2022] GET /compute/v2.1/servers/459e75d4-67d0-437c-aad4-09523804e931 => generated 1682 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 05:14:11.235325 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-54c7efbe-ea96-483a-833b-59c926f29245 tempest-TestVolumeBootPattern-1339481357 tempest-TestVolumeBootPattern-1339481357-project] Calling method '>' {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:14:11.236617 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.compute.api [None req-54c7efbe-ea96-483a-833b-59c926f29245 tempest-TestVolumeBootPattern-1339481357 tempest-TestVolumeBootPattern-1339481357-project] [instance: af77c184-6aa4-4f31-b736-bf19ec7c1482] Fetching instance by UUID {{(pid=120594) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:14:11.300795 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.policy [None req-54c7efbe-ea96-483a-833b-59c926f29245 tempest-TestVolumeBootPattern-1339481357 tempest-TestVolumeBootPattern-1339481357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60edcebcccaa4da99ffddadd3e27c1c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fef19544ec414094953daea6d545a361', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:14:11.314355 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [None req-54c7efbe-ea96-483a-833b-59c926f29245 tempest-TestVolumeBootPattern-1339481357 tempest-TestVolumeBootPattern-1339481357-project] 10.222.0.50 "GET /compute/v2.1/servers/af77c184-6aa4-4f31-b736-bf19ec7c1482" status: 200 len: 1093 microversion: 2.1 time: 0.082759 Sep 24 05:14:11.315058 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 637/1247] 10.222.0.50 () {58 vars in 1236 bytes} [Sat Sep 24 05:14:11 2022] GET /compute/v2.1/servers/af77c184-6aa4-4f31-b736-bf19ec7c1482 => generated 1093 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 05:14:11.787179 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-de63c692-9435-444c-81dc-8a941e945ee0 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Calling method '>' {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:14:11.787863 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.compute.api [None req-de63c692-9435-444c-81dc-8a941e945ee0 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] [instance: 459e75d4-67d0-437c-aad4-09523804e931] Fetching instance by UUID {{(pid=120593) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:14:11.794454 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-de63c692-9435-444c-81dc-8a941e945ee0 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:14:11.795142 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-de63c692-9435-444c-81dc-8a941e945ee0 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:14:11.795513 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-de63c692-9435-444c-81dc-8a941e945ee0 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:14:11.796417 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-de63c692-9435-444c-81dc-8a941e945ee0 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:14:11.797648 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-de63c692-9435-444c-81dc-8a941e945ee0 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:14:11.798094 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-de63c692-9435-444c-81dc-8a941e945ee0 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:14:12.079142 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-de63c692-9435-444c-81dc-8a941e945ee0 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74a8cc19ab204424ab23c62915ac2bab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87d5229e39fe4817b5187068d8acecc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:14:12.087268 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-de63c692-9435-444c-81dc-8a941e945ee0 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] 10.222.0.50 "GET /compute/v2.1/servers/459e75d4-67d0-437c-aad4-09523804e931" status: 200 len: 1682 microversion: 2.1 time: 0.304017 Sep 24 05:14:12.088729 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 611/1248] 10.222.0.50 () {58 vars in 1236 bytes} [Sat Sep 24 05:14:11 2022] GET /compute/v2.1/servers/459e75d4-67d0-437c-aad4-09523804e931 => generated 1682 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 24 05:14:12.337040 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-d53a7264-5b21-4596-bfcc-45ca7304df96 tempest-TestVolumeBootPattern-1339481357 tempest-TestVolumeBootPattern-1339481357-project] Calling method '>' {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:14:12.338394 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.compute.api [None req-d53a7264-5b21-4596-bfcc-45ca7304df96 tempest-TestVolumeBootPattern-1339481357 tempest-TestVolumeBootPattern-1339481357-project] [instance: af77c184-6aa4-4f31-b736-bf19ec7c1482] Fetching instance by UUID {{(pid=120594) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:14:12.522479 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.policy [None req-d53a7264-5b21-4596-bfcc-45ca7304df96 tempest-TestVolumeBootPattern-1339481357 tempest-TestVolumeBootPattern-1339481357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60edcebcccaa4da99ffddadd3e27c1c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fef19544ec414094953daea6d545a361', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:14:12.534147 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [None req-d53a7264-5b21-4596-bfcc-45ca7304df96 tempest-TestVolumeBootPattern-1339481357 tempest-TestVolumeBootPattern-1339481357-project] 10.222.0.50 "GET /compute/v2.1/servers/af77c184-6aa4-4f31-b736-bf19ec7c1482" status: 200 len: 1093 microversion: 2.1 time: 0.201196 Sep 24 05:14:12.535552 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 638/1249] 10.222.0.50 () {58 vars in 1236 bytes} [Sat Sep 24 05:14:12 2022] GET /compute/v2.1/servers/af77c184-6aa4-4f31-b736-bf19ec7c1482 => generated 1093 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 05:14:12.738736 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [req-e2790dcf-6cd6-4681-8d67-b7acea380c9c req-d65afe03-9d95-4d67-a8b4-03a904e9438e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "459e75d4-67d0-437c-aad4-09523804e931", "name": "network-vif-deleted", "tag": "ef9198dd-ee25-440b-bf14-75c1f892d961"}]} {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 05:14:12.773140 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [req-e2790dcf-6cd6-4681-8d67-b7acea380c9c req-d65afe03-9d95-4d67-a8b4-03a904e9438e service nova] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:14:12.773815 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [req-e2790dcf-6cd6-4681-8d67-b7acea380c9c req-d65afe03-9d95-4d67-a8b4-03a904e9438e service nova] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:14:12.774615 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [req-e2790dcf-6cd6-4681-8d67-b7acea380c9c req-d65afe03-9d95-4d67-a8b4-03a904e9438e service nova] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:14:12.791986 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.compute.server_external_events [req-e2790dcf-6cd6-4681-8d67-b7acea380c9c req-d65afe03-9d95-4d67-a8b4-03a904e9438e service nova] Creating event network-vif-deleted:ef9198dd-ee25-440b-bf14-75c1f892d961 for instance 459e75d4-67d0-437c-aad4-09523804e931 on hv-cinder-85918 Sep 24 05:14:12.797074 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [req-e2790dcf-6cd6-4681-8d67-b7acea380c9c req-d65afe03-9d95-4d67-a8b4-03a904e9438e service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.062703 Sep 24 05:14:12.801871 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 612/1250] 10.222.0.50 () {64 vars in 1317 bytes} [Sat Sep 24 05:14:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 05:14:13.113202 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-d7cc5686-7cc7-42cc-90eb-05f3f1becf2f tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Calling method '>' {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:14:13.114303 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.compute.api [None req-d7cc5686-7cc7-42cc-90eb-05f3f1becf2f tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] [instance: 459e75d4-67d0-437c-aad4-09523804e931] Fetching instance by UUID {{(pid=120594) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:14:13.122531 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-d7cc5686-7cc7-42cc-90eb-05f3f1becf2f tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:14:13.123353 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-d7cc5686-7cc7-42cc-90eb-05f3f1becf2f tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:14:13.123864 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-d7cc5686-7cc7-42cc-90eb-05f3f1becf2f tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:14:13.124780 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-d7cc5686-7cc7-42cc-90eb-05f3f1becf2f tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:14:13.125333 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-d7cc5686-7cc7-42cc-90eb-05f3f1becf2f tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:14:13.125829 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-d7cc5686-7cc7-42cc-90eb-05f3f1becf2f tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:14:13.160987 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-d7cc5686-7cc7-42cc-90eb-05f3f1becf2f tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:14:13.161486 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-d7cc5686-7cc7-42cc-90eb-05f3f1becf2f tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:14:13.161926 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-d7cc5686-7cc7-42cc-90eb-05f3f1becf2f tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:14:13.162464 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.objects.instance [None req-d7cc5686-7cc7-42cc-90eb-05f3f1becf2f tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Lazy-loading 'fault' on Instance uuid 459e75d4-67d0-437c-aad4-09523804e931 {{(pid=120594) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 24 05:14:13.208586 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.policy [None req-d7cc5686-7cc7-42cc-90eb-05f3f1becf2f tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74a8cc19ab204424ab23c62915ac2bab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87d5229e39fe4817b5187068d8acecc7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:14:13.217044 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [None req-d7cc5686-7cc7-42cc-90eb-05f3f1becf2f tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] 10.222.0.50 "GET /compute/v2.1/servers/459e75d4-67d0-437c-aad4-09523804e931" status: 200 len: 1331 microversion: 2.1 time: 0.109123 Sep 24 05:14:13.218030 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 639/1251] 10.222.0.50 () {58 vars in 1236 bytes} [Sat Sep 24 05:14:13 2022] GET /compute/v2.1/servers/459e75d4-67d0-437c-aad4-09523804e931 => generated 1331 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 05:14:13.564386 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-b953e32e-c0fc-478b-b9f2-62967f73d2d6 tempest-TestVolumeBootPattern-1339481357 tempest-TestVolumeBootPattern-1339481357-project] Calling method '>' {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:14:13.565191 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.compute.api [None req-b953e32e-c0fc-478b-b9f2-62967f73d2d6 tempest-TestVolumeBootPattern-1339481357 tempest-TestVolumeBootPattern-1339481357-project] [instance: af77c184-6aa4-4f31-b736-bf19ec7c1482] Fetching instance by UUID {{(pid=120593) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:14:13.573714 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-b7ec80c4-c68c-477b-9601-ee2711b77d2b tempest-TestMinimumBasicScenario-2093795776 tempest-TestMinimumBasicScenario-2093795776-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-872743105"}} {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 05:14:13.574954 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-b953e32e-c0fc-478b-b9f2-62967f73d2d6 tempest-TestVolumeBootPattern-1339481357 tempest-TestVolumeBootPattern-1339481357-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:14:13.575340 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.compute.api [None req-b7ec80c4-c68c-477b-9601-ee2711b77d2b tempest-TestMinimumBasicScenario-2093795776 tempest-TestMinimumBasicScenario-2093795776-project] [instance: c8dc693a-12ca-40a8-8ce8-4f5cb342fb8f] Fetching instance by UUID {{(pid=120594) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:14:13.575468 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-b953e32e-c0fc-478b-b9f2-62967f73d2d6 tempest-TestVolumeBootPattern-1339481357 tempest-TestVolumeBootPattern-1339481357-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:14:13.575894 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-b953e32e-c0fc-478b-b9f2-62967f73d2d6 tempest-TestVolumeBootPattern-1339481357 tempest-TestVolumeBootPattern-1339481357-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:14:13.578573 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-b953e32e-c0fc-478b-b9f2-62967f73d2d6 tempest-TestVolumeBootPattern-1339481357 tempest-TestVolumeBootPattern-1339481357-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:14:13.579400 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-b953e32e-c0fc-478b-b9f2-62967f73d2d6 tempest-TestVolumeBootPattern-1339481357 tempest-TestVolumeBootPattern-1339481357-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:14:13.580100 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-b953e32e-c0fc-478b-b9f2-62967f73d2d6 tempest-TestVolumeBootPattern-1339481357 tempest-TestVolumeBootPattern-1339481357-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:14:13.583361 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-b7ec80c4-c68c-477b-9601-ee2711b77d2b tempest-TestMinimumBasicScenario-2093795776 tempest-TestMinimumBasicScenario-2093795776-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:14:13.584107 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-b7ec80c4-c68c-477b-9601-ee2711b77d2b tempest-TestMinimumBasicScenario-2093795776 tempest-TestMinimumBasicScenario-2093795776-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:14:13.584750 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-b7ec80c4-c68c-477b-9601-ee2711b77d2b tempest-TestMinimumBasicScenario-2093795776 tempest-TestMinimumBasicScenario-2093795776-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:14:13.585656 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-b7ec80c4-c68c-477b-9601-ee2711b77d2b tempest-TestMinimumBasicScenario-2093795776 tempest-TestMinimumBasicScenario-2093795776-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:14:13.586221 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-b7ec80c4-c68c-477b-9601-ee2711b77d2b tempest-TestMinimumBasicScenario-2093795776 tempest-TestMinimumBasicScenario-2093795776-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:14:13.586864 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-b7ec80c4-c68c-477b-9601-ee2711b77d2b tempest-TestMinimumBasicScenario-2093795776 tempest-TestMinimumBasicScenario-2093795776-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:14:13.682493 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-b953e32e-c0fc-478b-b9f2-62967f73d2d6 tempest-TestVolumeBootPattern-1339481357 tempest-TestVolumeBootPattern-1339481357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60edcebcccaa4da99ffddadd3e27c1c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fef19544ec414094953daea6d545a361', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:14:13.691623 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-b953e32e-c0fc-478b-b9f2-62967f73d2d6 tempest-TestVolumeBootPattern-1339481357 tempest-TestVolumeBootPattern-1339481357-project] 10.222.0.50 "GET /compute/v2.1/servers/af77c184-6aa4-4f31-b736-bf19ec7c1482" status: 200 len: 1143 microversion: 2.1 time: 0.132100 Sep 24 05:14:13.713795 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 613/1252] 10.222.0.50 () {58 vars in 1236 bytes} [Sat Sep 24 05:14:13 2022] GET /compute/v2.1/servers/af77c184-6aa4-4f31-b736-bf19ec7c1482 => generated 1143 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 05:14:13.781596 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: INFO nova.network.security_group_api [None req-b7ec80c4-c68c-477b-9601-ee2711b77d2b tempest-TestMinimumBasicScenario-2093795776 tempest-TestMinimumBasicScenario-2093795776-project] Removing security group 04ed11fc-2c07-4d53-8110-ad9819653190 from port 3c4098d3-98fe-49ac-9677-5b3632da2208 Sep 24 05:14:14.141619 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [None req-b7ec80c4-c68c-477b-9601-ee2711b77d2b tempest-TestMinimumBasicScenario-2093795776 tempest-TestMinimumBasicScenario-2093795776-project] 10.222.0.50 "POST /compute/v2.1/servers/c8dc693a-12ca-40a8-8ce8-4f5cb342fb8f/action" status: 202 len: 0 microversion: 2.1 time: 0.573921 Sep 24 05:14:14.142352 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 640/1253] 10.222.0.50 () {60 vars in 1278 bytes} [Sat Sep 24 05:14:13 2022] POST /compute/v2.1/servers/c8dc693a-12ca-40a8-8ce8-4f5cb342fb8f/action => generated 0 bytes in 577 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 24 05:14:14.248425 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-90da96e6-4896-4a1e-ab04-1002986c1e71 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Calling method '>' {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:14:14.249063 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.compute.api [None req-90da96e6-4896-4a1e-ab04-1002986c1e71 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] [instance: 459e75d4-67d0-437c-aad4-09523804e931] Fetching instance by UUID {{(pid=120593) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:14:14.263916 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-90da96e6-4896-4a1e-ab04-1002986c1e71 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:14:14.264404 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-90da96e6-4896-4a1e-ab04-1002986c1e71 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:14:14.264842 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-90da96e6-4896-4a1e-ab04-1002986c1e71 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:14:14.267971 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-90da96e6-4896-4a1e-ab04-1002986c1e71 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:14:14.268561 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-90da96e6-4896-4a1e-ab04-1002986c1e71 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:14:14.269005 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-90da96e6-4896-4a1e-ab04-1002986c1e71 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:14:14.289944 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.wsgi [None req-90da96e6-4896-4a1e-ab04-1002986c1e71 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] HTTP exception thrown: Instance 459e75d4-67d0-437c-aad4-09523804e931 could not be found. Sep 24 05:14:14.292407 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-90da96e6-4896-4a1e-ab04-1002986c1e71 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Request method failure captured: Sep 24 05:14:14.292407 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: request: GET /compute/v2.1/servers/459e75d4-67d0-437c-aad4-09523804e931 HTTP/1.1 Sep 24 05:14:14.292407 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: Accept: application/json Sep 24 05:14:14.292407 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: Accept-Encoding: identity Sep 24 05:14:14.292407 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: Connection: close Sep 24 05:14:14.292407 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: Content-Length: 0 Sep 24 05:14:14.292407 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: Content-Type: application/json Sep 24 05:14:14.292407 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: Host: 10.222.0.50 Sep 24 05:14:14.292407 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: Openstack-System-Scope: None Sep 24 05:14:14.292407 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: User-Agent: python-urllib3/1.26.12 Sep 24 05:14:14.292407 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: X-Auth-Token: gAAAAABjLo8KJCPvHtvWyKaOwXAaewqfKJp-c56tHrqhjOY7vtWfARY07rjbw-W3QgTA2kDEaQgMq3ex8QYwhqyDv3WoWsnpjVPsFiqcb7HeDBvc5PhwgKBF3RB3Cu-UrcKVmBtV6eiqI3YpZ_J_-BmGo2bP4YmrVUCEd9XZC45eF-x5INM7y8Q Sep 24 05:14:14.292407 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: X-Domain-Id: None Sep 24 05:14:14.292407 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: X-Domain-Name: None Sep 24 05:14:14.292407 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: X-Identity-Status: Confirmed Sep 24 05:14:14.292407 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: X-Is-Admin-Project: True Sep 24 05:14:14.292407 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: X-Project-Domain-Id: default Sep 24 05:14:14.292407 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: X-Project-Domain-Name: Default Sep 24 05:14:14.292407 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: X-Project-Id: 87d5229e39fe4817b5187068d8acecc7 Sep 24 05:14:14.292407 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: X-Project-Name: tempest-AttachVolumeNegativeTest-993993432 Sep 24 05:14:14.292407 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: X-Role: member,reader Sep 24 05:14:14.292407 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: X-Roles: member,reader Sep 24 05:14:14.294133 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/87d5229e39fe4817b5187068d8acecc7"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/87d5229e39fe4817b5187068d8acecc7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/87d5229e39fe4817b5187068d8acecc7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.50:8080", "publicURL": "http://10.222.0.50:8080/v1/AUTH_87d5229e39fe4817b5187068d8acecc7"}]}] Sep 24 05:14:14.294133 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: X-Tenant: tempest-AttachVolumeNegativeTest-993993432 Sep 24 05:14:14.294133 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: X-Tenant-Id: 87d5229e39fe4817b5187068d8acecc7 Sep 24 05:14:14.294133 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-993993432 Sep 24 05:14:14.294133 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: X-User: tempest-AttachVolumeNegativeTest-993993432-project Sep 24 05:14:14.294133 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: X-User-Domain-Id: default Sep 24 05:14:14.294133 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: X-User-Domain-Name: Default Sep 24 05:14:14.294133 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: X-User-Id: 74a8cc19ab204424ab23c62915ac2bab Sep 24 05:14:14.294133 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: X-User-Name: tempest-AttachVolumeNegativeTest-993993432-project Sep 24 05:14:14.294133 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: method: > Sep 24 05:14:14.294133 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: exception: Instance 459e75d4-67d0-437c-aad4-09523804e931 could not be found. Sep 24 05:14:14.294133 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: action_args: {'id': '459e75d4-67d0-437c-aad4-09523804e931'} Sep 24 05:14:14.295135 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 24 05:14:14.295135 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 05:14:14.295135 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 24 05:14:14.295135 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 24 05:14:14.295135 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 24 05:14:14.295135 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 24 05:14:14.295135 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 24 05:14:14.295135 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 24 05:14:14.295135 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 24 05:14:14.295135 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 24 05:14:14.295135 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 459e75d4-67d0-437c-aad4-09523804e931 could not be found. Sep 24 05:14:14.295135 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi Sep 24 05:14:14.295135 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 05:14:14.295135 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi Sep 24 05:14:14.295135 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 05:14:14.295135 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 05:14:14.295135 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 05:14:14.295135 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 24 05:14:14.295135 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 24 05:14:14.295135 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 24 05:14:14.296751 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 24 05:14:14.296751 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 24 05:14:14.296751 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 24 05:14:14.296751 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 24 05:14:14.296751 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 24 05:14:14.296751 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 24 05:14:14.296751 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 24 05:14:14.296751 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 459e75d4-67d0-437c-aad4-09523804e931 could not be found. Sep 24 05:14:14.296751 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi Sep 24 05:14:14.296751 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 05:14:14.296751 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi Sep 24 05:14:14.296751 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 05:14:14.296751 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 05:14:14.296751 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 05:14:14.296751 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 24 05:14:14.296751 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 24 05:14:14.296751 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 459e75d4-67d0-437c-aad4-09523804e931 could not be found. Sep 24 05:14:14.296751 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi Sep 24 05:14:14.312418 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-90da96e6-4896-4a1e-ab04-1002986c1e71 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Returning 404 to user: Instance 459e75d4-67d0-437c-aad4-09523804e931 could not be found. {{(pid=120593) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 24 05:14:14.316183 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-90da96e6-4896-4a1e-ab04-1002986c1e71 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] 10.222.0.50 "GET /compute/v2.1/servers/459e75d4-67d0-437c-aad4-09523804e931" status: 404 len: 111 microversion: 2.1 time: 0.075038 Sep 24 05:14:14.320683 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 614/1254] 10.222.0.50 () {58 vars in 1236 bytes} [Sat Sep 24 05:14:14 2022] GET /compute/v2.1/servers/459e75d4-67d0-437c-aad4-09523804e931 => generated 111 bytes in 82 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 24 05:14:14.327094 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-cf2e7a20-0e03-43d6-9bd6-ba285840e9ac tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Calling method '.version_select at 0x7f7950811820>' {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:14:14.376412 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [None req-cf2e7a20-0e03-43d6-9bd6-ba285840e9ac tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] 10.222.0.50 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-884230319" status: 202 len: 0 microversion: 2.1 time: 0.053175 Sep 24 05:14:14.377477 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 641/1255] 10.222.0.50 () {58 vars in 1218 bytes} [Sat Sep 24 05:14:14 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-884230319 => generated 0 bytes in 56 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 24 05:14:14.716261 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-05fb1182-3461-4610-930d-aea438c5f144 tempest-TestVolumeBootPattern-1339481357 tempest-TestVolumeBootPattern-1339481357-project] Calling method '>' {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:14:14.716969 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.compute.api [None req-05fb1182-3461-4610-930d-aea438c5f144 tempest-TestVolumeBootPattern-1339481357 tempest-TestVolumeBootPattern-1339481357-project] [instance: af77c184-6aa4-4f31-b736-bf19ec7c1482] Fetching instance by UUID {{(pid=120593) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:14:14.723240 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-05fb1182-3461-4610-930d-aea438c5f144 tempest-TestVolumeBootPattern-1339481357 tempest-TestVolumeBootPattern-1339481357-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:14:14.723847 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-05fb1182-3461-4610-930d-aea438c5f144 tempest-TestVolumeBootPattern-1339481357 tempest-TestVolumeBootPattern-1339481357-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:14:14.724398 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-05fb1182-3461-4610-930d-aea438c5f144 tempest-TestVolumeBootPattern-1339481357 tempest-TestVolumeBootPattern-1339481357-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:14:14.725165 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-05fb1182-3461-4610-930d-aea438c5f144 tempest-TestVolumeBootPattern-1339481357 tempest-TestVolumeBootPattern-1339481357-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:14:14.725748 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-05fb1182-3461-4610-930d-aea438c5f144 tempest-TestVolumeBootPattern-1339481357 tempest-TestVolumeBootPattern-1339481357-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:14:14.726446 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-05fb1182-3461-4610-930d-aea438c5f144 tempest-TestVolumeBootPattern-1339481357 tempest-TestVolumeBootPattern-1339481357-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:14:14.747202 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 24 05:14:14.747877 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: Sat Sep 24 05:14:14 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/af77c184-6aa4-4f31-b736-bf19ec7c1482 (ip 10.222.0.50) !!! Sep 24 05:14:14.821820 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [req-2bf9d438-74b5-450c-857d-55a6e4aa5f1a req-127d4a04-6a26-4fb9-a79f-d7048e7f897e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c8dc693a-12ca-40a8-8ce8-4f5cb342fb8f", "tag": "3c4098d3-98fe-49ac-9677-5b3632da2208"}]} {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 05:14:14.833733 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [req-2bf9d438-74b5-450c-857d-55a6e4aa5f1a req-127d4a04-6a26-4fb9-a79f-d7048e7f897e service nova] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:14:14.834478 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [req-2bf9d438-74b5-450c-857d-55a6e4aa5f1a req-127d4a04-6a26-4fb9-a79f-d7048e7f897e service nova] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:14:14.835111 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [req-2bf9d438-74b5-450c-857d-55a6e4aa5f1a req-127d4a04-6a26-4fb9-a79f-d7048e7f897e service nova] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:14:14.848087 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: INFO nova.api.openstack.compute.server_external_events [req-2bf9d438-74b5-450c-857d-55a6e4aa5f1a req-127d4a04-6a26-4fb9-a79f-d7048e7f897e service nova] Creating event network-changed:3c4098d3-98fe-49ac-9677-5b3632da2208 for instance c8dc693a-12ca-40a8-8ce8-4f5cb342fb8f on hv-cinder-85918 Sep 24 05:14:14.854302 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [req-2bf9d438-74b5-450c-857d-55a6e4aa5f1a req-127d4a04-6a26-4fb9-a79f-d7048e7f897e service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037312 Sep 24 05:14:14.855689 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 642/1256] 10.222.0.50 () {64 vars in 1317 bytes} [Sat Sep 24 05:14:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 05:14:14.925661 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-05fb1182-3461-4610-930d-aea438c5f144 tempest-TestVolumeBootPattern-1339481357 tempest-TestVolumeBootPattern-1339481357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60edcebcccaa4da99ffddadd3e27c1c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fef19544ec414094953daea6d545a361', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:14:14.938247 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-05fb1182-3461-4610-930d-aea438c5f144 tempest-TestVolumeBootPattern-1339481357 tempest-TestVolumeBootPattern-1339481357-project] 10.222.0.50 "GET /compute/v2.1/servers/af77c184-6aa4-4f31-b736-bf19ec7c1482" status: 200 len: 1209 microversion: 2.1 time: 0.227069 Sep 24 05:14:14.939926 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 615/1257] 10.222.0.50 () {58 vars in 1236 bytes} [Sat Sep 24 05:14:14 2022] GET /compute/v2.1/servers/af77c184-6aa4-4f31-b736-bf19ec7c1482 => generated 1209 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 05:14:15.968834 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-b3c30158-f4fc-4bad-8ad3-61ad3f576da4 tempest-TestVolumeBootPattern-1339481357 tempest-TestVolumeBootPattern-1339481357-project] Calling method '>' {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:14:15.972118 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.compute.api [None req-b3c30158-f4fc-4bad-8ad3-61ad3f576da4 tempest-TestVolumeBootPattern-1339481357 tempest-TestVolumeBootPattern-1339481357-project] [instance: af77c184-6aa4-4f31-b736-bf19ec7c1482] Fetching instance by UUID {{(pid=120594) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:14:15.991794 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-b3c30158-f4fc-4bad-8ad3-61ad3f576da4 tempest-TestVolumeBootPattern-1339481357 tempest-TestVolumeBootPattern-1339481357-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:14:15.991928 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-b3c30158-f4fc-4bad-8ad3-61ad3f576da4 tempest-TestVolumeBootPattern-1339481357 tempest-TestVolumeBootPattern-1339481357-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:14:15.992329 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-b3c30158-f4fc-4bad-8ad3-61ad3f576da4 tempest-TestVolumeBootPattern-1339481357 tempest-TestVolumeBootPattern-1339481357-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:14:15.993237 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-b3c30158-f4fc-4bad-8ad3-61ad3f576da4 tempest-TestVolumeBootPattern-1339481357 tempest-TestVolumeBootPattern-1339481357-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:14:15.994557 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-b3c30158-f4fc-4bad-8ad3-61ad3f576da4 tempest-TestVolumeBootPattern-1339481357 tempest-TestVolumeBootPattern-1339481357-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:14:15.995169 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-b3c30158-f4fc-4bad-8ad3-61ad3f576da4 tempest-TestVolumeBootPattern-1339481357 tempest-TestVolumeBootPattern-1339481357-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:14:16.232613 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.policy [None req-b3c30158-f4fc-4bad-8ad3-61ad3f576da4 tempest-TestVolumeBootPattern-1339481357 tempest-TestVolumeBootPattern-1339481357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60edcebcccaa4da99ffddadd3e27c1c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fef19544ec414094953daea6d545a361', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:14:16.244508 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-7a3a0061-d7ba-47f1-839f-68a4a46a41e6 tempest-TestMinimumBasicScenario-2093795776 tempest-TestMinimumBasicScenario-2093795776-project] Calling method '>' {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:14:16.246225 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.compute.api [None req-7a3a0061-d7ba-47f1-839f-68a4a46a41e6 tempest-TestMinimumBasicScenario-2093795776 tempest-TestMinimumBasicScenario-2093795776-project] [instance: c8dc693a-12ca-40a8-8ce8-4f5cb342fb8f] Fetching instance by UUID {{(pid=120593) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:14:16.246840 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [None req-b3c30158-f4fc-4bad-8ad3-61ad3f576da4 tempest-TestVolumeBootPattern-1339481357 tempest-TestVolumeBootPattern-1339481357-project] 10.222.0.50 "GET /compute/v2.1/servers/af77c184-6aa4-4f31-b736-bf19ec7c1482" status: 200 len: 1265 microversion: 2.1 time: 0.284051 Sep 24 05:14:16.260852 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-7a3a0061-d7ba-47f1-839f-68a4a46a41e6 tempest-TestMinimumBasicScenario-2093795776 tempest-TestMinimumBasicScenario-2093795776-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:14:16.263414 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-7a3a0061-d7ba-47f1-839f-68a4a46a41e6 tempest-TestMinimumBasicScenario-2093795776 tempest-TestMinimumBasicScenario-2093795776-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:14:16.263827 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 643/1258] 10.222.0.50 () {58 vars in 1236 bytes} [Sat Sep 24 05:14:15 2022] GET /compute/v2.1/servers/af77c184-6aa4-4f31-b736-bf19ec7c1482 => generated 1265 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 05:14:16.265947 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-7a3a0061-d7ba-47f1-839f-68a4a46a41e6 tempest-TestMinimumBasicScenario-2093795776 tempest-TestMinimumBasicScenario-2093795776-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:14:16.270302 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-7a3a0061-d7ba-47f1-839f-68a4a46a41e6 tempest-TestMinimumBasicScenario-2093795776 tempest-TestMinimumBasicScenario-2093795776-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:14:16.271269 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-7a3a0061-d7ba-47f1-839f-68a4a46a41e6 tempest-TestMinimumBasicScenario-2093795776 tempest-TestMinimumBasicScenario-2093795776-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:14:16.272227 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-7a3a0061-d7ba-47f1-839f-68a4a46a41e6 tempest-TestMinimumBasicScenario-2093795776 tempest-TestMinimumBasicScenario-2093795776-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:14:16.487125 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.objects.instance [None req-7a3a0061-d7ba-47f1-839f-68a4a46a41e6 tempest-TestMinimumBasicScenario-2093795776 tempest-TestMinimumBasicScenario-2093795776-project] Lazy-loading 'services' on Instance uuid c8dc693a-12ca-40a8-8ce8-4f5cb342fb8f {{(pid=120593) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 24 05:14:16.599306 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [req-90aba282-0969-476e-9c17-2350b95ab0f2 req-a9d6c668-21fd-407d-b622-5a9408f7a692 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c8dc693a-12ca-40a8-8ce8-4f5cb342fb8f", "tag": "3c4098d3-98fe-49ac-9677-5b3632da2208"}]} {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 05:14:16.605455 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-7a3a0061-d7ba-47f1-839f-68a4a46a41e6 tempest-TestMinimumBasicScenario-2093795776 tempest-TestMinimumBasicScenario-2093795776-project] 10.222.0.50 "DELETE /compute/v2.1/servers/c8dc693a-12ca-40a8-8ce8-4f5cb342fb8f/os-volume_attachments/e5c6afc9-9f1a-4e9c-9f68-d6b4af6844a8" status: 202 len: 0 microversion: 2.1 time: 0.365941 Sep 24 05:14:16.609910 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 616/1259] 10.222.0.50 () {58 vars in 1416 bytes} [Sat Sep 24 05:14:16 2022] DELETE /compute/v2.1/servers/c8dc693a-12ca-40a8-8ce8-4f5cb342fb8f/os-volume_attachments/e5c6afc9-9f1a-4e9c-9f68-d6b4af6844a8 => generated 0 bytes in 371 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 24 05:14:16.617370 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-92c4e9d7-0cfd-4815-9372-b24733d84e9b tempest-TestMinimumBasicScenario-2093795776 tempest-TestMinimumBasicScenario-2093795776-project] Calling method '>' {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:14:16.620431 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.compute.api [None req-92c4e9d7-0cfd-4815-9372-b24733d84e9b tempest-TestMinimumBasicScenario-2093795776 tempest-TestMinimumBasicScenario-2093795776-project] [instance: c8dc693a-12ca-40a8-8ce8-4f5cb342fb8f] Fetching instance by UUID {{(pid=120593) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:14:16.624728 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [req-90aba282-0969-476e-9c17-2350b95ab0f2 req-a9d6c668-21fd-407d-b622-5a9408f7a692 service nova] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:14:16.625236 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [req-90aba282-0969-476e-9c17-2350b95ab0f2 req-a9d6c668-21fd-407d-b622-5a9408f7a692 service nova] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:14:16.625661 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [req-90aba282-0969-476e-9c17-2350b95ab0f2 req-a9d6c668-21fd-407d-b622-5a9408f7a692 service nova] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:14:16.640191 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: INFO nova.api.openstack.compute.server_external_events [req-90aba282-0969-476e-9c17-2350b95ab0f2 req-a9d6c668-21fd-407d-b622-5a9408f7a692 service nova] Creating event network-changed:3c4098d3-98fe-49ac-9677-5b3632da2208 for instance c8dc693a-12ca-40a8-8ce8-4f5cb342fb8f on hv-cinder-85918 Sep 24 05:14:16.642727 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-92c4e9d7-0cfd-4815-9372-b24733d84e9b tempest-TestMinimumBasicScenario-2093795776 tempest-TestMinimumBasicScenario-2093795776-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:14:16.644297 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-92c4e9d7-0cfd-4815-9372-b24733d84e9b tempest-TestMinimumBasicScenario-2093795776 tempest-TestMinimumBasicScenario-2093795776-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:14:16.645711 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [req-90aba282-0969-476e-9c17-2350b95ab0f2 req-a9d6c668-21fd-407d-b622-5a9408f7a692 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.380411 Sep 24 05:14:16.667932 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-92c4e9d7-0cfd-4815-9372-b24733d84e9b tempest-TestMinimumBasicScenario-2093795776 tempest-TestMinimumBasicScenario-2093795776-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.023s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:14:16.670099 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-92c4e9d7-0cfd-4815-9372-b24733d84e9b tempest-TestMinimumBasicScenario-2093795776 tempest-TestMinimumBasicScenario-2093795776-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:14:16.671313 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-92c4e9d7-0cfd-4815-9372-b24733d84e9b tempest-TestMinimumBasicScenario-2093795776 tempest-TestMinimumBasicScenario-2093795776-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:14:16.671549 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 644/1260] 10.222.0.50 () {64 vars in 1317 bytes} [Sat Sep 24 05:14:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 05:14:16.672695 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-92c4e9d7-0cfd-4815-9372-b24733d84e9b tempest-TestMinimumBasicScenario-2093795776 tempest-TestMinimumBasicScenario-2093795776-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:14:16.766919 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-92c4e9d7-0cfd-4815-9372-b24733d84e9b tempest-TestMinimumBasicScenario-2093795776 tempest-TestMinimumBasicScenario-2093795776-project] 10.222.0.50 "GET /compute/v2.1/servers/c8dc693a-12ca-40a8-8ce8-4f5cb342fb8f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.155658 Sep 24 05:14:16.769511 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 617/1261] 10.222.0.50 () {58 vars in 1302 bytes} [Sat Sep 24 05:14:16 2022] GET /compute/v2.1/servers/c8dc693a-12ca-40a8-8ce8-4f5cb342fb8f/os-volume_attachments => generated 197 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 05:14:16.938966 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [req-88e8269c-b879-4037-b857-a62509f3b256 req-13038e79-2759-4b05-adfa-2ffe5f196e9d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "af77c184-6aa4-4f31-b736-bf19ec7c1482", "tag": "b3fe81c9-e8d5-4709-aba9-c58720d8684a"}]} {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 05:14:16.950856 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [req-88e8269c-b879-4037-b857-a62509f3b256 req-13038e79-2759-4b05-adfa-2ffe5f196e9d service nova] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:14:16.951699 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [req-88e8269c-b879-4037-b857-a62509f3b256 req-13038e79-2759-4b05-adfa-2ffe5f196e9d service nova] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:14:16.952453 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [req-88e8269c-b879-4037-b857-a62509f3b256 req-13038e79-2759-4b05-adfa-2ffe5f196e9d service nova] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:14:16.966148 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: INFO nova.api.openstack.compute.server_external_events [req-88e8269c-b879-4037-b857-a62509f3b256 req-13038e79-2759-4b05-adfa-2ffe5f196e9d service nova] Creating event network-changed:b3fe81c9-e8d5-4709-aba9-c58720d8684a for instance af77c184-6aa4-4f31-b736-bf19ec7c1482 on hv-cinder-85918 Sep 24 05:14:16.972716 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [req-88e8269c-b879-4037-b857-a62509f3b256 req-13038e79-2759-4b05-adfa-2ffe5f196e9d service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040992 Sep 24 05:14:16.975312 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 645/1262] 10.222.0.50 () {64 vars in 1317 bytes} [Sat Sep 24 05:14:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 05:14:17.109196 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-13121d16-b066-4cf5-83d5-fecd9bc8c242 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Calling method '>' {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:14:17.109907 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.compute.api [None req-13121d16-b066-4cf5-83d5-fecd9bc8c242 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] [instance: 459e75d4-67d0-437c-aad4-09523804e931] Fetching instance by UUID {{(pid=120593) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:14:17.116415 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-13121d16-b066-4cf5-83d5-fecd9bc8c242 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:14:17.117415 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-13121d16-b066-4cf5-83d5-fecd9bc8c242 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:14:17.117951 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-13121d16-b066-4cf5-83d5-fecd9bc8c242 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:14:17.119518 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-13121d16-b066-4cf5-83d5-fecd9bc8c242 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:14:17.120203 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-13121d16-b066-4cf5-83d5-fecd9bc8c242 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:14:17.121247 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-13121d16-b066-4cf5-83d5-fecd9bc8c242 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:14:17.140278 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.wsgi [None req-13121d16-b066-4cf5-83d5-fecd9bc8c242 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] HTTP exception thrown: Instance 459e75d4-67d0-437c-aad4-09523804e931 could not be found. Sep 24 05:14:17.142547 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-13121d16-b066-4cf5-83d5-fecd9bc8c242 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Request method failure captured: Sep 24 05:14:17.142547 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: request: DELETE /compute/v2.1/servers/459e75d4-67d0-437c-aad4-09523804e931 HTTP/1.1 Sep 24 05:14:17.142547 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: Accept: application/json Sep 24 05:14:17.142547 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: Accept-Encoding: identity Sep 24 05:14:17.142547 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: Connection: close Sep 24 05:14:17.142547 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: Content-Length: 0 Sep 24 05:14:17.142547 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: Content-Type: application/json Sep 24 05:14:17.142547 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: Host: 10.222.0.50 Sep 24 05:14:17.142547 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: Openstack-System-Scope: None Sep 24 05:14:17.142547 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: User-Agent: python-urllib3/1.26.12 Sep 24 05:14:17.142547 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: X-Auth-Token: gAAAAABjLo8KJCPvHtvWyKaOwXAaewqfKJp-c56tHrqhjOY7vtWfARY07rjbw-W3QgTA2kDEaQgMq3ex8QYwhqyDv3WoWsnpjVPsFiqcb7HeDBvc5PhwgKBF3RB3Cu-UrcKVmBtV6eiqI3YpZ_J_-BmGo2bP4YmrVUCEd9XZC45eF-x5INM7y8Q Sep 24 05:14:17.142547 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: X-Domain-Id: None Sep 24 05:14:17.142547 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: X-Domain-Name: None Sep 24 05:14:17.142547 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: X-Identity-Status: Confirmed Sep 24 05:14:17.142547 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: X-Is-Admin-Project: True Sep 24 05:14:17.142547 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: X-Project-Domain-Id: default Sep 24 05:14:17.142547 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: X-Project-Domain-Name: Default Sep 24 05:14:17.142547 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: X-Project-Id: 87d5229e39fe4817b5187068d8acecc7 Sep 24 05:14:17.142547 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: X-Project-Name: tempest-AttachVolumeNegativeTest-993993432 Sep 24 05:14:17.142547 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: X-Role: member,reader Sep 24 05:14:17.142547 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: X-Roles: member,reader Sep 24 05:14:17.143939 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/87d5229e39fe4817b5187068d8acecc7"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/87d5229e39fe4817b5187068d8acecc7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/87d5229e39fe4817b5187068d8acecc7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.50:8080", "publicURL": "http://10.222.0.50:8080/v1/AUTH_87d5229e39fe4817b5187068d8acecc7"}]}] Sep 24 05:14:17.143939 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: X-Tenant: tempest-AttachVolumeNegativeTest-993993432 Sep 24 05:14:17.143939 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: X-Tenant-Id: 87d5229e39fe4817b5187068d8acecc7 Sep 24 05:14:17.143939 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-993993432 Sep 24 05:14:17.143939 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: X-User: tempest-AttachVolumeNegativeTest-993993432-project Sep 24 05:14:17.143939 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: X-User-Domain-Id: default Sep 24 05:14:17.143939 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: X-User-Domain-Name: Default Sep 24 05:14:17.143939 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: X-User-Id: 74a8cc19ab204424ab23c62915ac2bab Sep 24 05:14:17.143939 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: X-User-Name: tempest-AttachVolumeNegativeTest-993993432-project Sep 24 05:14:17.143939 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: method: > Sep 24 05:14:17.143939 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: exception: Instance 459e75d4-67d0-437c-aad4-09523804e931 could not be found. Sep 24 05:14:17.143939 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: action_args: {'id': '459e75d4-67d0-437c-aad4-09523804e931'} Sep 24 05:14:17.144751 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 24 05:14:17.144751 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 05:14:17.144751 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 24 05:14:17.144751 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 24 05:14:17.144751 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 24 05:14:17.144751 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 24 05:14:17.144751 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 24 05:14:17.144751 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 24 05:14:17.144751 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 24 05:14:17.144751 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 24 05:14:17.144751 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 459e75d4-67d0-437c-aad4-09523804e931 could not be found. Sep 24 05:14:17.144751 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi Sep 24 05:14:17.144751 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 05:14:17.144751 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi Sep 24 05:14:17.144751 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 05:14:17.144751 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 05:14:17.144751 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 05:14:17.144751 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 24 05:14:17.144751 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 24 05:14:17.144751 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 24 05:14:17.146021 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 24 05:14:17.146021 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 24 05:14:17.146021 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 24 05:14:17.146021 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 24 05:14:17.146021 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 24 05:14:17.146021 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 24 05:14:17.146021 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 24 05:14:17.146021 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 24 05:14:17.146021 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 24 05:14:17.146021 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 459e75d4-67d0-437c-aad4-09523804e931 could not be found. Sep 24 05:14:17.146021 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi Sep 24 05:14:17.146021 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 05:14:17.146021 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi Sep 24 05:14:17.146021 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 05:14:17.146021 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 05:14:17.146021 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 05:14:17.146021 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 24 05:14:17.146021 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 24 05:14:17.146021 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 459e75d4-67d0-437c-aad4-09523804e931 could not be found. Sep 24 05:14:17.146021 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi Sep 24 05:14:17.148990 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-13121d16-b066-4cf5-83d5-fecd9bc8c242 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Returning 404 to user: Instance 459e75d4-67d0-437c-aad4-09523804e931 could not be found. {{(pid=120593) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 24 05:14:17.150094 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-13121d16-b066-4cf5-83d5-fecd9bc8c242 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] 10.222.0.50 "DELETE /compute/v2.1/servers/459e75d4-67d0-437c-aad4-09523804e931" status: 404 len: 111 microversion: 2.1 time: 0.047113 Sep 24 05:14:17.151395 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 618/1263] 10.222.0.50 () {58 vars in 1239 bytes} [Sat Sep 24 05:14:17 2022] DELETE /compute/v2.1/servers/459e75d4-67d0-437c-aad4-09523804e931 => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 24 05:14:17.161184 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-ae2614a0-a927-4a04-9b62-792219143b94 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Calling method '>' {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:14:17.162126 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.compute.api [None req-ae2614a0-a927-4a04-9b62-792219143b94 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] [instance: 459e75d4-67d0-437c-aad4-09523804e931] Fetching instance by UUID {{(pid=120594) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:14:17.177601 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-ae2614a0-a927-4a04-9b62-792219143b94 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:14:17.178900 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-ae2614a0-a927-4a04-9b62-792219143b94 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:14:17.179857 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-ae2614a0-a927-4a04-9b62-792219143b94 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:14:17.182128 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-ae2614a0-a927-4a04-9b62-792219143b94 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:14:17.183191 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-ae2614a0-a927-4a04-9b62-792219143b94 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:14:17.184437 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-ae2614a0-a927-4a04-9b62-792219143b94 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:14:17.205940 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: INFO nova.api.openstack.wsgi [None req-ae2614a0-a927-4a04-9b62-792219143b94 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] HTTP exception thrown: Instance 459e75d4-67d0-437c-aad4-09523804e931 could not be found. Sep 24 05:14:17.208638 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-ae2614a0-a927-4a04-9b62-792219143b94 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Request method failure captured: Sep 24 05:14:17.208638 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: request: GET /compute/v2.1/servers/459e75d4-67d0-437c-aad4-09523804e931 HTTP/1.1 Sep 24 05:14:17.208638 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: Accept: application/json Sep 24 05:14:17.208638 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: Accept-Encoding: identity Sep 24 05:14:17.208638 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: Connection: close Sep 24 05:14:17.208638 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: Content-Length: 0 Sep 24 05:14:17.208638 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: Content-Type: application/json Sep 24 05:14:17.208638 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: Host: 10.222.0.50 Sep 24 05:14:17.208638 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: Openstack-System-Scope: None Sep 24 05:14:17.208638 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: User-Agent: python-urllib3/1.26.12 Sep 24 05:14:17.208638 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: X-Auth-Token: gAAAAABjLo8KJCPvHtvWyKaOwXAaewqfKJp-c56tHrqhjOY7vtWfARY07rjbw-W3QgTA2kDEaQgMq3ex8QYwhqyDv3WoWsnpjVPsFiqcb7HeDBvc5PhwgKBF3RB3Cu-UrcKVmBtV6eiqI3YpZ_J_-BmGo2bP4YmrVUCEd9XZC45eF-x5INM7y8Q Sep 24 05:14:17.208638 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: X-Domain-Id: None Sep 24 05:14:17.208638 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: X-Domain-Name: None Sep 24 05:14:17.208638 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: X-Identity-Status: Confirmed Sep 24 05:14:17.208638 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: X-Is-Admin-Project: True Sep 24 05:14:17.208638 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: X-Project-Domain-Id: default Sep 24 05:14:17.208638 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: X-Project-Domain-Name: Default Sep 24 05:14:17.208638 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: X-Project-Id: 87d5229e39fe4817b5187068d8acecc7 Sep 24 05:14:17.208638 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: X-Project-Name: tempest-AttachVolumeNegativeTest-993993432 Sep 24 05:14:17.208638 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: X-Role: member,reader Sep 24 05:14:17.208638 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: X-Roles: member,reader Sep 24 05:14:17.210387 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/87d5229e39fe4817b5187068d8acecc7"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/87d5229e39fe4817b5187068d8acecc7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/87d5229e39fe4817b5187068d8acecc7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.50:8080", "publicURL": "http://10.222.0.50:8080/v1/AUTH_87d5229e39fe4817b5187068d8acecc7"}]}] Sep 24 05:14:17.210387 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: X-Tenant: tempest-AttachVolumeNegativeTest-993993432 Sep 24 05:14:17.210387 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: X-Tenant-Id: 87d5229e39fe4817b5187068d8acecc7 Sep 24 05:14:17.210387 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-993993432 Sep 24 05:14:17.210387 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: X-User: tempest-AttachVolumeNegativeTest-993993432-project Sep 24 05:14:17.210387 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: X-User-Domain-Id: default Sep 24 05:14:17.210387 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: X-User-Domain-Name: Default Sep 24 05:14:17.210387 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: X-User-Id: 74a8cc19ab204424ab23c62915ac2bab Sep 24 05:14:17.210387 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: X-User-Name: tempest-AttachVolumeNegativeTest-993993432-project Sep 24 05:14:17.210387 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: method: > Sep 24 05:14:17.210387 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: exception: Instance 459e75d4-67d0-437c-aad4-09523804e931 could not be found. Sep 24 05:14:17.210387 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: action_args: {'id': '459e75d4-67d0-437c-aad4-09523804e931'} Sep 24 05:14:17.211534 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 24 05:14:17.211534 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 05:14:17.211534 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 24 05:14:17.211534 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 24 05:14:17.211534 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 24 05:14:17.211534 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 24 05:14:17.211534 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 24 05:14:17.211534 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 24 05:14:17.211534 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 24 05:14:17.211534 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 24 05:14:17.211534 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 459e75d4-67d0-437c-aad4-09523804e931 could not be found. Sep 24 05:14:17.211534 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi Sep 24 05:14:17.211534 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 05:14:17.211534 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi Sep 24 05:14:17.211534 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 05:14:17.211534 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 05:14:17.211534 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 05:14:17.211534 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 24 05:14:17.211534 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 24 05:14:17.211534 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 24 05:14:17.213160 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 24 05:14:17.213160 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 24 05:14:17.213160 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 24 05:14:17.213160 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 24 05:14:17.213160 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 24 05:14:17.213160 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 24 05:14:17.213160 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 24 05:14:17.213160 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 459e75d4-67d0-437c-aad4-09523804e931 could not be found. Sep 24 05:14:17.213160 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi Sep 24 05:14:17.213160 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 05:14:17.213160 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi Sep 24 05:14:17.213160 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 05:14:17.213160 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 05:14:17.213160 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 05:14:17.213160 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 24 05:14:17.213160 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 24 05:14:17.213160 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 459e75d4-67d0-437c-aad4-09523804e931 could not be found. Sep 24 05:14:17.213160 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi Sep 24 05:14:17.215346 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-ae2614a0-a927-4a04-9b62-792219143b94 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Returning 404 to user: Instance 459e75d4-67d0-437c-aad4-09523804e931 could not be found. {{(pid=120594) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 24 05:14:17.216553 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [None req-ae2614a0-a927-4a04-9b62-792219143b94 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] 10.222.0.50 "GET /compute/v2.1/servers/459e75d4-67d0-437c-aad4-09523804e931" status: 404 len: 111 microversion: 2.1 time: 0.061160 Sep 24 05:14:17.220529 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 646/1264] 10.222.0.50 () {58 vars in 1236 bytes} [Sat Sep 24 05:14:17 2022] GET /compute/v2.1/servers/459e75d4-67d0-437c-aad4-09523804e931 => generated 111 bytes in 63 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 24 05:14:17.272646 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-f5e27ae4-99d8-4cfb-bdaf-bbbad8393e32 tempest-TestVolumeBootPattern-1339481357 tempest-TestVolumeBootPattern-1339481357-project] Calling method '>' {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:14:17.274333 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.compute.api [None req-f5e27ae4-99d8-4cfb-bdaf-bbbad8393e32 tempest-TestVolumeBootPattern-1339481357 tempest-TestVolumeBootPattern-1339481357-project] [instance: af77c184-6aa4-4f31-b736-bf19ec7c1482] Fetching instance by UUID {{(pid=120593) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:14:17.295242 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-f5e27ae4-99d8-4cfb-bdaf-bbbad8393e32 tempest-TestVolumeBootPattern-1339481357 tempest-TestVolumeBootPattern-1339481357-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:14:17.299676 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-f5e27ae4-99d8-4cfb-bdaf-bbbad8393e32 tempest-TestVolumeBootPattern-1339481357 tempest-TestVolumeBootPattern-1339481357-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:14:17.300129 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-f5e27ae4-99d8-4cfb-bdaf-bbbad8393e32 tempest-TestVolumeBootPattern-1339481357 tempest-TestVolumeBootPattern-1339481357-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:14:17.304320 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-f5e27ae4-99d8-4cfb-bdaf-bbbad8393e32 tempest-TestVolumeBootPattern-1339481357 tempest-TestVolumeBootPattern-1339481357-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:14:17.305584 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-f5e27ae4-99d8-4cfb-bdaf-bbbad8393e32 tempest-TestVolumeBootPattern-1339481357 tempest-TestVolumeBootPattern-1339481357-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:14:17.305584 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-f5e27ae4-99d8-4cfb-bdaf-bbbad8393e32 tempest-TestVolumeBootPattern-1339481357 tempest-TestVolumeBootPattern-1339481357-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:14:17.744556 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-f5e27ae4-99d8-4cfb-bdaf-bbbad8393e32 tempest-TestVolumeBootPattern-1339481357 tempest-TestVolumeBootPattern-1339481357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60edcebcccaa4da99ffddadd3e27c1c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fef19544ec414094953daea6d545a361', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:14:17.759205 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-f5e27ae4-99d8-4cfb-bdaf-bbbad8393e32 tempest-TestVolumeBootPattern-1339481357 tempest-TestVolumeBootPattern-1339481357-project] 10.222.0.50 "GET /compute/v2.1/servers/af77c184-6aa4-4f31-b736-bf19ec7c1482" status: 200 len: 1265 microversion: 2.1 time: 0.491372 Sep 24 05:14:17.760748 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 619/1265] 10.222.0.50 () {58 vars in 1236 bytes} [Sat Sep 24 05:14:17 2022] GET /compute/v2.1/servers/af77c184-6aa4-4f31-b736-bf19ec7c1482 => generated 1265 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 05:14:17.781392 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-5e3c6236-15c7-4a87-993f-f7381f53ed22 tempest-TestMinimumBasicScenario-2093795776 tempest-TestMinimumBasicScenario-2093795776-project] Calling method '>' {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:14:17.783647 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.compute.api [None req-5e3c6236-15c7-4a87-993f-f7381f53ed22 tempest-TestMinimumBasicScenario-2093795776 tempest-TestMinimumBasicScenario-2093795776-project] [instance: c8dc693a-12ca-40a8-8ce8-4f5cb342fb8f] Fetching instance by UUID {{(pid=120594) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:14:17.794295 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-5e3c6236-15c7-4a87-993f-f7381f53ed22 tempest-TestMinimumBasicScenario-2093795776 tempest-TestMinimumBasicScenario-2093795776-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:14:17.794295 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-5e3c6236-15c7-4a87-993f-f7381f53ed22 tempest-TestMinimumBasicScenario-2093795776 tempest-TestMinimumBasicScenario-2093795776-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:14:17.794488 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-5e3c6236-15c7-4a87-993f-f7381f53ed22 tempest-TestMinimumBasicScenario-2093795776 tempest-TestMinimumBasicScenario-2093795776-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:14:17.795143 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-5e3c6236-15c7-4a87-993f-f7381f53ed22 tempest-TestMinimumBasicScenario-2093795776 tempest-TestMinimumBasicScenario-2093795776-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:14:17.795875 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-5e3c6236-15c7-4a87-993f-f7381f53ed22 tempest-TestMinimumBasicScenario-2093795776 tempest-TestMinimumBasicScenario-2093795776-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:14:17.796540 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-5e3c6236-15c7-4a87-993f-f7381f53ed22 tempest-TestMinimumBasicScenario-2093795776 tempest-TestMinimumBasicScenario-2093795776-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:14:17.838153 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [None req-5e3c6236-15c7-4a87-993f-f7381f53ed22 tempest-TestMinimumBasicScenario-2093795776 tempest-TestMinimumBasicScenario-2093795776-project] 10.222.0.50 "GET /compute/v2.1/servers/c8dc693a-12ca-40a8-8ce8-4f5cb342fb8f/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.060945 Sep 24 05:14:17.846573 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG dbcounter [-] [120593] Writing DB stats nova_cell0:SELECT=2 {{(pid=120593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 05:14:17.847705 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 647/1266] 10.222.0.50 () {58 vars in 1302 bytes} [Sat Sep 24 05:14:17 2022] GET /compute/v2.1/servers/c8dc693a-12ca-40a8-8ce8-4f5cb342fb8f/os-volume_attachments => generated 25 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 24 05:14:17.847843 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG dbcounter [-] [120593] Writing DB stats nova_cell0:SELECT=6 {{(pid=120593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 05:14:17.856265 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-02bb6a1b-d4b0-4688-8436-ba005ff296eb tempest-TestMinimumBasicScenario-2093795776 tempest-TestMinimumBasicScenario-2093795776-project] Calling method '>' {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:14:17.856627 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.compute.api [None req-02bb6a1b-d4b0-4688-8436-ba005ff296eb tempest-TestMinimumBasicScenario-2093795776 tempest-TestMinimumBasicScenario-2093795776-project] [instance: c8dc693a-12ca-40a8-8ce8-4f5cb342fb8f] Fetching instance by UUID {{(pid=120593) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:14:17.885188 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-02bb6a1b-d4b0-4688-8436-ba005ff296eb tempest-TestMinimumBasicScenario-2093795776 tempest-TestMinimumBasicScenario-2093795776-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:14:17.885691 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-02bb6a1b-d4b0-4688-8436-ba005ff296eb tempest-TestMinimumBasicScenario-2093795776 tempest-TestMinimumBasicScenario-2093795776-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:14:17.891571 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-02bb6a1b-d4b0-4688-8436-ba005ff296eb tempest-TestMinimumBasicScenario-2093795776 tempest-TestMinimumBasicScenario-2093795776-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:14:17.892358 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-02bb6a1b-d4b0-4688-8436-ba005ff296eb tempest-TestMinimumBasicScenario-2093795776 tempest-TestMinimumBasicScenario-2093795776-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:14:17.892841 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-02bb6a1b-d4b0-4688-8436-ba005ff296eb tempest-TestMinimumBasicScenario-2093795776 tempest-TestMinimumBasicScenario-2093795776-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:14:17.893280 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-02bb6a1b-d4b0-4688-8436-ba005ff296eb tempest-TestMinimumBasicScenario-2093795776 tempest-TestMinimumBasicScenario-2093795776-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:14:17.995126 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.wsgi [None req-02bb6a1b-d4b0-4688-8436-ba005ff296eb tempest-TestMinimumBasicScenario-2093795776 tempest-TestMinimumBasicScenario-2093795776-project] HTTP exception thrown: Instance c8dc693a-12ca-40a8-8ce8-4f5cb342fb8f is not attached to volume e5c6afc9-9f1a-4e9c-9f68-d6b4af6844a8 Sep 24 05:14:17.998123 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-02bb6a1b-d4b0-4688-8436-ba005ff296eb tempest-TestMinimumBasicScenario-2093795776 tempest-TestMinimumBasicScenario-2093795776-project] Request method failure captured: Sep 24 05:14:17.998123 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: request: DELETE /compute/v2.1/servers/c8dc693a-12ca-40a8-8ce8-4f5cb342fb8f/os-volume_attachments/e5c6afc9-9f1a-4e9c-9f68-d6b4af6844a8 HTTP/1.1 Sep 24 05:14:17.998123 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: Accept: application/json Sep 24 05:14:17.998123 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: Accept-Encoding: identity Sep 24 05:14:17.998123 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: Connection: close Sep 24 05:14:17.998123 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: Content-Length: 0 Sep 24 05:14:17.998123 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: Content-Type: application/json Sep 24 05:14:17.998123 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: Host: 10.222.0.50 Sep 24 05:14:17.998123 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: Openstack-System-Scope: None Sep 24 05:14:17.998123 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: User-Agent: python-urllib3/1.26.12 Sep 24 05:14:17.998123 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: X-Auth-Token: gAAAAABjLpFEQKVj7D8Qy_ezifbbgi6960YvQ0QzONrT8XGtio33rvCH3C-2RqWPdLxkbf8xu_1VA30-vPtf0ism6OPe_q1qkSQxmgi4ePnJKT-d5k9Q_cpmUHTb-76y1wYwcUpZElNQ-T9CIAomFCgo8uy9tAMGmkFwT1tRW8mGI2lpeKPc1gA Sep 24 05:14:17.998123 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: X-Domain-Id: None Sep 24 05:14:17.998123 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: X-Domain-Name: None Sep 24 05:14:17.998123 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: X-Identity-Status: Confirmed Sep 24 05:14:17.998123 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: X-Is-Admin-Project: True Sep 24 05:14:17.998123 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: X-Project-Domain-Id: default Sep 24 05:14:17.998123 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: X-Project-Domain-Name: Default Sep 24 05:14:17.998123 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: X-Project-Id: 85c73f9a74da4079a54a503e0b42ca2e Sep 24 05:14:17.998123 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: X-Project-Name: tempest-TestMinimumBasicScenario-2093795776 Sep 24 05:14:17.998123 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: X-Role: member,reader Sep 24 05:14:17.998123 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: X-Roles: member,reader Sep 24 05:14:17.999819 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/85c73f9a74da4079a54a503e0b42ca2e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/85c73f9a74da4079a54a503e0b42ca2e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/85c73f9a74da4079a54a503e0b42ca2e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.50:8080", "publicURL": "http://10.222.0.50:8080/v1/AUTH_85c73f9a74da4079a54a503e0b42ca2e"}]}] Sep 24 05:14:17.999819 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: X-Tenant: tempest-TestMinimumBasicScenario-2093795776 Sep 24 05:14:17.999819 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: X-Tenant-Id: 85c73f9a74da4079a54a503e0b42ca2e Sep 24 05:14:17.999819 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: X-Tenant-Name: tempest-TestMinimumBasicScenario-2093795776 Sep 24 05:14:17.999819 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: X-User: tempest-TestMinimumBasicScenario-2093795776-project Sep 24 05:14:17.999819 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: X-User-Domain-Id: default Sep 24 05:14:17.999819 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: X-User-Domain-Name: Default Sep 24 05:14:17.999819 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: X-User-Id: f67fe549bae6447f8b24219becb3bf97 Sep 24 05:14:17.999819 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: X-User-Name: tempest-TestMinimumBasicScenario-2093795776-project Sep 24 05:14:17.999819 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: method: > Sep 24 05:14:17.999819 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: exception: Instance c8dc693a-12ca-40a8-8ce8-4f5cb342fb8f is not attached to volume e5c6afc9-9f1a-4e9c-9f68-d6b4af6844a8 Sep 24 05:14:18.000734 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: action_args: {'server_id': 'c8dc693a-12ca-40a8-8ce8-4f5cb342fb8f', 'id': 'e5c6afc9-9f1a-4e9c-9f68-d6b4af6844a8'} Sep 24 05:14:18.000734 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 24 05:14:18.000734 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 05:14:18.000734 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Sep 24 05:14:18.000734 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Sep 24 05:14:18.000734 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 24 05:14:18.000734 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 24 05:14:18.000734 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 293, in get_by_volume_and_instance Sep 24 05:14:18.000734 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Sep 24 05:14:18.000734 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id e5c6afc9-9f1a-4e9c-9f68-d6b4af6844a8. Sep 24 05:14:18.000734 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi Sep 24 05:14:18.000734 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 05:14:18.000734 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi Sep 24 05:14:18.000734 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 05:14:18.000734 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 05:14:18.000734 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 05:14:18.000734 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 24 05:14:18.000734 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 24 05:14:18.000734 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 24 05:14:18.001988 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 24 05:14:18.001988 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Sep 24 05:14:18.001988 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Sep 24 05:14:18.001988 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c8dc693a-12ca-40a8-8ce8-4f5cb342fb8f is not attached to volume e5c6afc9-9f1a-4e9c-9f68-d6b4af6844a8 Sep 24 05:14:18.001988 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi Sep 24 05:14:18.001988 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 05:14:18.001988 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi Sep 24 05:14:18.001988 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 05:14:18.001988 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 05:14:18.001988 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 05:14:18.001988 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 24 05:14:18.001988 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 24 05:14:18.001988 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c8dc693a-12ca-40a8-8ce8-4f5cb342fb8f is not attached to volume e5c6afc9-9f1a-4e9c-9f68-d6b4af6844a8 Sep 24 05:14:18.001988 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi Sep 24 05:14:18.004255 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-02bb6a1b-d4b0-4688-8436-ba005ff296eb tempest-TestMinimumBasicScenario-2093795776 tempest-TestMinimumBasicScenario-2093795776-project] Returning 404 to user: Instance c8dc693a-12ca-40a8-8ce8-4f5cb342fb8f is not attached to volume e5c6afc9-9f1a-4e9c-9f68-d6b4af6844a8 {{(pid=120593) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 24 05:14:18.006793 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-02bb6a1b-d4b0-4688-8436-ba005ff296eb tempest-TestMinimumBasicScenario-2093795776 tempest-TestMinimumBasicScenario-2093795776-project] 10.222.0.50 "DELETE /compute/v2.1/servers/c8dc693a-12ca-40a8-8ce8-4f5cb342fb8f/os-volume_attachments/e5c6afc9-9f1a-4e9c-9f68-d6b4af6844a8" status: 404 len: 154 microversion: 2.1 time: 0.161317 Sep 24 05:14:18.009402 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 620/1267] 10.222.0.50 () {58 vars in 1416 bytes} [Sat Sep 24 05:14:17 2022] DELETE /compute/v2.1/servers/c8dc693a-12ca-40a8-8ce8-4f5cb342fb8f/os-volume_attachments/e5c6afc9-9f1a-4e9c-9f68-d6b4af6844a8 => generated 154 bytes in 165 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 24 05:14:18.483582 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-19134543-2035-4787-9630-44776e160648 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Calling method '>' {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:14:18.484183 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.compute.api [None req-19134543-2035-4787-9630-44776e160648 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] [instance: 87b5a30a-8b76-44d0-a014-23e753d0835f] Fetching instance by UUID {{(pid=120594) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:14:18.490469 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-19134543-2035-4787-9630-44776e160648 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:14:18.490955 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-19134543-2035-4787-9630-44776e160648 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:14:18.491395 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-19134543-2035-4787-9630-44776e160648 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:14:18.492082 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-19134543-2035-4787-9630-44776e160648 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:14:18.492543 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-19134543-2035-4787-9630-44776e160648 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:14:18.492968 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-19134543-2035-4787-9630-44776e160648 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:14:18.506500 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: INFO nova.api.openstack.wsgi [None req-19134543-2035-4787-9630-44776e160648 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] HTTP exception thrown: Instance 87b5a30a-8b76-44d0-a014-23e753d0835f could not be found. Sep 24 05:14:18.508259 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-19134543-2035-4787-9630-44776e160648 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Request method failure captured: Sep 24 05:14:18.508259 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: request: DELETE /compute/v2.1/servers/87b5a30a-8b76-44d0-a014-23e753d0835f HTTP/1.1 Sep 24 05:14:18.508259 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: Accept: application/json Sep 24 05:14:18.508259 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: Accept-Encoding: identity Sep 24 05:14:18.508259 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: Connection: close Sep 24 05:14:18.508259 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: Content-Length: 0 Sep 24 05:14:18.508259 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: Content-Type: application/json Sep 24 05:14:18.508259 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: Host: 10.222.0.50 Sep 24 05:14:18.508259 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: Openstack-System-Scope: None Sep 24 05:14:18.508259 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: User-Agent: python-urllib3/1.26.12 Sep 24 05:14:18.508259 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: X-Auth-Token: gAAAAABjLo8KJCPvHtvWyKaOwXAaewqfKJp-c56tHrqhjOY7vtWfARY07rjbw-W3QgTA2kDEaQgMq3ex8QYwhqyDv3WoWsnpjVPsFiqcb7HeDBvc5PhwgKBF3RB3Cu-UrcKVmBtV6eiqI3YpZ_J_-BmGo2bP4YmrVUCEd9XZC45eF-x5INM7y8Q Sep 24 05:14:18.508259 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: X-Domain-Id: None Sep 24 05:14:18.508259 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: X-Domain-Name: None Sep 24 05:14:18.508259 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: X-Identity-Status: Confirmed Sep 24 05:14:18.508259 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: X-Is-Admin-Project: True Sep 24 05:14:18.508259 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: X-Project-Domain-Id: default Sep 24 05:14:18.508259 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: X-Project-Domain-Name: Default Sep 24 05:14:18.508259 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: X-Project-Id: 87d5229e39fe4817b5187068d8acecc7 Sep 24 05:14:18.508259 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: X-Project-Name: tempest-AttachVolumeNegativeTest-993993432 Sep 24 05:14:18.508259 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: X-Role: member,reader Sep 24 05:14:18.508259 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: X-Roles: member,reader Sep 24 05:14:18.510462 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/87d5229e39fe4817b5187068d8acecc7"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/87d5229e39fe4817b5187068d8acecc7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/87d5229e39fe4817b5187068d8acecc7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.50:8080", "publicURL": "http://10.222.0.50:8080/v1/AUTH_87d5229e39fe4817b5187068d8acecc7"}]}] Sep 24 05:14:18.510462 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: X-Tenant: tempest-AttachVolumeNegativeTest-993993432 Sep 24 05:14:18.510462 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: X-Tenant-Id: 87d5229e39fe4817b5187068d8acecc7 Sep 24 05:14:18.510462 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-993993432 Sep 24 05:14:18.510462 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: X-User: tempest-AttachVolumeNegativeTest-993993432-project Sep 24 05:14:18.510462 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: X-User-Domain-Id: default Sep 24 05:14:18.510462 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: X-User-Domain-Name: Default Sep 24 05:14:18.510462 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: X-User-Id: 74a8cc19ab204424ab23c62915ac2bab Sep 24 05:14:18.510462 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: X-User-Name: tempest-AttachVolumeNegativeTest-993993432-project Sep 24 05:14:18.510462 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: method: > Sep 24 05:14:18.510462 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: exception: Instance 87b5a30a-8b76-44d0-a014-23e753d0835f could not be found. Sep 24 05:14:18.510462 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: action_args: {'id': '87b5a30a-8b76-44d0-a014-23e753d0835f'} Sep 24 05:14:18.511358 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 24 05:14:18.511358 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 05:14:18.511358 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 24 05:14:18.511358 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 24 05:14:18.511358 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 24 05:14:18.511358 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 24 05:14:18.511358 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 24 05:14:18.511358 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 24 05:14:18.511358 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 24 05:14:18.511358 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 24 05:14:18.511358 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 87b5a30a-8b76-44d0-a014-23e753d0835f could not be found. Sep 24 05:14:18.511358 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi Sep 24 05:14:18.511358 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 05:14:18.511358 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi Sep 24 05:14:18.511358 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 05:14:18.511358 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 05:14:18.511358 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 05:14:18.511358 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 24 05:14:18.511358 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 24 05:14:18.511358 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 24 05:14:18.512893 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 24 05:14:18.512893 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 24 05:14:18.512893 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 24 05:14:18.512893 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 24 05:14:18.512893 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 24 05:14:18.512893 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 24 05:14:18.512893 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 24 05:14:18.512893 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 24 05:14:18.512893 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 24 05:14:18.512893 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 87b5a30a-8b76-44d0-a014-23e753d0835f could not be found. Sep 24 05:14:18.512893 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi Sep 24 05:14:18.512893 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 05:14:18.512893 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi Sep 24 05:14:18.512893 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 05:14:18.512893 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 05:14:18.512893 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 05:14:18.512893 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 24 05:14:18.512893 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 24 05:14:18.512893 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 87b5a30a-8b76-44d0-a014-23e753d0835f could not be found. Sep 24 05:14:18.512893 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi Sep 24 05:14:18.514457 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-19134543-2035-4787-9630-44776e160648 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Returning 404 to user: Instance 87b5a30a-8b76-44d0-a014-23e753d0835f could not be found. {{(pid=120594) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 24 05:14:18.514457 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [None req-19134543-2035-4787-9630-44776e160648 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] 10.222.0.50 "DELETE /compute/v2.1/servers/87b5a30a-8b76-44d0-a014-23e753d0835f" status: 404 len: 111 microversion: 2.1 time: 0.031064 Sep 24 05:14:18.514457 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 648/1268] 10.222.0.50 () {58 vars in 1239 bytes} [Sat Sep 24 05:14:18 2022] DELETE /compute/v2.1/servers/87b5a30a-8b76-44d0-a014-23e753d0835f => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 24 05:14:18.523074 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-d5393176-d5c4-43b4-a3bd-b8377479de80 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Calling method '>' {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:14:18.523845 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.compute.api [None req-d5393176-d5c4-43b4-a3bd-b8377479de80 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] [instance: 87b5a30a-8b76-44d0-a014-23e753d0835f] Fetching instance by UUID {{(pid=120593) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:14:18.532008 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-d5393176-d5c4-43b4-a3bd-b8377479de80 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:14:18.532569 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-d5393176-d5c4-43b4-a3bd-b8377479de80 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:14:18.533083 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-d5393176-d5c4-43b4-a3bd-b8377479de80 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:14:18.534102 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-d5393176-d5c4-43b4-a3bd-b8377479de80 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:14:18.535093 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-d5393176-d5c4-43b4-a3bd-b8377479de80 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:14:18.535821 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-d5393176-d5c4-43b4-a3bd-b8377479de80 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:14:18.549625 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.wsgi [None req-d5393176-d5c4-43b4-a3bd-b8377479de80 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] HTTP exception thrown: Instance 87b5a30a-8b76-44d0-a014-23e753d0835f could not be found. Sep 24 05:14:18.551248 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-d5393176-d5c4-43b4-a3bd-b8377479de80 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Request method failure captured: Sep 24 05:14:18.551248 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: request: GET /compute/v2.1/servers/87b5a30a-8b76-44d0-a014-23e753d0835f HTTP/1.1 Sep 24 05:14:18.551248 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: Accept: application/json Sep 24 05:14:18.551248 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: Accept-Encoding: identity Sep 24 05:14:18.551248 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: Connection: close Sep 24 05:14:18.551248 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: Content-Length: 0 Sep 24 05:14:18.551248 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: Content-Type: application/json Sep 24 05:14:18.551248 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: Host: 10.222.0.50 Sep 24 05:14:18.551248 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: Openstack-System-Scope: None Sep 24 05:14:18.551248 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: User-Agent: python-urllib3/1.26.12 Sep 24 05:14:18.551248 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: X-Auth-Token: gAAAAABjLo8KJCPvHtvWyKaOwXAaewqfKJp-c56tHrqhjOY7vtWfARY07rjbw-W3QgTA2kDEaQgMq3ex8QYwhqyDv3WoWsnpjVPsFiqcb7HeDBvc5PhwgKBF3RB3Cu-UrcKVmBtV6eiqI3YpZ_J_-BmGo2bP4YmrVUCEd9XZC45eF-x5INM7y8Q Sep 24 05:14:18.551248 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: X-Domain-Id: None Sep 24 05:14:18.551248 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: X-Domain-Name: None Sep 24 05:14:18.551248 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: X-Identity-Status: Confirmed Sep 24 05:14:18.551248 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: X-Is-Admin-Project: True Sep 24 05:14:18.551248 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: X-Project-Domain-Id: default Sep 24 05:14:18.551248 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: X-Project-Domain-Name: Default Sep 24 05:14:18.551248 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: X-Project-Id: 87d5229e39fe4817b5187068d8acecc7 Sep 24 05:14:18.551248 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: X-Project-Name: tempest-AttachVolumeNegativeTest-993993432 Sep 24 05:14:18.551248 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: X-Role: member,reader Sep 24 05:14:18.551248 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: X-Roles: member,reader Sep 24 05:14:18.552898 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/87d5229e39fe4817b5187068d8acecc7"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/87d5229e39fe4817b5187068d8acecc7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/87d5229e39fe4817b5187068d8acecc7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.50:8080", "publicURL": "http://10.222.0.50:8080/v1/AUTH_87d5229e39fe4817b5187068d8acecc7"}]}] Sep 24 05:14:18.552898 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: X-Tenant: tempest-AttachVolumeNegativeTest-993993432 Sep 24 05:14:18.552898 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: X-Tenant-Id: 87d5229e39fe4817b5187068d8acecc7 Sep 24 05:14:18.552898 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-993993432 Sep 24 05:14:18.552898 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: X-User: tempest-AttachVolumeNegativeTest-993993432-project Sep 24 05:14:18.552898 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: X-User-Domain-Id: default Sep 24 05:14:18.552898 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: X-User-Domain-Name: Default Sep 24 05:14:18.552898 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: X-User-Id: 74a8cc19ab204424ab23c62915ac2bab Sep 24 05:14:18.552898 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: X-User-Name: tempest-AttachVolumeNegativeTest-993993432-project Sep 24 05:14:18.552898 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: method: > Sep 24 05:14:18.552898 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: exception: Instance 87b5a30a-8b76-44d0-a014-23e753d0835f could not be found. Sep 24 05:14:18.552898 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: action_args: {'id': '87b5a30a-8b76-44d0-a014-23e753d0835f'} Sep 24 05:14:18.553785 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 24 05:14:18.553785 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 05:14:18.553785 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 24 05:14:18.553785 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 24 05:14:18.553785 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 24 05:14:18.553785 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 24 05:14:18.553785 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 24 05:14:18.553785 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 24 05:14:18.553785 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 24 05:14:18.553785 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 24 05:14:18.553785 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 87b5a30a-8b76-44d0-a014-23e753d0835f could not be found. Sep 24 05:14:18.553785 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi Sep 24 05:14:18.553785 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 05:14:18.553785 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi Sep 24 05:14:18.553785 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 05:14:18.553785 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 05:14:18.553785 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 05:14:18.553785 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 24 05:14:18.553785 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 24 05:14:18.553785 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 24 05:14:18.555316 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 24 05:14:18.555316 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 24 05:14:18.555316 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 24 05:14:18.555316 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 24 05:14:18.555316 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 24 05:14:18.555316 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 24 05:14:18.555316 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 24 05:14:18.555316 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 87b5a30a-8b76-44d0-a014-23e753d0835f could not be found. Sep 24 05:14:18.555316 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi Sep 24 05:14:18.555316 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 05:14:18.555316 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi Sep 24 05:14:18.555316 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 05:14:18.555316 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 05:14:18.555316 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 05:14:18.555316 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 24 05:14:18.555316 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 24 05:14:18.555316 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 87b5a30a-8b76-44d0-a014-23e753d0835f could not be found. Sep 24 05:14:18.555316 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi Sep 24 05:14:18.556678 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-d5393176-d5c4-43b4-a3bd-b8377479de80 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Returning 404 to user: Instance 87b5a30a-8b76-44d0-a014-23e753d0835f could not be found. {{(pid=120593) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 24 05:14:18.556678 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-d5393176-d5c4-43b4-a3bd-b8377479de80 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] 10.222.0.50 "GET /compute/v2.1/servers/87b5a30a-8b76-44d0-a014-23e753d0835f" status: 404 len: 111 microversion: 2.1 time: 0.034657 Sep 24 05:14:18.556678 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 621/1269] 10.222.0.50 () {58 vars in 1236 bytes} [Sat Sep 24 05:14:18 2022] GET /compute/v2.1/servers/87b5a30a-8b76-44d0-a014-23e753d0835f => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 24 05:14:18.561232 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-4a325974-9300-4a89-8b29-4b02a61582ea tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Calling method '>' {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:14:18.561910 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.compute.api [None req-4a325974-9300-4a89-8b29-4b02a61582ea tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] [instance: 34b2ef46-4969-469b-adcd-22abf7c4d6df] Fetching instance by UUID {{(pid=120594) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:14:18.567862 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-4a325974-9300-4a89-8b29-4b02a61582ea tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:14:18.568350 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-4a325974-9300-4a89-8b29-4b02a61582ea tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:14:18.568787 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-4a325974-9300-4a89-8b29-4b02a61582ea tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:14:18.569481 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-4a325974-9300-4a89-8b29-4b02a61582ea tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:14:18.569934 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-4a325974-9300-4a89-8b29-4b02a61582ea tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:14:18.570391 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-4a325974-9300-4a89-8b29-4b02a61582ea tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:14:18.584993 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: INFO nova.api.openstack.wsgi [None req-4a325974-9300-4a89-8b29-4b02a61582ea tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] HTTP exception thrown: Instance 34b2ef46-4969-469b-adcd-22abf7c4d6df could not be found. Sep 24 05:14:18.586560 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-4a325974-9300-4a89-8b29-4b02a61582ea tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Request method failure captured: Sep 24 05:14:18.586560 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: request: DELETE /compute/v2.1/servers/34b2ef46-4969-469b-adcd-22abf7c4d6df HTTP/1.1 Sep 24 05:14:18.586560 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: Accept: application/json Sep 24 05:14:18.586560 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: Accept-Encoding: identity Sep 24 05:14:18.586560 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: Connection: close Sep 24 05:14:18.586560 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: Content-Length: 0 Sep 24 05:14:18.586560 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: Content-Type: application/json Sep 24 05:14:18.586560 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: Host: 10.222.0.50 Sep 24 05:14:18.586560 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: Openstack-System-Scope: None Sep 24 05:14:18.586560 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: User-Agent: python-urllib3/1.26.12 Sep 24 05:14:18.586560 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: X-Auth-Token: gAAAAABjLo8KJCPvHtvWyKaOwXAaewqfKJp-c56tHrqhjOY7vtWfARY07rjbw-W3QgTA2kDEaQgMq3ex8QYwhqyDv3WoWsnpjVPsFiqcb7HeDBvc5PhwgKBF3RB3Cu-UrcKVmBtV6eiqI3YpZ_J_-BmGo2bP4YmrVUCEd9XZC45eF-x5INM7y8Q Sep 24 05:14:18.586560 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: X-Domain-Id: None Sep 24 05:14:18.586560 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: X-Domain-Name: None Sep 24 05:14:18.586560 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: X-Identity-Status: Confirmed Sep 24 05:14:18.586560 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: X-Is-Admin-Project: True Sep 24 05:14:18.586560 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: X-Project-Domain-Id: default Sep 24 05:14:18.586560 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: X-Project-Domain-Name: Default Sep 24 05:14:18.586560 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: X-Project-Id: 87d5229e39fe4817b5187068d8acecc7 Sep 24 05:14:18.586560 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: X-Project-Name: tempest-AttachVolumeNegativeTest-993993432 Sep 24 05:14:18.586560 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: X-Role: member,reader Sep 24 05:14:18.586560 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: X-Roles: member,reader Sep 24 05:14:18.588206 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/87d5229e39fe4817b5187068d8acecc7"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/87d5229e39fe4817b5187068d8acecc7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/87d5229e39fe4817b5187068d8acecc7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.50:8080", "publicURL": "http://10.222.0.50:8080/v1/AUTH_87d5229e39fe4817b5187068d8acecc7"}]}] Sep 24 05:14:18.588206 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: X-Tenant: tempest-AttachVolumeNegativeTest-993993432 Sep 24 05:14:18.588206 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: X-Tenant-Id: 87d5229e39fe4817b5187068d8acecc7 Sep 24 05:14:18.588206 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-993993432 Sep 24 05:14:18.588206 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: X-User: tempest-AttachVolumeNegativeTest-993993432-project Sep 24 05:14:18.588206 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: X-User-Domain-Id: default Sep 24 05:14:18.588206 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: X-User-Domain-Name: Default Sep 24 05:14:18.588206 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: X-User-Id: 74a8cc19ab204424ab23c62915ac2bab Sep 24 05:14:18.588206 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: X-User-Name: tempest-AttachVolumeNegativeTest-993993432-project Sep 24 05:14:18.588206 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: method: > Sep 24 05:14:18.588206 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: exception: Instance 34b2ef46-4969-469b-adcd-22abf7c4d6df could not be found. Sep 24 05:14:18.588206 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: action_args: {'id': '34b2ef46-4969-469b-adcd-22abf7c4d6df'} Sep 24 05:14:18.589689 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 24 05:14:18.589689 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 05:14:18.589689 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 24 05:14:18.589689 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 24 05:14:18.589689 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 24 05:14:18.589689 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 24 05:14:18.589689 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 24 05:14:18.589689 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 24 05:14:18.589689 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 24 05:14:18.589689 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 24 05:14:18.589689 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 34b2ef46-4969-469b-adcd-22abf7c4d6df could not be found. Sep 24 05:14:18.589689 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi Sep 24 05:14:18.589689 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 05:14:18.589689 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi Sep 24 05:14:18.589689 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 05:14:18.589689 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 05:14:18.589689 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 05:14:18.589689 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 24 05:14:18.589689 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 24 05:14:18.589689 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 24 05:14:18.591294 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 24 05:14:18.591294 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 24 05:14:18.591294 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 24 05:14:18.591294 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 24 05:14:18.591294 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 24 05:14:18.591294 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 24 05:14:18.591294 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 24 05:14:18.591294 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 24 05:14:18.591294 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 24 05:14:18.591294 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 34b2ef46-4969-469b-adcd-22abf7c4d6df could not be found. Sep 24 05:14:18.591294 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi Sep 24 05:14:18.591294 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 05:14:18.591294 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi Sep 24 05:14:18.591294 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 05:14:18.591294 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 05:14:18.591294 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 05:14:18.591294 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 24 05:14:18.591294 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 24 05:14:18.591294 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 34b2ef46-4969-469b-adcd-22abf7c4d6df could not be found. Sep 24 05:14:18.591294 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi Sep 24 05:14:18.592851 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-4a325974-9300-4a89-8b29-4b02a61582ea tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Returning 404 to user: Instance 34b2ef46-4969-469b-adcd-22abf7c4d6df could not be found. {{(pid=120594) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 24 05:14:18.592851 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [None req-4a325974-9300-4a89-8b29-4b02a61582ea tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] 10.222.0.50 "DELETE /compute/v2.1/servers/34b2ef46-4969-469b-adcd-22abf7c4d6df" status: 404 len: 111 microversion: 2.1 time: 0.030548 Sep 24 05:14:18.592851 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 649/1270] 10.222.0.50 () {58 vars in 1239 bytes} [Sat Sep 24 05:14:18 2022] DELETE /compute/v2.1/servers/34b2ef46-4969-469b-adcd-22abf7c4d6df => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 24 05:14:18.596855 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-ad77c594-345b-420c-b5d5-8f83e947ad85 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Calling method '>' {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:14:18.597467 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.compute.api [None req-ad77c594-345b-420c-b5d5-8f83e947ad85 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] [instance: 34b2ef46-4969-469b-adcd-22abf7c4d6df] Fetching instance by UUID {{(pid=120593) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:14:18.603972 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-ad77c594-345b-420c-b5d5-8f83e947ad85 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:14:18.604506 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-ad77c594-345b-420c-b5d5-8f83e947ad85 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:14:18.604948 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-ad77c594-345b-420c-b5d5-8f83e947ad85 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:14:18.605637 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-ad77c594-345b-420c-b5d5-8f83e947ad85 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:14:18.606178 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-ad77c594-345b-420c-b5d5-8f83e947ad85 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:14:18.606543 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-ad77c594-345b-420c-b5d5-8f83e947ad85 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:14:18.622626 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.wsgi [None req-ad77c594-345b-420c-b5d5-8f83e947ad85 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] HTTP exception thrown: Instance 34b2ef46-4969-469b-adcd-22abf7c4d6df could not be found. Sep 24 05:14:18.624153 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-ad77c594-345b-420c-b5d5-8f83e947ad85 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Request method failure captured: Sep 24 05:14:18.624153 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: request: GET /compute/v2.1/servers/34b2ef46-4969-469b-adcd-22abf7c4d6df HTTP/1.1 Sep 24 05:14:18.624153 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: Accept: application/json Sep 24 05:14:18.624153 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: Accept-Encoding: identity Sep 24 05:14:18.624153 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: Connection: close Sep 24 05:14:18.624153 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: Content-Length: 0 Sep 24 05:14:18.624153 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: Content-Type: application/json Sep 24 05:14:18.624153 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: Host: 10.222.0.50 Sep 24 05:14:18.624153 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: Openstack-System-Scope: None Sep 24 05:14:18.624153 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: User-Agent: python-urllib3/1.26.12 Sep 24 05:14:18.624153 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: X-Auth-Token: gAAAAABjLo8KJCPvHtvWyKaOwXAaewqfKJp-c56tHrqhjOY7vtWfARY07rjbw-W3QgTA2kDEaQgMq3ex8QYwhqyDv3WoWsnpjVPsFiqcb7HeDBvc5PhwgKBF3RB3Cu-UrcKVmBtV6eiqI3YpZ_J_-BmGo2bP4YmrVUCEd9XZC45eF-x5INM7y8Q Sep 24 05:14:18.624153 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: X-Domain-Id: None Sep 24 05:14:18.624153 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: X-Domain-Name: None Sep 24 05:14:18.624153 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: X-Identity-Status: Confirmed Sep 24 05:14:18.624153 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: X-Is-Admin-Project: True Sep 24 05:14:18.624153 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: X-Project-Domain-Id: default Sep 24 05:14:18.624153 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: X-Project-Domain-Name: Default Sep 24 05:14:18.624153 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: X-Project-Id: 87d5229e39fe4817b5187068d8acecc7 Sep 24 05:14:18.624153 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: X-Project-Name: tempest-AttachVolumeNegativeTest-993993432 Sep 24 05:14:18.624153 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: X-Role: member,reader Sep 24 05:14:18.624153 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: X-Roles: member,reader Sep 24 05:14:18.625832 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/87d5229e39fe4817b5187068d8acecc7"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/87d5229e39fe4817b5187068d8acecc7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/87d5229e39fe4817b5187068d8acecc7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.50:8080", "publicURL": "http://10.222.0.50:8080/v1/AUTH_87d5229e39fe4817b5187068d8acecc7"}]}] Sep 24 05:14:18.625832 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: X-Tenant: tempest-AttachVolumeNegativeTest-993993432 Sep 24 05:14:18.625832 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: X-Tenant-Id: 87d5229e39fe4817b5187068d8acecc7 Sep 24 05:14:18.625832 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-993993432 Sep 24 05:14:18.625832 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: X-User: tempest-AttachVolumeNegativeTest-993993432-project Sep 24 05:14:18.625832 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: X-User-Domain-Id: default Sep 24 05:14:18.625832 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: X-User-Domain-Name: Default Sep 24 05:14:18.625832 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: X-User-Id: 74a8cc19ab204424ab23c62915ac2bab Sep 24 05:14:18.625832 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: X-User-Name: tempest-AttachVolumeNegativeTest-993993432-project Sep 24 05:14:18.625832 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: method: > Sep 24 05:14:18.625832 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: exception: Instance 34b2ef46-4969-469b-adcd-22abf7c4d6df could not be found. Sep 24 05:14:18.625832 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: action_args: {'id': '34b2ef46-4969-469b-adcd-22abf7c4d6df'} Sep 24 05:14:18.626855 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 24 05:14:18.626855 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 05:14:18.626855 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 24 05:14:18.626855 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 24 05:14:18.626855 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 24 05:14:18.626855 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 24 05:14:18.626855 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 24 05:14:18.626855 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 24 05:14:18.626855 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 24 05:14:18.626855 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 24 05:14:18.626855 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 34b2ef46-4969-469b-adcd-22abf7c4d6df could not be found. Sep 24 05:14:18.626855 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi Sep 24 05:14:18.626855 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 05:14:18.626855 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi Sep 24 05:14:18.626855 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 05:14:18.626855 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 05:14:18.626855 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 05:14:18.626855 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 24 05:14:18.626855 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 24 05:14:18.626855 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 24 05:14:18.628287 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 24 05:14:18.628287 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 24 05:14:18.628287 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 24 05:14:18.628287 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 24 05:14:18.628287 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 24 05:14:18.628287 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 24 05:14:18.628287 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 24 05:14:18.628287 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 34b2ef46-4969-469b-adcd-22abf7c4d6df could not be found. Sep 24 05:14:18.628287 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi Sep 24 05:14:18.628287 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 05:14:18.628287 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi Sep 24 05:14:18.628287 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 05:14:18.628287 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 05:14:18.628287 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 05:14:18.628287 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 24 05:14:18.628287 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 24 05:14:18.628287 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 34b2ef46-4969-469b-adcd-22abf7c4d6df could not be found. Sep 24 05:14:18.628287 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi Sep 24 05:14:18.629512 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-ad77c594-345b-420c-b5d5-8f83e947ad85 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Returning 404 to user: Instance 34b2ef46-4969-469b-adcd-22abf7c4d6df could not be found. {{(pid=120593) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 24 05:14:18.629512 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-ad77c594-345b-420c-b5d5-8f83e947ad85 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] 10.222.0.50 "GET /compute/v2.1/servers/34b2ef46-4969-469b-adcd-22abf7c4d6df" status: 404 len: 111 microversion: 2.1 time: 0.032549 Sep 24 05:14:18.629512 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 622/1271] 10.222.0.50 () {58 vars in 1236 bytes} [Sat Sep 24 05:14:18 2022] GET /compute/v2.1/servers/34b2ef46-4969-469b-adcd-22abf7c4d6df => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 24 05:14:18.783495 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-26f05701-164d-4097-b74d-dfbb66d68dd8 tempest-TestVolumeBootPattern-1339481357 tempest-TestVolumeBootPattern-1339481357-project] Calling method '>' {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:14:18.784314 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.compute.api [None req-26f05701-164d-4097-b74d-dfbb66d68dd8 tempest-TestVolumeBootPattern-1339481357 tempest-TestVolumeBootPattern-1339481357-project] [instance: af77c184-6aa4-4f31-b736-bf19ec7c1482] Fetching instance by UUID {{(pid=120594) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:14:18.790155 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-26f05701-164d-4097-b74d-dfbb66d68dd8 tempest-TestVolumeBootPattern-1339481357 tempest-TestVolumeBootPattern-1339481357-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:14:18.790676 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-26f05701-164d-4097-b74d-dfbb66d68dd8 tempest-TestVolumeBootPattern-1339481357 tempest-TestVolumeBootPattern-1339481357-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:14:18.791118 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-26f05701-164d-4097-b74d-dfbb66d68dd8 tempest-TestVolumeBootPattern-1339481357 tempest-TestVolumeBootPattern-1339481357-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:14:18.791805 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-26f05701-164d-4097-b74d-dfbb66d68dd8 tempest-TestVolumeBootPattern-1339481357 tempest-TestVolumeBootPattern-1339481357-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:14:18.792258 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-26f05701-164d-4097-b74d-dfbb66d68dd8 tempest-TestVolumeBootPattern-1339481357 tempest-TestVolumeBootPattern-1339481357-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:14:18.792677 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-26f05701-164d-4097-b74d-dfbb66d68dd8 tempest-TestVolumeBootPattern-1339481357 tempest-TestVolumeBootPattern-1339481357-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:14:19.161847 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-f4b2af13-6278-4a33-a671-bf148c04147c tempest-TestMinimumBasicScenario-2093795776 tempest-TestMinimumBasicScenario-2093795776-project] Calling method '>' {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:14:19.162376 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.compute.api [None req-f4b2af13-6278-4a33-a671-bf148c04147c tempest-TestMinimumBasicScenario-2093795776 tempest-TestMinimumBasicScenario-2093795776-project] [instance: c8dc693a-12ca-40a8-8ce8-4f5cb342fb8f] Fetching instance by UUID {{(pid=120593) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:14:19.168600 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-f4b2af13-6278-4a33-a671-bf148c04147c tempest-TestMinimumBasicScenario-2093795776 tempest-TestMinimumBasicScenario-2093795776-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:14:19.169363 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-f4b2af13-6278-4a33-a671-bf148c04147c tempest-TestMinimumBasicScenario-2093795776 tempest-TestMinimumBasicScenario-2093795776-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:14:19.169829 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-f4b2af13-6278-4a33-a671-bf148c04147c tempest-TestMinimumBasicScenario-2093795776 tempest-TestMinimumBasicScenario-2093795776-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:14:19.170570 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-f4b2af13-6278-4a33-a671-bf148c04147c tempest-TestMinimumBasicScenario-2093795776 tempest-TestMinimumBasicScenario-2093795776-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:14:19.171016 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-f4b2af13-6278-4a33-a671-bf148c04147c tempest-TestMinimumBasicScenario-2093795776 tempest-TestMinimumBasicScenario-2093795776-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:14:19.171128 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.policy [None req-26f05701-164d-4097-b74d-dfbb66d68dd8 tempest-TestVolumeBootPattern-1339481357 tempest-TestVolumeBootPattern-1339481357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60edcebcccaa4da99ffddadd3e27c1c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fef19544ec414094953daea6d545a361', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:14:19.171434 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-f4b2af13-6278-4a33-a671-bf148c04147c tempest-TestMinimumBasicScenario-2093795776 tempest-TestMinimumBasicScenario-2093795776-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:14:19.181920 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [None req-26f05701-164d-4097-b74d-dfbb66d68dd8 tempest-TestVolumeBootPattern-1339481357 tempest-TestVolumeBootPattern-1339481357-project] 10.222.0.50 "GET /compute/v2.1/servers/af77c184-6aa4-4f31-b736-bf19ec7c1482" status: 200 len: 1265 microversion: 2.1 time: 0.401983 Sep 24 05:14:19.182620 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 650/1272] 10.222.0.50 () {58 vars in 1236 bytes} [Sat Sep 24 05:14:18 2022] GET /compute/v2.1/servers/af77c184-6aa4-4f31-b736-bf19ec7c1482 => generated 1265 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 05:14:19.197665 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.compute.api [None req-f4b2af13-6278-4a33-a671-bf148c04147c tempest-TestMinimumBasicScenario-2093795776 tempest-TestMinimumBasicScenario-2093795776-project] [instance: c8dc693a-12ca-40a8-8ce8-4f5cb342fb8f] Going to try to terminate instance {{(pid=120593) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 24 05:14:19.287988 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-f4b2af13-6278-4a33-a671-bf148c04147c tempest-TestMinimumBasicScenario-2093795776 tempest-TestMinimumBasicScenario-2093795776-project] 10.222.0.50 "DELETE /compute/v2.1/servers/c8dc693a-12ca-40a8-8ce8-4f5cb342fb8f" status: 204 len: 0 microversion: 2.1 time: 0.129663 Sep 24 05:14:19.288566 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 623/1273] 10.222.0.50 () {58 vars in 1239 bytes} [Sat Sep 24 05:14:19 2022] DELETE /compute/v2.1/servers/c8dc693a-12ca-40a8-8ce8-4f5cb342fb8f => generated 0 bytes in 131 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Sep 24 05:14:19.297822 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-82f3b622-e356-41cc-8583-445a97a313ef tempest-TestMinimumBasicScenario-2093795776 tempest-TestMinimumBasicScenario-2093795776-project] Calling method '>' {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:14:19.298634 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.compute.api [None req-82f3b622-e356-41cc-8583-445a97a313ef tempest-TestMinimumBasicScenario-2093795776 tempest-TestMinimumBasicScenario-2093795776-project] [instance: c8dc693a-12ca-40a8-8ce8-4f5cb342fb8f] Fetching instance by UUID {{(pid=120594) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:14:19.304790 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-82f3b622-e356-41cc-8583-445a97a313ef tempest-TestMinimumBasicScenario-2093795776 tempest-TestMinimumBasicScenario-2093795776-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:14:19.305346 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-82f3b622-e356-41cc-8583-445a97a313ef tempest-TestMinimumBasicScenario-2093795776 tempest-TestMinimumBasicScenario-2093795776-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:14:19.305858 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-82f3b622-e356-41cc-8583-445a97a313ef tempest-TestMinimumBasicScenario-2093795776 tempest-TestMinimumBasicScenario-2093795776-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:14:19.307455 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-82f3b622-e356-41cc-8583-445a97a313ef tempest-TestMinimumBasicScenario-2093795776 tempest-TestMinimumBasicScenario-2093795776-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:14:19.307912 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-82f3b622-e356-41cc-8583-445a97a313ef tempest-TestMinimumBasicScenario-2093795776 tempest-TestMinimumBasicScenario-2093795776-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:14:19.308380 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-82f3b622-e356-41cc-8583-445a97a313ef tempest-TestMinimumBasicScenario-2093795776 tempest-TestMinimumBasicScenario-2093795776-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:14:19.447543 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.policy [None req-82f3b622-e356-41cc-8583-445a97a313ef tempest-TestMinimumBasicScenario-2093795776 tempest-TestMinimumBasicScenario-2093795776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f67fe549bae6447f8b24219becb3bf97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85c73f9a74da4079a54a503e0b42ca2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:14:19.455862 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [None req-82f3b622-e356-41cc-8583-445a97a313ef tempest-TestMinimumBasicScenario-2093795776 tempest-TestMinimumBasicScenario-2093795776-project] 10.222.0.50 "GET /compute/v2.1/servers/c8dc693a-12ca-40a8-8ce8-4f5cb342fb8f" status: 200 len: 1555 microversion: 2.1 time: 0.162134 Sep 24 05:14:19.456516 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 651/1274] 10.222.0.50 () {58 vars in 1236 bytes} [Sat Sep 24 05:14:19 2022] GET /compute/v2.1/servers/c8dc693a-12ca-40a8-8ce8-4f5cb342fb8f => generated 1555 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 05:14:19.771134 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-57927398-dc50-49de-9f46-b7d506810e95 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Calling method '>' {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:14:19.771724 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.compute.api [None req-57927398-dc50-49de-9f46-b7d506810e95 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] [instance: 201433d5-db4e-4e57-a800-42fe5cfc95ca] Fetching instance by UUID {{(pid=120593) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:14:19.780829 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-57927398-dc50-49de-9f46-b7d506810e95 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:14:19.781710 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-57927398-dc50-49de-9f46-b7d506810e95 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:14:19.782584 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-57927398-dc50-49de-9f46-b7d506810e95 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:14:19.783484 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-57927398-dc50-49de-9f46-b7d506810e95 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:14:19.783945 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-57927398-dc50-49de-9f46-b7d506810e95 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:14:19.784427 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-57927398-dc50-49de-9f46-b7d506810e95 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:14:19.800319 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.wsgi [None req-57927398-dc50-49de-9f46-b7d506810e95 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] HTTP exception thrown: Instance 201433d5-db4e-4e57-a800-42fe5cfc95ca could not be found. Sep 24 05:14:19.801986 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-57927398-dc50-49de-9f46-b7d506810e95 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Request method failure captured: Sep 24 05:14:19.801986 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: request: DELETE /compute/v2.1/servers/201433d5-db4e-4e57-a800-42fe5cfc95ca HTTP/1.1 Sep 24 05:14:19.801986 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: Accept: application/json Sep 24 05:14:19.801986 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: Accept-Encoding: identity Sep 24 05:14:19.801986 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: Connection: close Sep 24 05:14:19.801986 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: Content-Length: 0 Sep 24 05:14:19.801986 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: Content-Type: application/json Sep 24 05:14:19.801986 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: Host: 10.222.0.50 Sep 24 05:14:19.801986 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: Openstack-System-Scope: None Sep 24 05:14:19.801986 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: User-Agent: python-urllib3/1.26.12 Sep 24 05:14:19.801986 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: X-Auth-Token: gAAAAABjLo8KJCPvHtvWyKaOwXAaewqfKJp-c56tHrqhjOY7vtWfARY07rjbw-W3QgTA2kDEaQgMq3ex8QYwhqyDv3WoWsnpjVPsFiqcb7HeDBvc5PhwgKBF3RB3Cu-UrcKVmBtV6eiqI3YpZ_J_-BmGo2bP4YmrVUCEd9XZC45eF-x5INM7y8Q Sep 24 05:14:19.801986 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: X-Domain-Id: None Sep 24 05:14:19.801986 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: X-Domain-Name: None Sep 24 05:14:19.801986 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: X-Identity-Status: Confirmed Sep 24 05:14:19.801986 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: X-Is-Admin-Project: True Sep 24 05:14:19.801986 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: X-Project-Domain-Id: default Sep 24 05:14:19.801986 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: X-Project-Domain-Name: Default Sep 24 05:14:19.801986 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: X-Project-Id: 87d5229e39fe4817b5187068d8acecc7 Sep 24 05:14:19.801986 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: X-Project-Name: tempest-AttachVolumeNegativeTest-993993432 Sep 24 05:14:19.801986 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: X-Role: member,reader Sep 24 05:14:19.801986 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: X-Roles: member,reader Sep 24 05:14:19.803565 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/87d5229e39fe4817b5187068d8acecc7"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/87d5229e39fe4817b5187068d8acecc7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/87d5229e39fe4817b5187068d8acecc7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.50:8080", "publicURL": "http://10.222.0.50:8080/v1/AUTH_87d5229e39fe4817b5187068d8acecc7"}]}] Sep 24 05:14:19.803565 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: X-Tenant: tempest-AttachVolumeNegativeTest-993993432 Sep 24 05:14:19.803565 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: X-Tenant-Id: 87d5229e39fe4817b5187068d8acecc7 Sep 24 05:14:19.803565 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-993993432 Sep 24 05:14:19.803565 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: X-User: tempest-AttachVolumeNegativeTest-993993432-project Sep 24 05:14:19.803565 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: X-User-Domain-Id: default Sep 24 05:14:19.803565 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: X-User-Domain-Name: Default Sep 24 05:14:19.803565 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: X-User-Id: 74a8cc19ab204424ab23c62915ac2bab Sep 24 05:14:19.803565 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: X-User-Name: tempest-AttachVolumeNegativeTest-993993432-project Sep 24 05:14:19.803565 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: method: > Sep 24 05:14:19.803565 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: exception: Instance 201433d5-db4e-4e57-a800-42fe5cfc95ca could not be found. Sep 24 05:14:19.803565 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: action_args: {'id': '201433d5-db4e-4e57-a800-42fe5cfc95ca'} Sep 24 05:14:19.804492 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 24 05:14:19.804492 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 05:14:19.804492 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 24 05:14:19.804492 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 24 05:14:19.804492 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 24 05:14:19.804492 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 24 05:14:19.804492 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 24 05:14:19.804492 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 24 05:14:19.804492 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 24 05:14:19.804492 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 24 05:14:19.804492 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 201433d5-db4e-4e57-a800-42fe5cfc95ca could not be found. Sep 24 05:14:19.804492 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi Sep 24 05:14:19.804492 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 05:14:19.804492 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi Sep 24 05:14:19.804492 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 05:14:19.804492 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 05:14:19.804492 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 05:14:19.804492 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 24 05:14:19.804492 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 24 05:14:19.804492 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 24 05:14:19.806132 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 24 05:14:19.806132 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 24 05:14:19.806132 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 24 05:14:19.806132 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 24 05:14:19.806132 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 24 05:14:19.806132 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 24 05:14:19.806132 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 24 05:14:19.806132 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 24 05:14:19.806132 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 24 05:14:19.806132 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 201433d5-db4e-4e57-a800-42fe5cfc95ca could not be found. Sep 24 05:14:19.806132 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi Sep 24 05:14:19.806132 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 05:14:19.806132 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi Sep 24 05:14:19.806132 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 05:14:19.806132 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 05:14:19.806132 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 05:14:19.806132 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 24 05:14:19.806132 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 24 05:14:19.806132 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 201433d5-db4e-4e57-a800-42fe5cfc95ca could not be found. Sep 24 05:14:19.806132 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi Sep 24 05:14:19.807692 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-57927398-dc50-49de-9f46-b7d506810e95 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Returning 404 to user: Instance 201433d5-db4e-4e57-a800-42fe5cfc95ca could not be found. {{(pid=120593) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 24 05:14:19.807692 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-57927398-dc50-49de-9f46-b7d506810e95 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] 10.222.0.50 "DELETE /compute/v2.1/servers/201433d5-db4e-4e57-a800-42fe5cfc95ca" status: 404 len: 111 microversion: 2.1 time: 0.036664 Sep 24 05:14:19.807692 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 624/1275] 10.222.0.50 () {58 vars in 1239 bytes} [Sat Sep 24 05:14:19 2022] DELETE /compute/v2.1/servers/201433d5-db4e-4e57-a800-42fe5cfc95ca => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 24 05:14:19.811933 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-b7a9ac2f-ab20-48c6-b633-3e7526f67e33 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Calling method '>' {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:14:19.812545 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.compute.api [None req-b7a9ac2f-ab20-48c6-b633-3e7526f67e33 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] [instance: 201433d5-db4e-4e57-a800-42fe5cfc95ca] Fetching instance by UUID {{(pid=120594) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:14:19.818963 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-b7a9ac2f-ab20-48c6-b633-3e7526f67e33 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:14:19.819441 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-b7a9ac2f-ab20-48c6-b633-3e7526f67e33 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:14:19.819881 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-b7a9ac2f-ab20-48c6-b633-3e7526f67e33 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:14:19.820566 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-b7a9ac2f-ab20-48c6-b633-3e7526f67e33 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:14:19.821019 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-b7a9ac2f-ab20-48c6-b633-3e7526f67e33 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:14:19.821468 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-b7a9ac2f-ab20-48c6-b633-3e7526f67e33 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:14:19.834572 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: INFO nova.api.openstack.wsgi [None req-b7a9ac2f-ab20-48c6-b633-3e7526f67e33 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] HTTP exception thrown: Instance 201433d5-db4e-4e57-a800-42fe5cfc95ca could not be found. Sep 24 05:14:19.836063 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-b7a9ac2f-ab20-48c6-b633-3e7526f67e33 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Request method failure captured: Sep 24 05:14:19.836063 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: request: GET /compute/v2.1/servers/201433d5-db4e-4e57-a800-42fe5cfc95ca HTTP/1.1 Sep 24 05:14:19.836063 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: Accept: application/json Sep 24 05:14:19.836063 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: Accept-Encoding: identity Sep 24 05:14:19.836063 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: Connection: close Sep 24 05:14:19.836063 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: Content-Length: 0 Sep 24 05:14:19.836063 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: Content-Type: application/json Sep 24 05:14:19.836063 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: Host: 10.222.0.50 Sep 24 05:14:19.836063 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: Openstack-System-Scope: None Sep 24 05:14:19.836063 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: User-Agent: python-urllib3/1.26.12 Sep 24 05:14:19.836063 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: X-Auth-Token: gAAAAABjLo8KJCPvHtvWyKaOwXAaewqfKJp-c56tHrqhjOY7vtWfARY07rjbw-W3QgTA2kDEaQgMq3ex8QYwhqyDv3WoWsnpjVPsFiqcb7HeDBvc5PhwgKBF3RB3Cu-UrcKVmBtV6eiqI3YpZ_J_-BmGo2bP4YmrVUCEd9XZC45eF-x5INM7y8Q Sep 24 05:14:19.836063 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: X-Domain-Id: None Sep 24 05:14:19.836063 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: X-Domain-Name: None Sep 24 05:14:19.836063 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: X-Identity-Status: Confirmed Sep 24 05:14:19.836063 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: X-Is-Admin-Project: True Sep 24 05:14:19.836063 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: X-Project-Domain-Id: default Sep 24 05:14:19.836063 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: X-Project-Domain-Name: Default Sep 24 05:14:19.836063 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: X-Project-Id: 87d5229e39fe4817b5187068d8acecc7 Sep 24 05:14:19.836063 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: X-Project-Name: tempest-AttachVolumeNegativeTest-993993432 Sep 24 05:14:19.836063 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: X-Role: member,reader Sep 24 05:14:19.836063 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: X-Roles: member,reader Sep 24 05:14:19.838257 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/87d5229e39fe4817b5187068d8acecc7"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/87d5229e39fe4817b5187068d8acecc7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/87d5229e39fe4817b5187068d8acecc7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.50:8080", "publicURL": "http://10.222.0.50:8080/v1/AUTH_87d5229e39fe4817b5187068d8acecc7"}]}] Sep 24 05:14:19.838257 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: X-Tenant: tempest-AttachVolumeNegativeTest-993993432 Sep 24 05:14:19.838257 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: X-Tenant-Id: 87d5229e39fe4817b5187068d8acecc7 Sep 24 05:14:19.838257 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-993993432 Sep 24 05:14:19.838257 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: X-User: tempest-AttachVolumeNegativeTest-993993432-project Sep 24 05:14:19.838257 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: X-User-Domain-Id: default Sep 24 05:14:19.838257 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: X-User-Domain-Name: Default Sep 24 05:14:19.838257 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: X-User-Id: 74a8cc19ab204424ab23c62915ac2bab Sep 24 05:14:19.838257 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: X-User-Name: tempest-AttachVolumeNegativeTest-993993432-project Sep 24 05:14:19.838257 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: method: > Sep 24 05:14:19.838257 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: exception: Instance 201433d5-db4e-4e57-a800-42fe5cfc95ca could not be found. Sep 24 05:14:19.838257 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: action_args: {'id': '201433d5-db4e-4e57-a800-42fe5cfc95ca'} Sep 24 05:14:19.839323 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 24 05:14:19.839323 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 05:14:19.839323 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 24 05:14:19.839323 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 24 05:14:19.839323 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 24 05:14:19.839323 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 24 05:14:19.839323 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 24 05:14:19.839323 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 24 05:14:19.839323 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 24 05:14:19.839323 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 24 05:14:19.839323 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 201433d5-db4e-4e57-a800-42fe5cfc95ca could not be found. Sep 24 05:14:19.839323 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi Sep 24 05:14:19.839323 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 05:14:19.839323 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi Sep 24 05:14:19.839323 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 05:14:19.839323 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 05:14:19.839323 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 05:14:19.839323 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 24 05:14:19.839323 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 24 05:14:19.839323 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 24 05:14:19.840628 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 24 05:14:19.840628 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 24 05:14:19.840628 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 24 05:14:19.840628 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 24 05:14:19.840628 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 24 05:14:19.840628 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 24 05:14:19.840628 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 24 05:14:19.840628 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 201433d5-db4e-4e57-a800-42fe5cfc95ca could not be found. Sep 24 05:14:19.840628 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi Sep 24 05:14:19.840628 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 05:14:19.840628 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi Sep 24 05:14:19.840628 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 05:14:19.840628 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 05:14:19.840628 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 05:14:19.840628 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 24 05:14:19.840628 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 24 05:14:19.840628 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 201433d5-db4e-4e57-a800-42fe5cfc95ca could not be found. Sep 24 05:14:19.840628 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi Sep 24 05:14:19.841889 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-b7a9ac2f-ab20-48c6-b633-3e7526f67e33 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] Returning 404 to user: Instance 201433d5-db4e-4e57-a800-42fe5cfc95ca could not be found. {{(pid=120594) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 24 05:14:19.841889 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [None req-b7a9ac2f-ab20-48c6-b633-3e7526f67e33 tempest-AttachVolumeNegativeTest-993993432 tempest-AttachVolumeNegativeTest-993993432-project] 10.222.0.50 "GET /compute/v2.1/servers/201433d5-db4e-4e57-a800-42fe5cfc95ca" status: 404 len: 111 microversion: 2.1 time: 0.029377 Sep 24 05:14:19.841889 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 652/1276] 10.222.0.50 () {58 vars in 1236 bytes} [Sat Sep 24 05:14:19 2022] GET /compute/v2.1/servers/201433d5-db4e-4e57-a800-42fe5cfc95ca => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 24 05:14:20.205618 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-937deab0-d1b9-4530-a499-1c8759a50a86 tempest-TestVolumeBootPattern-1339481357 tempest-TestVolumeBootPattern-1339481357-project] Calling method '>' {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:14:20.206178 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.compute.api [None req-937deab0-d1b9-4530-a499-1c8759a50a86 tempest-TestVolumeBootPattern-1339481357 tempest-TestVolumeBootPattern-1339481357-project] [instance: af77c184-6aa4-4f31-b736-bf19ec7c1482] Fetching instance by UUID {{(pid=120593) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:14:20.212190 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-937deab0-d1b9-4530-a499-1c8759a50a86 tempest-TestVolumeBootPattern-1339481357 tempest-TestVolumeBootPattern-1339481357-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:14:20.212747 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-937deab0-d1b9-4530-a499-1c8759a50a86 tempest-TestVolumeBootPattern-1339481357 tempest-TestVolumeBootPattern-1339481357-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:14:20.213148 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-937deab0-d1b9-4530-a499-1c8759a50a86 tempest-TestVolumeBootPattern-1339481357 tempest-TestVolumeBootPattern-1339481357-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:14:20.213839 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-937deab0-d1b9-4530-a499-1c8759a50a86 tempest-TestVolumeBootPattern-1339481357 tempest-TestVolumeBootPattern-1339481357-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:14:20.214323 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-937deab0-d1b9-4530-a499-1c8759a50a86 tempest-TestVolumeBootPattern-1339481357 tempest-TestVolumeBootPattern-1339481357-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:14:20.214782 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-937deab0-d1b9-4530-a499-1c8759a50a86 tempest-TestVolumeBootPattern-1339481357 tempest-TestVolumeBootPattern-1339481357-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:14:20.349274 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-937deab0-d1b9-4530-a499-1c8759a50a86 tempest-TestVolumeBootPattern-1339481357 tempest-TestVolumeBootPattern-1339481357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60edcebcccaa4da99ffddadd3e27c1c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fef19544ec414094953daea6d545a361', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:14:20.352797 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG dbcounter [-] [120593] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=120593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 05:14:20.358626 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-937deab0-d1b9-4530-a499-1c8759a50a86 tempest-TestVolumeBootPattern-1339481357 tempest-TestVolumeBootPattern-1339481357-project] 10.222.0.50 "GET /compute/v2.1/servers/af77c184-6aa4-4f31-b736-bf19ec7c1482" status: 200 len: 1265 microversion: 2.1 time: 0.157049 Sep 24 05:14:20.359432 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 625/1277] 10.222.0.50 () {58 vars in 1236 bytes} [Sat Sep 24 05:14:20 2022] GET /compute/v2.1/servers/af77c184-6aa4-4f31-b736-bf19ec7c1482 => generated 1265 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 05:14:20.481515 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-9d6c1af1-911d-4078-b866-58803304c076 tempest-TestMinimumBasicScenario-2093795776 tempest-TestMinimumBasicScenario-2093795776-project] Calling method '>' {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:14:20.482168 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.compute.api [None req-9d6c1af1-911d-4078-b866-58803304c076 tempest-TestMinimumBasicScenario-2093795776 tempest-TestMinimumBasicScenario-2093795776-project] [instance: c8dc693a-12ca-40a8-8ce8-4f5cb342fb8f] Fetching instance by UUID {{(pid=120594) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:14:20.488087 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-9d6c1af1-911d-4078-b866-58803304c076 tempest-TestMinimumBasicScenario-2093795776 tempest-TestMinimumBasicScenario-2093795776-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:14:20.488567 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-9d6c1af1-911d-4078-b866-58803304c076 tempest-TestMinimumBasicScenario-2093795776 tempest-TestMinimumBasicScenario-2093795776-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:14:20.489004 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-9d6c1af1-911d-4078-b866-58803304c076 tempest-TestMinimumBasicScenario-2093795776 tempest-TestMinimumBasicScenario-2093795776-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:14:20.489694 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-9d6c1af1-911d-4078-b866-58803304c076 tempest-TestMinimumBasicScenario-2093795776 tempest-TestMinimumBasicScenario-2093795776-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:14:20.490183 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-9d6c1af1-911d-4078-b866-58803304c076 tempest-TestMinimumBasicScenario-2093795776 tempest-TestMinimumBasicScenario-2093795776-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:14:20.490608 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-9d6c1af1-911d-4078-b866-58803304c076 tempest-TestMinimumBasicScenario-2093795776 tempest-TestMinimumBasicScenario-2093795776-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:14:20.628459 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.policy [None req-9d6c1af1-911d-4078-b866-58803304c076 tempest-TestMinimumBasicScenario-2093795776 tempest-TestMinimumBasicScenario-2093795776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f67fe549bae6447f8b24219becb3bf97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85c73f9a74da4079a54a503e0b42ca2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:14:20.633023 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [None req-9d6c1af1-911d-4078-b866-58803304c076 tempest-TestMinimumBasicScenario-2093795776 tempest-TestMinimumBasicScenario-2093795776-project] 10.222.0.50 "GET /compute/v2.1/servers/c8dc693a-12ca-40a8-8ce8-4f5cb342fb8f" status: 200 len: 1555 microversion: 2.1 time: 0.156069 Sep 24 05:14:20.633797 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 653/1278] 10.222.0.50 () {58 vars in 1236 bytes} [Sat Sep 24 05:14:20 2022] GET /compute/v2.1/servers/c8dc693a-12ca-40a8-8ce8-4f5cb342fb8f => generated 1555 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 05:14:21.382121 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-c11e7ac6-6677-41b1-a9cd-16f45a9fdec7 tempest-TestVolumeBootPattern-1339481357 tempest-TestVolumeBootPattern-1339481357-project] Calling method '>' {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:14:21.382680 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.compute.api [None req-c11e7ac6-6677-41b1-a9cd-16f45a9fdec7 tempest-TestVolumeBootPattern-1339481357 tempest-TestVolumeBootPattern-1339481357-project] [instance: af77c184-6aa4-4f31-b736-bf19ec7c1482] Fetching instance by UUID {{(pid=120593) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:14:21.390473 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-c11e7ac6-6677-41b1-a9cd-16f45a9fdec7 tempest-TestVolumeBootPattern-1339481357 tempest-TestVolumeBootPattern-1339481357-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:14:21.390960 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-c11e7ac6-6677-41b1-a9cd-16f45a9fdec7 tempest-TestVolumeBootPattern-1339481357 tempest-TestVolumeBootPattern-1339481357-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:14:21.391535 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-c11e7ac6-6677-41b1-a9cd-16f45a9fdec7 tempest-TestVolumeBootPattern-1339481357 tempest-TestVolumeBootPattern-1339481357-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:14:21.392240 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-c11e7ac6-6677-41b1-a9cd-16f45a9fdec7 tempest-TestVolumeBootPattern-1339481357 tempest-TestVolumeBootPattern-1339481357-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:14:21.392693 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-c11e7ac6-6677-41b1-a9cd-16f45a9fdec7 tempest-TestVolumeBootPattern-1339481357 tempest-TestVolumeBootPattern-1339481357-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:14:21.393111 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-c11e7ac6-6677-41b1-a9cd-16f45a9fdec7 tempest-TestVolumeBootPattern-1339481357 tempest-TestVolumeBootPattern-1339481357-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:14:21.554108 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-c11e7ac6-6677-41b1-a9cd-16f45a9fdec7 tempest-TestVolumeBootPattern-1339481357 tempest-TestVolumeBootPattern-1339481357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60edcebcccaa4da99ffddadd3e27c1c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fef19544ec414094953daea6d545a361', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:14:21.564601 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-c11e7ac6-6677-41b1-a9cd-16f45a9fdec7 tempest-TestVolumeBootPattern-1339481357 tempest-TestVolumeBootPattern-1339481357-project] 10.222.0.50 "GET /compute/v2.1/servers/af77c184-6aa4-4f31-b736-bf19ec7c1482" status: 200 len: 1265 microversion: 2.1 time: 0.186026 Sep 24 05:14:21.578020 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 626/1279] 10.222.0.50 () {58 vars in 1236 bytes} [Sat Sep 24 05:14:21 2022] GET /compute/v2.1/servers/af77c184-6aa4-4f31-b736-bf19ec7c1482 => generated 1265 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 05:14:21.665380 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-e95cc939-51d8-4e0b-9892-c13f1c1aea9f tempest-TestMinimumBasicScenario-2093795776 tempest-TestMinimumBasicScenario-2093795776-project] Calling method '>' {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:14:21.666014 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.compute.api [None req-e95cc939-51d8-4e0b-9892-c13f1c1aea9f tempest-TestMinimumBasicScenario-2093795776 tempest-TestMinimumBasicScenario-2093795776-project] [instance: c8dc693a-12ca-40a8-8ce8-4f5cb342fb8f] Fetching instance by UUID {{(pid=120594) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:14:21.673602 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-e95cc939-51d8-4e0b-9892-c13f1c1aea9f tempest-TestMinimumBasicScenario-2093795776 tempest-TestMinimumBasicScenario-2093795776-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:14:21.674142 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-e95cc939-51d8-4e0b-9892-c13f1c1aea9f tempest-TestMinimumBasicScenario-2093795776 tempest-TestMinimumBasicScenario-2093795776-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:14:21.674577 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-e95cc939-51d8-4e0b-9892-c13f1c1aea9f tempest-TestMinimumBasicScenario-2093795776 tempest-TestMinimumBasicScenario-2093795776-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:14:21.675276 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-e95cc939-51d8-4e0b-9892-c13f1c1aea9f tempest-TestMinimumBasicScenario-2093795776 tempest-TestMinimumBasicScenario-2093795776-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:14:21.675897 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-e95cc939-51d8-4e0b-9892-c13f1c1aea9f tempest-TestMinimumBasicScenario-2093795776 tempest-TestMinimumBasicScenario-2093795776-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:14:21.676328 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-e95cc939-51d8-4e0b-9892-c13f1c1aea9f tempest-TestMinimumBasicScenario-2093795776 tempest-TestMinimumBasicScenario-2093795776-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:14:21.923069 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.policy [None req-e95cc939-51d8-4e0b-9892-c13f1c1aea9f tempest-TestMinimumBasicScenario-2093795776 tempest-TestMinimumBasicScenario-2093795776-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f67fe549bae6447f8b24219becb3bf97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85c73f9a74da4079a54a503e0b42ca2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:14:21.932603 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [None req-e95cc939-51d8-4e0b-9892-c13f1c1aea9f tempest-TestMinimumBasicScenario-2093795776 tempest-TestMinimumBasicScenario-2093795776-project] 10.222.0.50 "GET /compute/v2.1/servers/c8dc693a-12ca-40a8-8ce8-4f5cb342fb8f" status: 200 len: 1555 microversion: 2.1 time: 0.272480 Sep 24 05:14:21.933723 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 654/1280] 10.222.0.50 () {58 vars in 1236 bytes} [Sat Sep 24 05:14:21 2022] GET /compute/v2.1/servers/c8dc693a-12ca-40a8-8ce8-4f5cb342fb8f => generated 1555 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 05:14:22.153574 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [req-ca1af421-e5df-4ef3-81ea-325ccca3967f req-6b12bf71-07d6-4878-8221-fb6bb0d11711 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c8dc693a-12ca-40a8-8ce8-4f5cb342fb8f", "name": "network-vif-deleted", "tag": "3c4098d3-98fe-49ac-9677-5b3632da2208"}]} {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 05:14:22.164249 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [req-ca1af421-e5df-4ef3-81ea-325ccca3967f req-6b12bf71-07d6-4878-8221-fb6bb0d11711 service nova] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:14:22.164760 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [req-ca1af421-e5df-4ef3-81ea-325ccca3967f req-6b12bf71-07d6-4878-8221-fb6bb0d11711 service nova] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:14:22.165189 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [req-ca1af421-e5df-4ef3-81ea-325ccca3967f req-6b12bf71-07d6-4878-8221-fb6bb0d11711 service nova] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:14:22.178728 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.compute.server_external_events [req-ca1af421-e5df-4ef3-81ea-325ccca3967f req-6b12bf71-07d6-4878-8221-fb6bb0d11711 service nova] Creating event network-vif-deleted:3c4098d3-98fe-49ac-9677-5b3632da2208 for instance c8dc693a-12ca-40a8-8ce8-4f5cb342fb8f on hv-cinder-85918 Sep 24 05:14:22.186961 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [req-ca1af421-e5df-4ef3-81ea-325ccca3967f req-6b12bf71-07d6-4878-8221-fb6bb0d11711 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036955 Sep 24 05:14:22.188127 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 627/1281] 10.222.0.50 () {64 vars in 1317 bytes} [Sat Sep 24 05:14:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 05:14:22.587003 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG dbcounter [-] [120594] Writing DB stats nova_cell0:SELECT=8 {{(pid=120594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 05:14:22.592766 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-64d93ec4-2827-4c7b-b280-9967e329294b tempest-TestVolumeBootPattern-1339481357 tempest-TestVolumeBootPattern-1339481357-project] Calling method '>' {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:14:22.593386 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.compute.api [None req-64d93ec4-2827-4c7b-b280-9967e329294b tempest-TestVolumeBootPattern-1339481357 tempest-TestVolumeBootPattern-1339481357-project] [instance: af77c184-6aa4-4f31-b736-bf19ec7c1482] Fetching instance by UUID {{(pid=120594) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:14:22.602177 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-64d93ec4-2827-4c7b-b280-9967e329294b tempest-TestVolumeBootPattern-1339481357 tempest-TestVolumeBootPattern-1339481357-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:14:22.604834 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-64d93ec4-2827-4c7b-b280-9967e329294b tempest-TestVolumeBootPattern-1339481357 tempest-TestVolumeBootPattern-1339481357-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:14:22.605416 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-64d93ec4-2827-4c7b-b280-9967e329294b tempest-TestVolumeBootPattern-1339481357 tempest-TestVolumeBootPattern-1339481357-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:14:22.606073 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-64d93ec4-2827-4c7b-b280-9967e329294b tempest-TestVolumeBootPattern-1339481357 tempest-TestVolumeBootPattern-1339481357-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:14:22.606900 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-64d93ec4-2827-4c7b-b280-9967e329294b tempest-TestVolumeBootPattern-1339481357 tempest-TestVolumeBootPattern-1339481357-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:14:22.607277 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-64d93ec4-2827-4c7b-b280-9967e329294b tempest-TestVolumeBootPattern-1339481357 tempest-TestVolumeBootPattern-1339481357-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:14:22.859189 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.policy [None req-64d93ec4-2827-4c7b-b280-9967e329294b tempest-TestVolumeBootPattern-1339481357 tempest-TestVolumeBootPattern-1339481357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60edcebcccaa4da99ffddadd3e27c1c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fef19544ec414094953daea6d545a361', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:14:22.863419 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG dbcounter [-] [120594] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=120594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 05:14:22.869681 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [None req-64d93ec4-2827-4c7b-b280-9967e329294b tempest-TestVolumeBootPattern-1339481357 tempest-TestVolumeBootPattern-1339481357-project] 10.222.0.50 "GET /compute/v2.1/servers/af77c184-6aa4-4f31-b736-bf19ec7c1482" status: 200 len: 1265 microversion: 2.1 time: 0.283563 Sep 24 05:14:22.870316 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 655/1282] 10.222.0.50 () {58 vars in 1236 bytes} [Sat Sep 24 05:14:22 2022] GET /compute/v2.1/servers/af77c184-6aa4-4f31-b736-bf19ec7c1482 => generated 1265 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 05:14:22.961451 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-ff55eb22-a5ff-4043-b4db-c676d914231b tempest-TestMinimumBasicScenario-2093795776 tempest-TestMinimumBasicScenario-2093795776-project] Calling method '>' {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:14:22.962911 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.compute.api [None req-ff55eb22-a5ff-4043-b4db-c676d914231b tempest-TestMinimumBasicScenario-2093795776 tempest-TestMinimumBasicScenario-2093795776-project] [instance: c8dc693a-12ca-40a8-8ce8-4f5cb342fb8f] Fetching instance by UUID {{(pid=120593) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:14:22.979941 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-ff55eb22-a5ff-4043-b4db-c676d914231b tempest-TestMinimumBasicScenario-2093795776 tempest-TestMinimumBasicScenario-2093795776-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:14:22.980609 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-ff55eb22-a5ff-4043-b4db-c676d914231b tempest-TestMinimumBasicScenario-2093795776 tempest-TestMinimumBasicScenario-2093795776-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:14:22.981164 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-ff55eb22-a5ff-4043-b4db-c676d914231b tempest-TestMinimumBasicScenario-2093795776 tempest-TestMinimumBasicScenario-2093795776-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:14:22.982176 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-ff55eb22-a5ff-4043-b4db-c676d914231b tempest-TestMinimumBasicScenario-2093795776 tempest-TestMinimumBasicScenario-2093795776-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:14:22.982658 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-ff55eb22-a5ff-4043-b4db-c676d914231b tempest-TestMinimumBasicScenario-2093795776 tempest-TestMinimumBasicScenario-2093795776-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:14:22.983189 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-ff55eb22-a5ff-4043-b4db-c676d914231b tempest-TestMinimumBasicScenario-2093795776 tempest-TestMinimumBasicScenario-2093795776-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:14:23.014296 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.wsgi [None req-ff55eb22-a5ff-4043-b4db-c676d914231b tempest-TestMinimumBasicScenario-2093795776 tempest-TestMinimumBasicScenario-2093795776-project] HTTP exception thrown: Instance c8dc693a-12ca-40a8-8ce8-4f5cb342fb8f could not be found. Sep 24 05:14:23.016142 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-ff55eb22-a5ff-4043-b4db-c676d914231b tempest-TestMinimumBasicScenario-2093795776 tempest-TestMinimumBasicScenario-2093795776-project] Request method failure captured: Sep 24 05:14:23.016142 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: request: GET /compute/v2.1/servers/c8dc693a-12ca-40a8-8ce8-4f5cb342fb8f HTTP/1.1 Sep 24 05:14:23.016142 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: Accept: application/json Sep 24 05:14:23.016142 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: Accept-Encoding: identity Sep 24 05:14:23.016142 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: Connection: close Sep 24 05:14:23.016142 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: Content-Length: 0 Sep 24 05:14:23.016142 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: Content-Type: application/json Sep 24 05:14:23.016142 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: Host: 10.222.0.50 Sep 24 05:14:23.016142 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: Openstack-System-Scope: None Sep 24 05:14:23.016142 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: User-Agent: python-urllib3/1.26.12 Sep 24 05:14:23.016142 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: X-Auth-Token: gAAAAABjLpFEQKVj7D8Qy_ezifbbgi6960YvQ0QzONrT8XGtio33rvCH3C-2RqWPdLxkbf8xu_1VA30-vPtf0ism6OPe_q1qkSQxmgi4ePnJKT-d5k9Q_cpmUHTb-76y1wYwcUpZElNQ-T9CIAomFCgo8uy9tAMGmkFwT1tRW8mGI2lpeKPc1gA Sep 24 05:14:23.016142 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: X-Domain-Id: None Sep 24 05:14:23.016142 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: X-Domain-Name: None Sep 24 05:14:23.016142 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: X-Identity-Status: Confirmed Sep 24 05:14:23.016142 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: X-Is-Admin-Project: True Sep 24 05:14:23.016142 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: X-Project-Domain-Id: default Sep 24 05:14:23.016142 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: X-Project-Domain-Name: Default Sep 24 05:14:23.016142 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: X-Project-Id: 85c73f9a74da4079a54a503e0b42ca2e Sep 24 05:14:23.016142 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: X-Project-Name: tempest-TestMinimumBasicScenario-2093795776 Sep 24 05:14:23.016142 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: X-Role: member,reader Sep 24 05:14:23.016142 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: X-Roles: member,reader Sep 24 05:14:23.017614 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/85c73f9a74da4079a54a503e0b42ca2e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/85c73f9a74da4079a54a503e0b42ca2e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/85c73f9a74da4079a54a503e0b42ca2e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.50:8080", "publicURL": "http://10.222.0.50:8080/v1/AUTH_85c73f9a74da4079a54a503e0b42ca2e"}]}] Sep 24 05:14:23.017614 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: X-Tenant: tempest-TestMinimumBasicScenario-2093795776 Sep 24 05:14:23.017614 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: X-Tenant-Id: 85c73f9a74da4079a54a503e0b42ca2e Sep 24 05:14:23.017614 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: X-Tenant-Name: tempest-TestMinimumBasicScenario-2093795776 Sep 24 05:14:23.017614 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: X-User: tempest-TestMinimumBasicScenario-2093795776-project Sep 24 05:14:23.017614 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: X-User-Domain-Id: default Sep 24 05:14:23.017614 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: X-User-Domain-Name: Default Sep 24 05:14:23.017614 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: X-User-Id: f67fe549bae6447f8b24219becb3bf97 Sep 24 05:14:23.017614 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: X-User-Name: tempest-TestMinimumBasicScenario-2093795776-project Sep 24 05:14:23.017614 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: method: > Sep 24 05:14:23.017614 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: exception: Instance c8dc693a-12ca-40a8-8ce8-4f5cb342fb8f could not be found. Sep 24 05:14:23.017614 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: action_args: {'id': 'c8dc693a-12ca-40a8-8ce8-4f5cb342fb8f'} Sep 24 05:14:23.018543 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 24 05:14:23.018543 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 05:14:23.018543 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 24 05:14:23.018543 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 24 05:14:23.018543 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 24 05:14:23.018543 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 24 05:14:23.018543 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 24 05:14:23.018543 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 24 05:14:23.018543 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 24 05:14:23.018543 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 24 05:14:23.018543 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c8dc693a-12ca-40a8-8ce8-4f5cb342fb8f could not be found. Sep 24 05:14:23.018543 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi Sep 24 05:14:23.018543 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 05:14:23.018543 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi Sep 24 05:14:23.018543 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 05:14:23.018543 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 05:14:23.018543 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 05:14:23.018543 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 24 05:14:23.018543 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 24 05:14:23.018543 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 24 05:14:23.019848 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 24 05:14:23.019848 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 24 05:14:23.019848 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 24 05:14:23.019848 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 24 05:14:23.019848 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 24 05:14:23.019848 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 24 05:14:23.019848 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 24 05:14:23.019848 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c8dc693a-12ca-40a8-8ce8-4f5cb342fb8f could not be found. Sep 24 05:14:23.019848 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi Sep 24 05:14:23.019848 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 05:14:23.019848 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi Sep 24 05:14:23.019848 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 05:14:23.019848 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 05:14:23.019848 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 05:14:23.019848 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 24 05:14:23.019848 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 24 05:14:23.019848 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c8dc693a-12ca-40a8-8ce8-4f5cb342fb8f could not be found. Sep 24 05:14:23.019848 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi Sep 24 05:14:23.022563 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-ff55eb22-a5ff-4043-b4db-c676d914231b tempest-TestMinimumBasicScenario-2093795776 tempest-TestMinimumBasicScenario-2093795776-project] Returning 404 to user: Instance c8dc693a-12ca-40a8-8ce8-4f5cb342fb8f could not be found. {{(pid=120593) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 24 05:14:23.022563 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-ff55eb22-a5ff-4043-b4db-c676d914231b tempest-TestMinimumBasicScenario-2093795776 tempest-TestMinimumBasicScenario-2093795776-project] 10.222.0.50 "GET /compute/v2.1/servers/c8dc693a-12ca-40a8-8ce8-4f5cb342fb8f" status: 404 len: 111 microversion: 2.1 time: 0.065209 Sep 24 05:14:23.022563 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 628/1283] 10.222.0.50 () {58 vars in 1236 bytes} [Sat Sep 24 05:14:22 2022] GET /compute/v2.1/servers/c8dc693a-12ca-40a8-8ce8-4f5cb342fb8f => generated 111 bytes in 69 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 24 05:14:23.031166 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-9c038cfa-0801-45f5-8f11-f7ee214a82d6 tempest-TestMinimumBasicScenario-2093795776 tempest-TestMinimumBasicScenario-2093795776-project] Calling method '.version_select at 0x7f795096ca60>' {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:14:23.073206 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [None req-9c038cfa-0801-45f5-8f11-f7ee214a82d6 tempest-TestMinimumBasicScenario-2093795776 tempest-TestMinimumBasicScenario-2093795776-project] 10.222.0.50 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1931805901" status: 202 len: 0 microversion: 2.1 time: 0.046713 Sep 24 05:14:23.074321 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 656/1284] 10.222.0.50 () {58 vars in 1272 bytes} [Sat Sep 24 05:14:23 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1931805901 => generated 0 bytes in 49 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 24 05:14:23.894970 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-aa0653c1-54d2-43fb-98ab-f1dfa7ad3f22 tempest-TestVolumeBootPattern-1339481357 tempest-TestVolumeBootPattern-1339481357-project] Calling method '>' {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:14:23.895589 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.compute.api [None req-aa0653c1-54d2-43fb-98ab-f1dfa7ad3f22 tempest-TestVolumeBootPattern-1339481357 tempest-TestVolumeBootPattern-1339481357-project] [instance: af77c184-6aa4-4f31-b736-bf19ec7c1482] Fetching instance by UUID {{(pid=120593) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:14:23.901752 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-aa0653c1-54d2-43fb-98ab-f1dfa7ad3f22 tempest-TestVolumeBootPattern-1339481357 tempest-TestVolumeBootPattern-1339481357-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:14:23.902280 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-aa0653c1-54d2-43fb-98ab-f1dfa7ad3f22 tempest-TestVolumeBootPattern-1339481357 tempest-TestVolumeBootPattern-1339481357-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:14:23.902727 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-aa0653c1-54d2-43fb-98ab-f1dfa7ad3f22 tempest-TestVolumeBootPattern-1339481357 tempest-TestVolumeBootPattern-1339481357-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:14:23.903431 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-aa0653c1-54d2-43fb-98ab-f1dfa7ad3f22 tempest-TestVolumeBootPattern-1339481357 tempest-TestVolumeBootPattern-1339481357-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:14:23.903884 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-aa0653c1-54d2-43fb-98ab-f1dfa7ad3f22 tempest-TestVolumeBootPattern-1339481357 tempest-TestVolumeBootPattern-1339481357-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:14:23.904308 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-aa0653c1-54d2-43fb-98ab-f1dfa7ad3f22 tempest-TestVolumeBootPattern-1339481357 tempest-TestVolumeBootPattern-1339481357-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:14:24.155768 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-aa0653c1-54d2-43fb-98ab-f1dfa7ad3f22 tempest-TestVolumeBootPattern-1339481357 tempest-TestVolumeBootPattern-1339481357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60edcebcccaa4da99ffddadd3e27c1c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fef19544ec414094953daea6d545a361', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:14:24.169215 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-aa0653c1-54d2-43fb-98ab-f1dfa7ad3f22 tempest-TestVolumeBootPattern-1339481357 tempest-TestVolumeBootPattern-1339481357-project] 10.222.0.50 "GET /compute/v2.1/servers/af77c184-6aa4-4f31-b736-bf19ec7c1482" status: 200 len: 1265 microversion: 2.1 time: 0.279798 Sep 24 05:14:24.169789 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 629/1285] 10.222.0.50 () {58 vars in 1236 bytes} [Sat Sep 24 05:14:23 2022] GET /compute/v2.1/servers/af77c184-6aa4-4f31-b736-bf19ec7c1482 => generated 1265 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 05:14:25.192310 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-71206c9a-a0c9-4b9f-91a3-7a9051594ad0 tempest-TestVolumeBootPattern-1339481357 tempest-TestVolumeBootPattern-1339481357-project] Calling method '>' {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:14:25.193831 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.compute.api [None req-71206c9a-a0c9-4b9f-91a3-7a9051594ad0 tempest-TestVolumeBootPattern-1339481357 tempest-TestVolumeBootPattern-1339481357-project] [instance: af77c184-6aa4-4f31-b736-bf19ec7c1482] Fetching instance by UUID {{(pid=120594) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:14:25.201479 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-71206c9a-a0c9-4b9f-91a3-7a9051594ad0 tempest-TestVolumeBootPattern-1339481357 tempest-TestVolumeBootPattern-1339481357-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:14:25.202173 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-71206c9a-a0c9-4b9f-91a3-7a9051594ad0 tempest-TestVolumeBootPattern-1339481357 tempest-TestVolumeBootPattern-1339481357-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:14:25.202984 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-71206c9a-a0c9-4b9f-91a3-7a9051594ad0 tempest-TestVolumeBootPattern-1339481357 tempest-TestVolumeBootPattern-1339481357-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:14:25.204612 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-71206c9a-a0c9-4b9f-91a3-7a9051594ad0 tempest-TestVolumeBootPattern-1339481357 tempest-TestVolumeBootPattern-1339481357-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:14:25.205753 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-71206c9a-a0c9-4b9f-91a3-7a9051594ad0 tempest-TestVolumeBootPattern-1339481357 tempest-TestVolumeBootPattern-1339481357-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:14:25.206357 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-71206c9a-a0c9-4b9f-91a3-7a9051594ad0 tempest-TestVolumeBootPattern-1339481357 tempest-TestVolumeBootPattern-1339481357-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:14:25.434189 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.policy [None req-71206c9a-a0c9-4b9f-91a3-7a9051594ad0 tempest-TestVolumeBootPattern-1339481357 tempest-TestVolumeBootPattern-1339481357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60edcebcccaa4da99ffddadd3e27c1c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fef19544ec414094953daea6d545a361', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:14:25.442432 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [None req-71206c9a-a0c9-4b9f-91a3-7a9051594ad0 tempest-TestVolumeBootPattern-1339481357 tempest-TestVolumeBootPattern-1339481357-project] 10.222.0.50 "GET /compute/v2.1/servers/af77c184-6aa4-4f31-b736-bf19ec7c1482" status: 200 len: 1265 microversion: 2.1 time: 0.254511 Sep 24 05:14:25.443340 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 657/1286] 10.222.0.50 () {58 vars in 1236 bytes} [Sat Sep 24 05:14:25 2022] GET /compute/v2.1/servers/af77c184-6aa4-4f31-b736-bf19ec7c1482 => generated 1265 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 05:14:26.471015 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-bc333be9-c562-4fa3-8fc5-bb82e2450086 tempest-TestVolumeBootPattern-1339481357 tempest-TestVolumeBootPattern-1339481357-project] Calling method '>' {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:14:26.471015 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.compute.api [None req-bc333be9-c562-4fa3-8fc5-bb82e2450086 tempest-TestVolumeBootPattern-1339481357 tempest-TestVolumeBootPattern-1339481357-project] [instance: af77c184-6aa4-4f31-b736-bf19ec7c1482] Fetching instance by UUID {{(pid=120593) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:14:26.478766 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-bc333be9-c562-4fa3-8fc5-bb82e2450086 tempest-TestVolumeBootPattern-1339481357 tempest-TestVolumeBootPattern-1339481357-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:14:26.479471 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-bc333be9-c562-4fa3-8fc5-bb82e2450086 tempest-TestVolumeBootPattern-1339481357 tempest-TestVolumeBootPattern-1339481357-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:14:26.480341 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-bc333be9-c562-4fa3-8fc5-bb82e2450086 tempest-TestVolumeBootPattern-1339481357 tempest-TestVolumeBootPattern-1339481357-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:14:26.481338 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-bc333be9-c562-4fa3-8fc5-bb82e2450086 tempest-TestVolumeBootPattern-1339481357 tempest-TestVolumeBootPattern-1339481357-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:14:26.482141 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-bc333be9-c562-4fa3-8fc5-bb82e2450086 tempest-TestVolumeBootPattern-1339481357 tempest-TestVolumeBootPattern-1339481357-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:14:26.482713 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-bc333be9-c562-4fa3-8fc5-bb82e2450086 tempest-TestVolumeBootPattern-1339481357 tempest-TestVolumeBootPattern-1339481357-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:14:26.636163 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-bc333be9-c562-4fa3-8fc5-bb82e2450086 tempest-TestVolumeBootPattern-1339481357 tempest-TestVolumeBootPattern-1339481357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60edcebcccaa4da99ffddadd3e27c1c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fef19544ec414094953daea6d545a361', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:14:26.662610 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-bc333be9-c562-4fa3-8fc5-bb82e2450086 tempest-TestVolumeBootPattern-1339481357 tempest-TestVolumeBootPattern-1339481357-project] 10.222.0.50 "GET /compute/v2.1/servers/af77c184-6aa4-4f31-b736-bf19ec7c1482" status: 200 len: 1265 microversion: 2.1 time: 0.197217 Sep 24 05:14:26.663572 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 630/1287] 10.222.0.50 () {58 vars in 1236 bytes} [Sat Sep 24 05:14:26 2022] GET /compute/v2.1/servers/af77c184-6aa4-4f31-b736-bf19ec7c1482 => generated 1265 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 05:14:27.686834 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-62315192-8ee8-4e78-beb5-b021da91a557 tempest-TestVolumeBootPattern-1339481357 tempest-TestVolumeBootPattern-1339481357-project] Calling method '>' {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:14:27.687456 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.compute.api [None req-62315192-8ee8-4e78-beb5-b021da91a557 tempest-TestVolumeBootPattern-1339481357 tempest-TestVolumeBootPattern-1339481357-project] [instance: af77c184-6aa4-4f31-b736-bf19ec7c1482] Fetching instance by UUID {{(pid=120594) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:14:27.696668 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-62315192-8ee8-4e78-beb5-b021da91a557 tempest-TestVolumeBootPattern-1339481357 tempest-TestVolumeBootPattern-1339481357-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:14:27.697498 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-62315192-8ee8-4e78-beb5-b021da91a557 tempest-TestVolumeBootPattern-1339481357 tempest-TestVolumeBootPattern-1339481357-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:14:27.698722 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-62315192-8ee8-4e78-beb5-b021da91a557 tempest-TestVolumeBootPattern-1339481357 tempest-TestVolumeBootPattern-1339481357-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:14:27.699739 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-62315192-8ee8-4e78-beb5-b021da91a557 tempest-TestVolumeBootPattern-1339481357 tempest-TestVolumeBootPattern-1339481357-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:14:27.700372 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-62315192-8ee8-4e78-beb5-b021da91a557 tempest-TestVolumeBootPattern-1339481357 tempest-TestVolumeBootPattern-1339481357-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:14:27.700998 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-62315192-8ee8-4e78-beb5-b021da91a557 tempest-TestVolumeBootPattern-1339481357 tempest-TestVolumeBootPattern-1339481357-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:14:28.157958 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.policy [None req-62315192-8ee8-4e78-beb5-b021da91a557 tempest-TestVolumeBootPattern-1339481357 tempest-TestVolumeBootPattern-1339481357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60edcebcccaa4da99ffddadd3e27c1c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fef19544ec414094953daea6d545a361', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:14:28.166959 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [None req-62315192-8ee8-4e78-beb5-b021da91a557 tempest-TestVolumeBootPattern-1339481357 tempest-TestVolumeBootPattern-1339481357-project] 10.222.0.50 "GET /compute/v2.1/servers/af77c184-6aa4-4f31-b736-bf19ec7c1482" status: 200 len: 1265 microversion: 2.1 time: 0.485643 Sep 24 05:14:28.167972 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 658/1288] 10.222.0.50 () {58 vars in 1236 bytes} [Sat Sep 24 05:14:27 2022] GET /compute/v2.1/servers/af77c184-6aa4-4f31-b736-bf19ec7c1482 => generated 1265 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 05:14:29.220016 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-7883ed70-bdb4-4343-a856-d01a4370acee tempest-TestVolumeBootPattern-1339481357 tempest-TestVolumeBootPattern-1339481357-project] Calling method '>' {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:14:29.221051 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.compute.api [None req-7883ed70-bdb4-4343-a856-d01a4370acee tempest-TestVolumeBootPattern-1339481357 tempest-TestVolumeBootPattern-1339481357-project] [instance: af77c184-6aa4-4f31-b736-bf19ec7c1482] Fetching instance by UUID {{(pid=120594) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:14:29.244730 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 24 05:14:29.244991 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: Sat Sep 24 05:14:29 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/af77c184-6aa4-4f31-b736-bf19ec7c1482 (ip 10.222.0.50) !!! Sep 24 05:14:29.269652 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-7883ed70-bdb4-4343-a856-d01a4370acee tempest-TestVolumeBootPattern-1339481357 tempest-TestVolumeBootPattern-1339481357-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:14:29.271154 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-7883ed70-bdb4-4343-a856-d01a4370acee tempest-TestVolumeBootPattern-1339481357 tempest-TestVolumeBootPattern-1339481357-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:14:29.271789 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-7883ed70-bdb4-4343-a856-d01a4370acee tempest-TestVolumeBootPattern-1339481357 tempest-TestVolumeBootPattern-1339481357-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:14:29.273472 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-7883ed70-bdb4-4343-a856-d01a4370acee tempest-TestVolumeBootPattern-1339481357 tempest-TestVolumeBootPattern-1339481357-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:14:29.275675 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-7883ed70-bdb4-4343-a856-d01a4370acee tempest-TestVolumeBootPattern-1339481357 tempest-TestVolumeBootPattern-1339481357-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:14:29.276277 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-7883ed70-bdb4-4343-a856-d01a4370acee tempest-TestVolumeBootPattern-1339481357 tempest-TestVolumeBootPattern-1339481357-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:14:29.345502 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [req-c922416c-d729-40c2-b9f6-0cb1dec11ca1 req-7040cf47-f942-43b8-a5c8-ac810acb45b2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "af77c184-6aa4-4f31-b736-bf19ec7c1482", "name": "network-vif-plugged", "status": "completed", "tag": "b3fe81c9-e8d5-4709-aba9-c58720d8684a"}]} {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 05:14:29.368228 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [req-c922416c-d729-40c2-b9f6-0cb1dec11ca1 req-7040cf47-f942-43b8-a5c8-ac810acb45b2 service nova] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:14:29.369464 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [req-c922416c-d729-40c2-b9f6-0cb1dec11ca1 req-7040cf47-f942-43b8-a5c8-ac810acb45b2 service nova] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:14:29.370141 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [req-c922416c-d729-40c2-b9f6-0cb1dec11ca1 req-7040cf47-f942-43b8-a5c8-ac810acb45b2 service nova] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:14:29.386408 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.compute.server_external_events [req-c922416c-d729-40c2-b9f6-0cb1dec11ca1 req-7040cf47-f942-43b8-a5c8-ac810acb45b2 service nova] Creating event network-vif-plugged:b3fe81c9-e8d5-4709-aba9-c58720d8684a for instance af77c184-6aa4-4f31-b736-bf19ec7c1482 on hv-cinder-85918 Sep 24 05:14:29.393485 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [req-c922416c-d729-40c2-b9f6-0cb1dec11ca1 req-7040cf47-f942-43b8-a5c8-ac810acb45b2 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.221829 Sep 24 05:14:29.394883 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 631/1289] 10.222.0.50 () {64 vars in 1317 bytes} [Sat Sep 24 05:14:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 05:14:29.495625 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.policy [None req-7883ed70-bdb4-4343-a856-d01a4370acee tempest-TestVolumeBootPattern-1339481357 tempest-TestVolumeBootPattern-1339481357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60edcebcccaa4da99ffddadd3e27c1c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fef19544ec414094953daea6d545a361', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:14:29.504681 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [None req-7883ed70-bdb4-4343-a856-d01a4370acee tempest-TestVolumeBootPattern-1339481357 tempest-TestVolumeBootPattern-1339481357-project] 10.222.0.50 "GET /compute/v2.1/servers/af77c184-6aa4-4f31-b736-bf19ec7c1482" status: 200 len: 1265 microversion: 2.1 time: 0.315082 Sep 24 05:14:29.505685 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 659/1290] 10.222.0.50 () {58 vars in 1236 bytes} [Sat Sep 24 05:14:29 2022] GET /compute/v2.1/servers/af77c184-6aa4-4f31-b736-bf19ec7c1482 => generated 1265 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 05:14:30.417893 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-76ee7edc-3cef-4ace-b1fd-3173640332e8 tempest-VolumesNegativeTest-579746364 tempest-VolumesNegativeTest-579746364-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-1720719420", "imageRef": "75ab730a-d8cc-4ea2-b58f-0f3eb476c976", "flavorRef": "452"}} {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 05:14:30.480324 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.network.neutron [None req-76ee7edc-3cef-4ace-b1fd-3173640332e8 tempest-VolumesNegativeTest-579746364 tempest-VolumesNegativeTest-579746364-project] validate_networks() for None {{(pid=120593) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 24 05:14:30.528652 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-9e60af22-e170-480d-8a7a-7491680cc56a tempest-TestVolumeBootPattern-1339481357 tempest-TestVolumeBootPattern-1339481357-project] Calling method '>' {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:14:30.530029 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.compute.api [None req-9e60af22-e170-480d-8a7a-7491680cc56a tempest-TestVolumeBootPattern-1339481357 tempest-TestVolumeBootPattern-1339481357-project] [instance: af77c184-6aa4-4f31-b736-bf19ec7c1482] Fetching instance by UUID {{(pid=120594) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:14:30.539054 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-9e60af22-e170-480d-8a7a-7491680cc56a tempest-TestVolumeBootPattern-1339481357 tempest-TestVolumeBootPattern-1339481357-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:14:30.539801 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-9e60af22-e170-480d-8a7a-7491680cc56a tempest-TestVolumeBootPattern-1339481357 tempest-TestVolumeBootPattern-1339481357-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:14:30.540993 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-9e60af22-e170-480d-8a7a-7491680cc56a tempest-TestVolumeBootPattern-1339481357 tempest-TestVolumeBootPattern-1339481357-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:14:30.541709 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-9e60af22-e170-480d-8a7a-7491680cc56a tempest-TestVolumeBootPattern-1339481357 tempest-TestVolumeBootPattern-1339481357-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:14:30.542199 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-9e60af22-e170-480d-8a7a-7491680cc56a tempest-TestVolumeBootPattern-1339481357 tempest-TestVolumeBootPattern-1339481357-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:14:30.542629 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-9e60af22-e170-480d-8a7a-7491680cc56a tempest-TestVolumeBootPattern-1339481357 tempest-TestVolumeBootPattern-1339481357-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:14:30.825116 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.policy [None req-9e60af22-e170-480d-8a7a-7491680cc56a tempest-TestVolumeBootPattern-1339481357 tempest-TestVolumeBootPattern-1339481357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60edcebcccaa4da99ffddadd3e27c1c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fef19544ec414094953daea6d545a361', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:14:30.839737 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [None req-9e60af22-e170-480d-8a7a-7491680cc56a tempest-TestVolumeBootPattern-1339481357 tempest-TestVolumeBootPattern-1339481357-project] 10.222.0.50 "GET /compute/v2.1/servers/af77c184-6aa4-4f31-b736-bf19ec7c1482" status: 200 len: 1265 microversion: 2.1 time: 0.314939 Sep 24 05:14:30.859532 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 660/1291] 10.222.0.50 () {58 vars in 1236 bytes} [Sat Sep 24 05:14:30 2022] GET /compute/v2.1/servers/af77c184-6aa4-4f31-b736-bf19ec7c1482 => generated 1265 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 24 05:14:30.896083 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.virt.hardware [None req-76ee7edc-3cef-4ace-b1fd-3173640332e8 tempest-VolumesNegativeTest-579746364 tempest-VolumesNegativeTest-579746364-project] Flavor limits 0:0:0 {{(pid=120593) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 24 05:14:30.896901 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.virt.hardware [None req-76ee7edc-3cef-4ace-b1fd-3173640332e8 tempest-VolumesNegativeTest-579746364 tempest-VolumesNegativeTest-579746364-project] Image limits 0:0:0 {{(pid=120593) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 24 05:14:30.897635 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.virt.hardware [None req-76ee7edc-3cef-4ace-b1fd-3173640332e8 tempest-VolumesNegativeTest-579746364 tempest-VolumesNegativeTest-579746364-project] Flavor pref 0:0:0 {{(pid=120593) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 24 05:14:30.898343 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.virt.hardware [None req-76ee7edc-3cef-4ace-b1fd-3173640332e8 tempest-VolumesNegativeTest-579746364 tempest-VolumesNegativeTest-579746364-project] Image pref 0:0:0 {{(pid=120593) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 24 05:14:30.899101 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.virt.hardware [None req-76ee7edc-3cef-4ace-b1fd-3173640332e8 tempest-VolumesNegativeTest-579746364 tempest-VolumesNegativeTest-579746364-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120593) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 24 05:14:30.909503 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-76ee7edc-3cef-4ace-b1fd-3173640332e8 tempest-VolumesNegativeTest-579746364 tempest-VolumesNegativeTest-579746364-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:14:30.910253 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-76ee7edc-3cef-4ace-b1fd-3173640332e8 tempest-VolumesNegativeTest-579746364 tempest-VolumesNegativeTest-579746364-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:14:30.910845 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-76ee7edc-3cef-4ace-b1fd-3173640332e8 tempest-VolumesNegativeTest-579746364 tempest-VolumesNegativeTest-579746364-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:14:30.914157 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-76ee7edc-3cef-4ace-b1fd-3173640332e8 tempest-VolumesNegativeTest-579746364 tempest-VolumesNegativeTest-579746364-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:14:30.914978 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-76ee7edc-3cef-4ace-b1fd-3173640332e8 tempest-VolumesNegativeTest-579746364 tempest-VolumesNegativeTest-579746364-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:14:30.916060 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-76ee7edc-3cef-4ace-b1fd-3173640332e8 tempest-VolumesNegativeTest-579746364 tempest-VolumesNegativeTest-579746364-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:14:30.943312 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.quota [None req-76ee7edc-3cef-4ace-b1fd-3173640332e8 tempest-VolumesNegativeTest-579746364 tempest-VolumesNegativeTest-579746364-project] Getting quotas for project 3c7dd358b27c46c39025fc95f3d56997. Resources: {'instances', 'ram', 'cores'} {{(pid=120593) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 24 05:14:30.950946 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.quota [None req-76ee7edc-3cef-4ace-b1fd-3173640332e8 tempest-VolumesNegativeTest-579746364 tempest-VolumesNegativeTest-579746364-project] Getting quotas for user abf719b5d31043cc937217f4610e4190 and project 3c7dd358b27c46c39025fc95f3d56997. Resources: {'instances', 'ram', 'cores'} {{(pid=120593) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 24 05:14:30.967015 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.compute.api [None req-76ee7edc-3cef-4ace-b1fd-3173640332e8 tempest-VolumesNegativeTest-579746364 tempest-VolumesNegativeTest-579746364-project] Going to run 1 instances... {{(pid=120593) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 24 05:14:30.969700 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.compute.api [None req-76ee7edc-3cef-4ace-b1fd-3173640332e8 tempest-VolumesNegativeTest-579746364 tempest-VolumesNegativeTest-579746364-project] [instance: 67460808-bbd6-44c0-90ed-ef732020e5c0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='75ab730a-d8cc-4ea2-b58f-0f3eb476c976',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120593) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 24 05:14:31.062891 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-76ee7edc-3cef-4ace-b1fd-3173640332e8 tempest-VolumesNegativeTest-579746364 tempest-VolumesNegativeTest-579746364-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.642946 Sep 24 05:14:31.064191 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 632/1292] 10.222.0.50 () {60 vars in 1147 bytes} [Sat Sep 24 05:14:30 2022] POST /compute/v2.1/servers => generated 380 bytes in 652 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 24 05:14:31.076800 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-21a90142-2912-47ed-aea8-d9da1485b4f2 tempest-VolumesNegativeTest-579746364 tempest-VolumesNegativeTest-579746364-project] Calling method '>' {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:14:31.078037 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.compute.api [None req-21a90142-2912-47ed-aea8-d9da1485b4f2 tempest-VolumesNegativeTest-579746364 tempest-VolumesNegativeTest-579746364-project] [instance: 67460808-bbd6-44c0-90ed-ef732020e5c0] Fetching instance by UUID {{(pid=120594) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:14:31.143190 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.policy [None req-21a90142-2912-47ed-aea8-d9da1485b4f2 tempest-VolumesNegativeTest-579746364 tempest-VolumesNegativeTest-579746364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abf719b5d31043cc937217f4610e4190', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c7dd358b27c46c39025fc95f3d56997', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:14:31.153225 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [None req-21a90142-2912-47ed-aea8-d9da1485b4f2 tempest-VolumesNegativeTest-579746364 tempest-VolumesNegativeTest-579746364-project] 10.222.0.50 "GET /compute/v2.1/servers/67460808-bbd6-44c0-90ed-ef732020e5c0" status: 200 len: 1215 microversion: 2.1 time: 0.081903 Sep 24 05:14:31.155451 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 661/1293] 10.222.0.50 () {58 vars in 1236 bytes} [Sat Sep 24 05:14:31 2022] GET /compute/v2.1/servers/67460808-bbd6-44c0-90ed-ef732020e5c0 => generated 1215 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 05:14:31.867853 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-34a7482d-c25c-4c00-83b6-dbe497132623 tempest-TestVolumeBootPattern-1339481357 tempest-TestVolumeBootPattern-1339481357-project] Calling method '>' {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:14:31.869202 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.compute.api [None req-34a7482d-c25c-4c00-83b6-dbe497132623 tempest-TestVolumeBootPattern-1339481357 tempest-TestVolumeBootPattern-1339481357-project] [instance: af77c184-6aa4-4f31-b736-bf19ec7c1482] Fetching instance by UUID {{(pid=120593) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:14:31.877068 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-34a7482d-c25c-4c00-83b6-dbe497132623 tempest-TestVolumeBootPattern-1339481357 tempest-TestVolumeBootPattern-1339481357-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:14:31.877633 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-34a7482d-c25c-4c00-83b6-dbe497132623 tempest-TestVolumeBootPattern-1339481357 tempest-TestVolumeBootPattern-1339481357-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:14:31.878163 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-34a7482d-c25c-4c00-83b6-dbe497132623 tempest-TestVolumeBootPattern-1339481357 tempest-TestVolumeBootPattern-1339481357-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:14:31.878957 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-34a7482d-c25c-4c00-83b6-dbe497132623 tempest-TestVolumeBootPattern-1339481357 tempest-TestVolumeBootPattern-1339481357-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:14:31.879478 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-34a7482d-c25c-4c00-83b6-dbe497132623 tempest-TestVolumeBootPattern-1339481357 tempest-TestVolumeBootPattern-1339481357-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:14:31.880221 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-34a7482d-c25c-4c00-83b6-dbe497132623 tempest-TestVolumeBootPattern-1339481357 tempest-TestVolumeBootPattern-1339481357-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:14:32.016347 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-34a7482d-c25c-4c00-83b6-dbe497132623 tempest-TestVolumeBootPattern-1339481357 tempest-TestVolumeBootPattern-1339481357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60edcebcccaa4da99ffddadd3e27c1c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fef19544ec414094953daea6d545a361', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:14:32.029120 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-34a7482d-c25c-4c00-83b6-dbe497132623 tempest-TestVolumeBootPattern-1339481357 tempest-TestVolumeBootPattern-1339481357-project] 10.222.0.50 "GET /compute/v2.1/servers/af77c184-6aa4-4f31-b736-bf19ec7c1482" status: 200 len: 1451 microversion: 2.1 time: 0.165735 Sep 24 05:14:32.029789 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 633/1294] 10.222.0.50 () {58 vars in 1236 bytes} [Sat Sep 24 05:14:31 2022] GET /compute/v2.1/servers/af77c184-6aa4-4f31-b736-bf19ec7c1482 => generated 1451 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 05:14:32.052199 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-f72668ec-f1c7-4713-a454-1cdf030ab0a6 tempest-TestVolumeBootPattern-1339481357 tempest-TestVolumeBootPattern-1339481357-project] Calling method '>' {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:14:32.052903 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.compute.api [None req-f72668ec-f1c7-4713-a454-1cdf030ab0a6 tempest-TestVolumeBootPattern-1339481357 tempest-TestVolumeBootPattern-1339481357-project] [instance: af77c184-6aa4-4f31-b736-bf19ec7c1482] Fetching instance by UUID {{(pid=120594) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:14:32.059852 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-f72668ec-f1c7-4713-a454-1cdf030ab0a6 tempest-TestVolumeBootPattern-1339481357 tempest-TestVolumeBootPattern-1339481357-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:14:32.060309 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-f72668ec-f1c7-4713-a454-1cdf030ab0a6 tempest-TestVolumeBootPattern-1339481357 tempest-TestVolumeBootPattern-1339481357-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:14:32.060740 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-f72668ec-f1c7-4713-a454-1cdf030ab0a6 tempest-TestVolumeBootPattern-1339481357 tempest-TestVolumeBootPattern-1339481357-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:14:32.061427 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-f72668ec-f1c7-4713-a454-1cdf030ab0a6 tempest-TestVolumeBootPattern-1339481357 tempest-TestVolumeBootPattern-1339481357-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:14:32.062089 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-f72668ec-f1c7-4713-a454-1cdf030ab0a6 tempest-TestVolumeBootPattern-1339481357 tempest-TestVolumeBootPattern-1339481357-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:14:32.062509 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-f72668ec-f1c7-4713-a454-1cdf030ab0a6 tempest-TestVolumeBootPattern-1339481357 tempest-TestVolumeBootPattern-1339481357-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:14:32.182636 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-850c1ca1-5606-424a-9eac-d92a2a8224ee tempest-VolumesNegativeTest-579746364 tempest-VolumesNegativeTest-579746364-project] Calling method '>' {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:14:32.183974 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.compute.api [None req-850c1ca1-5606-424a-9eac-d92a2a8224ee tempest-VolumesNegativeTest-579746364 tempest-VolumesNegativeTest-579746364-project] [instance: 67460808-bbd6-44c0-90ed-ef732020e5c0] Fetching instance by UUID {{(pid=120593) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:14:32.194843 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-850c1ca1-5606-424a-9eac-d92a2a8224ee tempest-VolumesNegativeTest-579746364 tempest-VolumesNegativeTest-579746364-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:14:32.196038 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-850c1ca1-5606-424a-9eac-d92a2a8224ee tempest-VolumesNegativeTest-579746364 tempest-VolumesNegativeTest-579746364-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:14:32.197238 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-850c1ca1-5606-424a-9eac-d92a2a8224ee tempest-VolumesNegativeTest-579746364 tempest-VolumesNegativeTest-579746364-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:14:32.198594 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-850c1ca1-5606-424a-9eac-d92a2a8224ee tempest-VolumesNegativeTest-579746364 tempest-VolumesNegativeTest-579746364-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:14:32.199622 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-850c1ca1-5606-424a-9eac-d92a2a8224ee tempest-VolumesNegativeTest-579746364 tempest-VolumesNegativeTest-579746364-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:14:32.200563 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-850c1ca1-5606-424a-9eac-d92a2a8224ee tempest-VolumesNegativeTest-579746364 tempest-VolumesNegativeTest-579746364-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:14:32.349055 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.policy [None req-f72668ec-f1c7-4713-a454-1cdf030ab0a6 tempest-TestVolumeBootPattern-1339481357 tempest-TestVolumeBootPattern-1339481357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60edcebcccaa4da99ffddadd3e27c1c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fef19544ec414094953daea6d545a361', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:14:32.353512 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-850c1ca1-5606-424a-9eac-d92a2a8224ee tempest-VolumesNegativeTest-579746364 tempest-VolumesNegativeTest-579746364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abf719b5d31043cc937217f4610e4190', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c7dd358b27c46c39025fc95f3d56997', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:14:32.358697 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [None req-f72668ec-f1c7-4713-a454-1cdf030ab0a6 tempest-TestVolumeBootPattern-1339481357 tempest-TestVolumeBootPattern-1339481357-project] 10.222.0.50 "GET /compute/v2.1/servers/af77c184-6aa4-4f31-b736-bf19ec7c1482" status: 200 len: 1451 microversion: 2.1 time: 0.310379 Sep 24 05:14:32.359501 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 662/1295] 10.222.0.50 () {58 vars in 1236 bytes} [Sat Sep 24 05:14:32 2022] GET /compute/v2.1/servers/af77c184-6aa4-4f31-b736-bf19ec7c1482 => generated 1451 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 05:14:32.362238 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-850c1ca1-5606-424a-9eac-d92a2a8224ee tempest-VolumesNegativeTest-579746364 tempest-VolumesNegativeTest-579746364-project] 10.222.0.50 "GET /compute/v2.1/servers/67460808-bbd6-44c0-90ed-ef732020e5c0" status: 200 len: 1275 microversion: 2.1 time: 0.188356 Sep 24 05:14:32.362989 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 634/1296] 10.222.0.50 () {58 vars in 1236 bytes} [Sat Sep 24 05:14:32 2022] GET /compute/v2.1/servers/67460808-bbd6-44c0-90ed-ef732020e5c0 => generated 1275 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 05:14:33.386661 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-99bfac94-12c9-440d-b651-202af2fc1f62 tempest-VolumesNegativeTest-579746364 tempest-VolumesNegativeTest-579746364-project] Calling method '>' {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:14:33.387983 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.compute.api [None req-99bfac94-12c9-440d-b651-202af2fc1f62 tempest-VolumesNegativeTest-579746364 tempest-VolumesNegativeTest-579746364-project] [instance: 67460808-bbd6-44c0-90ed-ef732020e5c0] Fetching instance by UUID {{(pid=120594) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:14:33.394859 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-99bfac94-12c9-440d-b651-202af2fc1f62 tempest-VolumesNegativeTest-579746364 tempest-VolumesNegativeTest-579746364-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:14:33.395685 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-99bfac94-12c9-440d-b651-202af2fc1f62 tempest-VolumesNegativeTest-579746364 tempest-VolumesNegativeTest-579746364-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:14:33.396200 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-99bfac94-12c9-440d-b651-202af2fc1f62 tempest-VolumesNegativeTest-579746364 tempest-VolumesNegativeTest-579746364-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:14:33.396915 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-99bfac94-12c9-440d-b651-202af2fc1f62 tempest-VolumesNegativeTest-579746364 tempest-VolumesNegativeTest-579746364-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:14:33.397370 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-99bfac94-12c9-440d-b651-202af2fc1f62 tempest-VolumesNegativeTest-579746364 tempest-VolumesNegativeTest-579746364-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:14:33.397795 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-99bfac94-12c9-440d-b651-202af2fc1f62 tempest-VolumesNegativeTest-579746364 tempest-VolumesNegativeTest-579746364-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:14:33.620341 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.policy [None req-99bfac94-12c9-440d-b651-202af2fc1f62 tempest-VolumesNegativeTest-579746364 tempest-VolumesNegativeTest-579746364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abf719b5d31043cc937217f4610e4190', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c7dd358b27c46c39025fc95f3d56997', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:14:33.631153 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [None req-99bfac94-12c9-440d-b651-202af2fc1f62 tempest-VolumesNegativeTest-579746364 tempest-VolumesNegativeTest-579746364-project] 10.222.0.50 "GET /compute/v2.1/servers/67460808-bbd6-44c0-90ed-ef732020e5c0" status: 200 len: 1315 microversion: 2.1 time: 0.248148 Sep 24 05:14:33.632362 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 663/1297] 10.222.0.50 () {58 vars in 1236 bytes} [Sat Sep 24 05:14:33 2022] GET /compute/v2.1/servers/67460808-bbd6-44c0-90ed-ef732020e5c0 => generated 1315 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 05:14:34.136033 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [req-76d06499-6237-446e-9a19-625a012ea373 req-00008b9d-dd5c-47cf-8d30-d82ca686be9a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "67460808-bbd6-44c0-90ed-ef732020e5c0", "tag": "6b9c8dd3-2d3a-4ce3-ba3a-61ad10888be3"}]} {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 05:14:34.152218 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [req-76d06499-6237-446e-9a19-625a012ea373 req-00008b9d-dd5c-47cf-8d30-d82ca686be9a service nova] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:14:34.153347 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [req-76d06499-6237-446e-9a19-625a012ea373 req-00008b9d-dd5c-47cf-8d30-d82ca686be9a service nova] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:14:34.154096 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [req-76d06499-6237-446e-9a19-625a012ea373 req-00008b9d-dd5c-47cf-8d30-d82ca686be9a service nova] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:14:34.185102 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.compute.server_external_events [req-76d06499-6237-446e-9a19-625a012ea373 req-00008b9d-dd5c-47cf-8d30-d82ca686be9a service nova] Creating event network-changed:6b9c8dd3-2d3a-4ce3-ba3a-61ad10888be3 for instance 67460808-bbd6-44c0-90ed-ef732020e5c0 on hv-cinder-85918 Sep 24 05:14:34.199011 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [req-76d06499-6237-446e-9a19-625a012ea373 req-00008b9d-dd5c-47cf-8d30-d82ca686be9a service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.071072 Sep 24 05:14:34.199969 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 635/1298] 10.222.0.50 () {64 vars in 1317 bytes} [Sat Sep 24 05:14:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 05:14:34.574402 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [req-a488d87c-6b9b-4dab-936d-0224e7f2a9d1 req-28e5381a-6f69-4cc2-bb50-28ff92861c0f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "af77c184-6aa4-4f31-b736-bf19ec7c1482", "tag": "b3fe81c9-e8d5-4709-aba9-c58720d8684a"}]} {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 05:14:34.595044 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [req-a488d87c-6b9b-4dab-936d-0224e7f2a9d1 req-28e5381a-6f69-4cc2-bb50-28ff92861c0f service nova] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:14:34.597641 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [req-a488d87c-6b9b-4dab-936d-0224e7f2a9d1 req-28e5381a-6f69-4cc2-bb50-28ff92861c0f service nova] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:14:34.599478 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [req-a488d87c-6b9b-4dab-936d-0224e7f2a9d1 req-28e5381a-6f69-4cc2-bb50-28ff92861c0f service nova] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:14:34.619970 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: INFO nova.api.openstack.compute.server_external_events [req-a488d87c-6b9b-4dab-936d-0224e7f2a9d1 req-28e5381a-6f69-4cc2-bb50-28ff92861c0f service nova] Creating event network-changed:b3fe81c9-e8d5-4709-aba9-c58720d8684a for instance af77c184-6aa4-4f31-b736-bf19ec7c1482 on hv-cinder-85918 Sep 24 05:14:34.629181 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [req-a488d87c-6b9b-4dab-936d-0224e7f2a9d1 req-28e5381a-6f69-4cc2-bb50-28ff92861c0f service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.058472 Sep 24 05:14:34.630204 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 664/1299] 10.222.0.50 () {64 vars in 1317 bytes} [Sat Sep 24 05:14:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 05:14:34.657041 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-0257da7b-2737-49c6-a157-11ace612380a tempest-VolumesNegativeTest-579746364 tempest-VolumesNegativeTest-579746364-project] Calling method '>' {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:14:34.658613 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.compute.api [None req-0257da7b-2737-49c6-a157-11ace612380a tempest-VolumesNegativeTest-579746364 tempest-VolumesNegativeTest-579746364-project] [instance: 67460808-bbd6-44c0-90ed-ef732020e5c0] Fetching instance by UUID {{(pid=120593) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:14:34.666811 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-0257da7b-2737-49c6-a157-11ace612380a tempest-VolumesNegativeTest-579746364 tempest-VolumesNegativeTest-579746364-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:14:34.667715 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-0257da7b-2737-49c6-a157-11ace612380a tempest-VolumesNegativeTest-579746364 tempest-VolumesNegativeTest-579746364-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:14:34.668404 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-0257da7b-2737-49c6-a157-11ace612380a tempest-VolumesNegativeTest-579746364 tempest-VolumesNegativeTest-579746364-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:14:34.669357 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-0257da7b-2737-49c6-a157-11ace612380a tempest-VolumesNegativeTest-579746364 tempest-VolumesNegativeTest-579746364-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:14:34.670129 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-0257da7b-2737-49c6-a157-11ace612380a tempest-VolumesNegativeTest-579746364 tempest-VolumesNegativeTest-579746364-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:14:34.670800 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-0257da7b-2737-49c6-a157-11ace612380a tempest-VolumesNegativeTest-579746364 tempest-VolumesNegativeTest-579746364-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:14:34.818226 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-0257da7b-2737-49c6-a157-11ace612380a tempest-VolumesNegativeTest-579746364 tempest-VolumesNegativeTest-579746364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abf719b5d31043cc937217f4610e4190', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c7dd358b27c46c39025fc95f3d56997', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:14:34.826248 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-0257da7b-2737-49c6-a157-11ace612380a tempest-VolumesNegativeTest-579746364 tempest-VolumesNegativeTest-579746364-project] 10.222.0.50 "GET /compute/v2.1/servers/67460808-bbd6-44c0-90ed-ef732020e5c0" status: 200 len: 1315 microversion: 2.1 time: 0.174884 Sep 24 05:14:34.826826 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 636/1300] 10.222.0.50 () {58 vars in 1236 bytes} [Sat Sep 24 05:14:34 2022] GET /compute/v2.1/servers/67460808-bbd6-44c0-90ed-ef732020e5c0 => generated 1315 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 05:14:35.849258 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-217379cf-3f0b-4bf9-99c9-97144f476948 tempest-VolumesNegativeTest-579746364 tempest-VolumesNegativeTest-579746364-project] Calling method '>' {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:14:35.849963 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.compute.api [None req-217379cf-3f0b-4bf9-99c9-97144f476948 tempest-VolumesNegativeTest-579746364 tempest-VolumesNegativeTest-579746364-project] [instance: 67460808-bbd6-44c0-90ed-ef732020e5c0] Fetching instance by UUID {{(pid=120594) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:14:35.859976 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-217379cf-3f0b-4bf9-99c9-97144f476948 tempest-VolumesNegativeTest-579746364 tempest-VolumesNegativeTest-579746364-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:14:35.860465 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-217379cf-3f0b-4bf9-99c9-97144f476948 tempest-VolumesNegativeTest-579746364 tempest-VolumesNegativeTest-579746364-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:14:35.861009 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-217379cf-3f0b-4bf9-99c9-97144f476948 tempest-VolumesNegativeTest-579746364 tempest-VolumesNegativeTest-579746364-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:14:35.861773 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-217379cf-3f0b-4bf9-99c9-97144f476948 tempest-VolumesNegativeTest-579746364 tempest-VolumesNegativeTest-579746364-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:14:35.862259 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-217379cf-3f0b-4bf9-99c9-97144f476948 tempest-VolumesNegativeTest-579746364 tempest-VolumesNegativeTest-579746364-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:14:35.862688 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-217379cf-3f0b-4bf9-99c9-97144f476948 tempest-VolumesNegativeTest-579746364 tempest-VolumesNegativeTest-579746364-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:14:36.000814 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.policy [None req-217379cf-3f0b-4bf9-99c9-97144f476948 tempest-VolumesNegativeTest-579746364 tempest-VolumesNegativeTest-579746364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abf719b5d31043cc937217f4610e4190', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c7dd358b27c46c39025fc95f3d56997', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:14:36.014360 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [None req-217379cf-3f0b-4bf9-99c9-97144f476948 tempest-VolumesNegativeTest-579746364 tempest-VolumesNegativeTest-579746364-project] 10.222.0.50 "GET /compute/v2.1/servers/67460808-bbd6-44c0-90ed-ef732020e5c0" status: 200 len: 1315 microversion: 2.1 time: 0.166412 Sep 24 05:14:36.014360 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 665/1301] 10.222.0.50 () {58 vars in 1236 bytes} [Sat Sep 24 05:14:35 2022] GET /compute/v2.1/servers/67460808-bbd6-44c0-90ed-ef732020e5c0 => generated 1315 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 05:14:37.034299 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-8ac3f452-ed8e-45ae-bc27-e1f0e4e245cf tempest-VolumesNegativeTest-579746364 tempest-VolumesNegativeTest-579746364-project] Calling method '>' {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:14:37.034828 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.compute.api [None req-8ac3f452-ed8e-45ae-bc27-e1f0e4e245cf tempest-VolumesNegativeTest-579746364 tempest-VolumesNegativeTest-579746364-project] [instance: 67460808-bbd6-44c0-90ed-ef732020e5c0] Fetching instance by UUID {{(pid=120593) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:14:37.041085 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-8ac3f452-ed8e-45ae-bc27-e1f0e4e245cf tempest-VolumesNegativeTest-579746364 tempest-VolumesNegativeTest-579746364-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:14:37.041556 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-8ac3f452-ed8e-45ae-bc27-e1f0e4e245cf tempest-VolumesNegativeTest-579746364 tempest-VolumesNegativeTest-579746364-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:14:37.041986 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-8ac3f452-ed8e-45ae-bc27-e1f0e4e245cf tempest-VolumesNegativeTest-579746364 tempest-VolumesNegativeTest-579746364-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:14:37.042684 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-8ac3f452-ed8e-45ae-bc27-e1f0e4e245cf tempest-VolumesNegativeTest-579746364 tempest-VolumesNegativeTest-579746364-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:14:37.043128 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-8ac3f452-ed8e-45ae-bc27-e1f0e4e245cf tempest-VolumesNegativeTest-579746364 tempest-VolumesNegativeTest-579746364-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:14:37.043545 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-8ac3f452-ed8e-45ae-bc27-e1f0e4e245cf tempest-VolumesNegativeTest-579746364 tempest-VolumesNegativeTest-579746364-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:14:37.172362 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-8ac3f452-ed8e-45ae-bc27-e1f0e4e245cf tempest-VolumesNegativeTest-579746364 tempest-VolumesNegativeTest-579746364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abf719b5d31043cc937217f4610e4190', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c7dd358b27c46c39025fc95f3d56997', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:14:37.179847 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-8ac3f452-ed8e-45ae-bc27-e1f0e4e245cf tempest-VolumesNegativeTest-579746364 tempest-VolumesNegativeTest-579746364-project] 10.222.0.50 "GET /compute/v2.1/servers/67460808-bbd6-44c0-90ed-ef732020e5c0" status: 200 len: 1315 microversion: 2.1 time: 0.149772 Sep 24 05:14:37.180966 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 637/1302] 10.222.0.50 () {58 vars in 1236 bytes} [Sat Sep 24 05:14:37 2022] GET /compute/v2.1/servers/67460808-bbd6-44c0-90ed-ef732020e5c0 => generated 1315 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 05:14:38.202946 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-4bc55c07-00f0-4664-914d-6010dc608e25 tempest-VolumesNegativeTest-579746364 tempest-VolumesNegativeTest-579746364-project] Calling method '>' {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:14:38.203534 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.compute.api [None req-4bc55c07-00f0-4664-914d-6010dc608e25 tempest-VolumesNegativeTest-579746364 tempest-VolumesNegativeTest-579746364-project] [instance: 67460808-bbd6-44c0-90ed-ef732020e5c0] Fetching instance by UUID {{(pid=120594) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:14:38.205937 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG dbcounter [-] [120594] Writing DB stats nova_api:SELECT=88,nova_api:UPDATE=1,nova_api:DELETE=2 {{(pid=120594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 05:14:38.212332 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-4bc55c07-00f0-4664-914d-6010dc608e25 tempest-VolumesNegativeTest-579746364 tempest-VolumesNegativeTest-579746364-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:14:38.212813 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-4bc55c07-00f0-4664-914d-6010dc608e25 tempest-VolumesNegativeTest-579746364 tempest-VolumesNegativeTest-579746364-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:14:38.213251 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-4bc55c07-00f0-4664-914d-6010dc608e25 tempest-VolumesNegativeTest-579746364 tempest-VolumesNegativeTest-579746364-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:14:38.213950 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-4bc55c07-00f0-4664-914d-6010dc608e25 tempest-VolumesNegativeTest-579746364 tempest-VolumesNegativeTest-579746364-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:14:38.214428 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-4bc55c07-00f0-4664-914d-6010dc608e25 tempest-VolumesNegativeTest-579746364 tempest-VolumesNegativeTest-579746364-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:14:38.214856 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-4bc55c07-00f0-4664-914d-6010dc608e25 tempest-VolumesNegativeTest-579746364 tempest-VolumesNegativeTest-579746364-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:14:38.370574 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.policy [None req-4bc55c07-00f0-4664-914d-6010dc608e25 tempest-VolumesNegativeTest-579746364 tempest-VolumesNegativeTest-579746364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abf719b5d31043cc937217f4610e4190', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c7dd358b27c46c39025fc95f3d56997', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:14:38.378321 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [None req-4bc55c07-00f0-4664-914d-6010dc608e25 tempest-VolumesNegativeTest-579746364 tempest-VolumesNegativeTest-579746364-project] 10.222.0.50 "GET /compute/v2.1/servers/67460808-bbd6-44c0-90ed-ef732020e5c0" status: 200 len: 1315 microversion: 2.1 time: 0.179178 Sep 24 05:14:38.378883 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 666/1303] 10.222.0.50 () {58 vars in 1236 bytes} [Sat Sep 24 05:14:38 2022] GET /compute/v2.1/servers/67460808-bbd6-44c0-90ed-ef732020e5c0 => generated 1315 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 05:14:39.402002 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-a6f49b2b-0ca8-4184-87a2-d0401bd31782 tempest-VolumesNegativeTest-579746364 tempest-VolumesNegativeTest-579746364-project] Calling method '>' {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:14:39.402633 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.compute.api [None req-a6f49b2b-0ca8-4184-87a2-d0401bd31782 tempest-VolumesNegativeTest-579746364 tempest-VolumesNegativeTest-579746364-project] [instance: 67460808-bbd6-44c0-90ed-ef732020e5c0] Fetching instance by UUID {{(pid=120593) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:14:39.405274 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG dbcounter [-] [120593] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=6,nova_api:UPDATE=1 {{(pid=120593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 05:14:39.410379 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-a6f49b2b-0ca8-4184-87a2-d0401bd31782 tempest-VolumesNegativeTest-579746364 tempest-VolumesNegativeTest-579746364-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:14:39.410859 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-a6f49b2b-0ca8-4184-87a2-d0401bd31782 tempest-VolumesNegativeTest-579746364 tempest-VolumesNegativeTest-579746364-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:14:39.411291 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-a6f49b2b-0ca8-4184-87a2-d0401bd31782 tempest-VolumesNegativeTest-579746364 tempest-VolumesNegativeTest-579746364-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:14:39.411971 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-a6f49b2b-0ca8-4184-87a2-d0401bd31782 tempest-VolumesNegativeTest-579746364 tempest-VolumesNegativeTest-579746364-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:14:39.412414 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-a6f49b2b-0ca8-4184-87a2-d0401bd31782 tempest-VolumesNegativeTest-579746364 tempest-VolumesNegativeTest-579746364-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:14:39.412829 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-a6f49b2b-0ca8-4184-87a2-d0401bd31782 tempest-VolumesNegativeTest-579746364 tempest-VolumesNegativeTest-579746364-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:14:39.545434 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-a6f49b2b-0ca8-4184-87a2-d0401bd31782 tempest-VolumesNegativeTest-579746364 tempest-VolumesNegativeTest-579746364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abf719b5d31043cc937217f4610e4190', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c7dd358b27c46c39025fc95f3d56997', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:14:39.553101 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-a6f49b2b-0ca8-4184-87a2-d0401bd31782 tempest-VolumesNegativeTest-579746364 tempest-VolumesNegativeTest-579746364-project] 10.222.0.50 "GET /compute/v2.1/servers/67460808-bbd6-44c0-90ed-ef732020e5c0" status: 200 len: 1315 microversion: 2.1 time: 0.155402 Sep 24 05:14:39.553686 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 638/1304] 10.222.0.50 () {58 vars in 1236 bytes} [Sat Sep 24 05:14:39 2022] GET /compute/v2.1/servers/67460808-bbd6-44c0-90ed-ef732020e5c0 => generated 1315 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 05:14:40.576120 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-1cb096cb-43c3-4865-8442-614933fbb095 tempest-VolumesNegativeTest-579746364 tempest-VolumesNegativeTest-579746364-project] Calling method '>' {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:14:40.576734 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.compute.api [None req-1cb096cb-43c3-4865-8442-614933fbb095 tempest-VolumesNegativeTest-579746364 tempest-VolumesNegativeTest-579746364-project] [instance: 67460808-bbd6-44c0-90ed-ef732020e5c0] Fetching instance by UUID {{(pid=120594) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:14:40.583261 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-1cb096cb-43c3-4865-8442-614933fbb095 tempest-VolumesNegativeTest-579746364 tempest-VolumesNegativeTest-579746364-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:14:40.583739 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-1cb096cb-43c3-4865-8442-614933fbb095 tempest-VolumesNegativeTest-579746364 tempest-VolumesNegativeTest-579746364-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:14:40.584234 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-1cb096cb-43c3-4865-8442-614933fbb095 tempest-VolumesNegativeTest-579746364 tempest-VolumesNegativeTest-579746364-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:14:40.584920 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-1cb096cb-43c3-4865-8442-614933fbb095 tempest-VolumesNegativeTest-579746364 tempest-VolumesNegativeTest-579746364-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:14:40.585366 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-1cb096cb-43c3-4865-8442-614933fbb095 tempest-VolumesNegativeTest-579746364 tempest-VolumesNegativeTest-579746364-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:14:40.585786 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-1cb096cb-43c3-4865-8442-614933fbb095 tempest-VolumesNegativeTest-579746364 tempest-VolumesNegativeTest-579746364-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:14:40.716505 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.policy [None req-1cb096cb-43c3-4865-8442-614933fbb095 tempest-VolumesNegativeTest-579746364 tempest-VolumesNegativeTest-579746364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abf719b5d31043cc937217f4610e4190', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c7dd358b27c46c39025fc95f3d56997', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:14:40.724103 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [None req-1cb096cb-43c3-4865-8442-614933fbb095 tempest-VolumesNegativeTest-579746364 tempest-VolumesNegativeTest-579746364-project] 10.222.0.50 "GET /compute/v2.1/servers/67460808-bbd6-44c0-90ed-ef732020e5c0" status: 200 len: 1315 microversion: 2.1 time: 0.151844 Sep 24 05:14:40.724662 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 667/1305] 10.222.0.50 () {58 vars in 1236 bytes} [Sat Sep 24 05:14:40 2022] GET /compute/v2.1/servers/67460808-bbd6-44c0-90ed-ef732020e5c0 => generated 1315 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 05:14:41.204948 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [req-6b0255cd-264e-44e0-84ba-bc757ffa4219 req-3bdeaeff-d126-4beb-ba85-4a3dd91088b3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "67460808-bbd6-44c0-90ed-ef732020e5c0", "name": "network-vif-plugged", "status": "completed", "tag": "6b9c8dd3-2d3a-4ce3-ba3a-61ad10888be3"}]} {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 05:14:41.211839 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG dbcounter [-] [120593] Writing DB stats nova_cell0:SELECT=2 {{(pid=120593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 05:14:41.214641 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG dbcounter [-] [120593] Writing DB stats nova_cell0:SELECT=6 {{(pid=120593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 05:14:41.222728 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [req-6b0255cd-264e-44e0-84ba-bc757ffa4219 req-3bdeaeff-d126-4beb-ba85-4a3dd91088b3 service nova] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:14:41.223209 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [req-6b0255cd-264e-44e0-84ba-bc757ffa4219 req-3bdeaeff-d126-4beb-ba85-4a3dd91088b3 service nova] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:14:41.223633 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [req-6b0255cd-264e-44e0-84ba-bc757ffa4219 req-3bdeaeff-d126-4beb-ba85-4a3dd91088b3 service nova] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:14:41.236854 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.compute.server_external_events [req-6b0255cd-264e-44e0-84ba-bc757ffa4219 req-3bdeaeff-d126-4beb-ba85-4a3dd91088b3 service nova] Creating event network-vif-plugged:6b9c8dd3-2d3a-4ce3-ba3a-61ad10888be3 for instance 67460808-bbd6-44c0-90ed-ef732020e5c0 on hv-cinder-85918 Sep 24 05:14:41.242239 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [req-6b0255cd-264e-44e0-84ba-bc757ffa4219 req-3bdeaeff-d126-4beb-ba85-4a3dd91088b3 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043082 Sep 24 05:14:41.243479 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 639/1306] 10.222.0.50 () {64 vars in 1317 bytes} [Sat Sep 24 05:14:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 05:14:41.746215 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-bf951679-88be-48b9-848f-70c59eb89d4f tempest-VolumesNegativeTest-579746364 tempest-VolumesNegativeTest-579746364-project] Calling method '>' {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:14:41.746855 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.compute.api [None req-bf951679-88be-48b9-848f-70c59eb89d4f tempest-VolumesNegativeTest-579746364 tempest-VolumesNegativeTest-579746364-project] [instance: 67460808-bbd6-44c0-90ed-ef732020e5c0] Fetching instance by UUID {{(pid=120594) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:14:41.748666 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG dbcounter [-] [120594] Writing DB stats nova_cell0:SELECT=2 {{(pid=120594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 05:14:41.755087 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-bf951679-88be-48b9-848f-70c59eb89d4f tempest-VolumesNegativeTest-579746364 tempest-VolumesNegativeTest-579746364-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:14:41.755571 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-bf951679-88be-48b9-848f-70c59eb89d4f tempest-VolumesNegativeTest-579746364 tempest-VolumesNegativeTest-579746364-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:14:41.756009 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-bf951679-88be-48b9-848f-70c59eb89d4f tempest-VolumesNegativeTest-579746364 tempest-VolumesNegativeTest-579746364-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:14:41.756710 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-bf951679-88be-48b9-848f-70c59eb89d4f tempest-VolumesNegativeTest-579746364 tempest-VolumesNegativeTest-579746364-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:14:41.757166 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-bf951679-88be-48b9-848f-70c59eb89d4f tempest-VolumesNegativeTest-579746364 tempest-VolumesNegativeTest-579746364-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:14:41.757603 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-bf951679-88be-48b9-848f-70c59eb89d4f tempest-VolumesNegativeTest-579746364 tempest-VolumesNegativeTest-579746364-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:14:41.891299 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.policy [None req-bf951679-88be-48b9-848f-70c59eb89d4f tempest-VolumesNegativeTest-579746364 tempest-VolumesNegativeTest-579746364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abf719b5d31043cc937217f4610e4190', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c7dd358b27c46c39025fc95f3d56997', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:14:41.899676 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [None req-bf951679-88be-48b9-848f-70c59eb89d4f tempest-VolumesNegativeTest-579746364 tempest-VolumesNegativeTest-579746364-project] 10.222.0.50 "GET /compute/v2.1/servers/67460808-bbd6-44c0-90ed-ef732020e5c0" status: 200 len: 1315 microversion: 2.1 time: 0.156808 Sep 24 05:14:41.900243 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 668/1307] 10.222.0.50 () {58 vars in 1236 bytes} [Sat Sep 24 05:14:41 2022] GET /compute/v2.1/servers/67460808-bbd6-44c0-90ed-ef732020e5c0 => generated 1315 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 05:14:42.923309 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-e4bf49d0-0ea5-4033-b79b-23c7c632a3dc tempest-VolumesNegativeTest-579746364 tempest-VolumesNegativeTest-579746364-project] Calling method '>' {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:14:42.924019 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.compute.api [None req-e4bf49d0-0ea5-4033-b79b-23c7c632a3dc tempest-VolumesNegativeTest-579746364 tempest-VolumesNegativeTest-579746364-project] [instance: 67460808-bbd6-44c0-90ed-ef732020e5c0] Fetching instance by UUID {{(pid=120593) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:14:42.930576 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-e4bf49d0-0ea5-4033-b79b-23c7c632a3dc tempest-VolumesNegativeTest-579746364 tempest-VolumesNegativeTest-579746364-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:14:42.931066 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-e4bf49d0-0ea5-4033-b79b-23c7c632a3dc tempest-VolumesNegativeTest-579746364 tempest-VolumesNegativeTest-579746364-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:14:42.931509 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-e4bf49d0-0ea5-4033-b79b-23c7c632a3dc tempest-VolumesNegativeTest-579746364 tempest-VolumesNegativeTest-579746364-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:14:42.932357 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-e4bf49d0-0ea5-4033-b79b-23c7c632a3dc tempest-VolumesNegativeTest-579746364 tempest-VolumesNegativeTest-579746364-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:14:42.932824 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-e4bf49d0-0ea5-4033-b79b-23c7c632a3dc tempest-VolumesNegativeTest-579746364 tempest-VolumesNegativeTest-579746364-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:14:42.933254 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-e4bf49d0-0ea5-4033-b79b-23c7c632a3dc tempest-VolumesNegativeTest-579746364 tempest-VolumesNegativeTest-579746364-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:14:43.074824 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-e4bf49d0-0ea5-4033-b79b-23c7c632a3dc tempest-VolumesNegativeTest-579746364 tempest-VolumesNegativeTest-579746364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abf719b5d31043cc937217f4610e4190', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c7dd358b27c46c39025fc95f3d56997', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:14:43.083268 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-e4bf49d0-0ea5-4033-b79b-23c7c632a3dc tempest-VolumesNegativeTest-579746364 tempest-VolumesNegativeTest-579746364-project] 10.222.0.50 "GET /compute/v2.1/servers/67460808-bbd6-44c0-90ed-ef732020e5c0" status: 200 len: 1463 microversion: 2.1 time: 0.164165 Sep 24 05:14:43.083912 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 640/1308] 10.222.0.50 () {58 vars in 1236 bytes} [Sat Sep 24 05:14:42 2022] GET /compute/v2.1/servers/67460808-bbd6-44c0-90ed-ef732020e5c0 => generated 1463 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 24 05:14:43.134227 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-2e8d2bd1-9371-4351-a2ca-33a21ea80707 tempest-VolumesNegativeTest-579746364 tempest-VolumesNegativeTest-579746364-project] Calling method '>' {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:14:43.134696 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.compute.api [None req-2e8d2bd1-9371-4351-a2ca-33a21ea80707 tempest-VolumesNegativeTest-579746364 tempest-VolumesNegativeTest-579746364-project] [instance: 67460808-bbd6-44c0-90ed-ef732020e5c0] Fetching instance by UUID {{(pid=120594) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:14:43.141017 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-2e8d2bd1-9371-4351-a2ca-33a21ea80707 tempest-VolumesNegativeTest-579746364 tempest-VolumesNegativeTest-579746364-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:14:43.141648 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-2e8d2bd1-9371-4351-a2ca-33a21ea80707 tempest-VolumesNegativeTest-579746364 tempest-VolumesNegativeTest-579746364-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:14:43.142282 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-2e8d2bd1-9371-4351-a2ca-33a21ea80707 tempest-VolumesNegativeTest-579746364 tempest-VolumesNegativeTest-579746364-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:14:43.142965 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-2e8d2bd1-9371-4351-a2ca-33a21ea80707 tempest-VolumesNegativeTest-579746364 tempest-VolumesNegativeTest-579746364-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:14:43.143406 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-2e8d2bd1-9371-4351-a2ca-33a21ea80707 tempest-VolumesNegativeTest-579746364 tempest-VolumesNegativeTest-579746364-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:14:43.143823 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-2e8d2bd1-9371-4351-a2ca-33a21ea80707 tempest-VolumesNegativeTest-579746364 tempest-VolumesNegativeTest-579746364-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:14:43.170905 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.compute.api [None req-2e8d2bd1-9371-4351-a2ca-33a21ea80707 tempest-VolumesNegativeTest-579746364 tempest-VolumesNegativeTest-579746364-project] [instance: 67460808-bbd6-44c0-90ed-ef732020e5c0] Going to try to terminate instance {{(pid=120594) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 24 05:14:43.261790 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [None req-2e8d2bd1-9371-4351-a2ca-33a21ea80707 tempest-VolumesNegativeTest-579746364 tempest-VolumesNegativeTest-579746364-project] 10.222.0.50 "DELETE /compute/v2.1/servers/67460808-bbd6-44c0-90ed-ef732020e5c0" status: 204 len: 0 microversion: 2.1 time: 0.131194 Sep 24 05:14:43.262408 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 669/1309] 10.222.0.50 () {58 vars in 1239 bytes} [Sat Sep 24 05:14:43 2022] DELETE /compute/v2.1/servers/67460808-bbd6-44c0-90ed-ef732020e5c0 => generated 0 bytes in 133 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Sep 24 05:14:43.271200 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-42d2226f-52d5-4eda-a835-1c282da489d2 tempest-VolumesNegativeTest-579746364 tempest-VolumesNegativeTest-579746364-project] Calling method '>' {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:14:43.272048 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.compute.api [None req-42d2226f-52d5-4eda-a835-1c282da489d2 tempest-VolumesNegativeTest-579746364 tempest-VolumesNegativeTest-579746364-project] [instance: 67460808-bbd6-44c0-90ed-ef732020e5c0] Fetching instance by UUID {{(pid=120593) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:14:43.278904 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-42d2226f-52d5-4eda-a835-1c282da489d2 tempest-VolumesNegativeTest-579746364 tempest-VolumesNegativeTest-579746364-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:14:43.279473 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-42d2226f-52d5-4eda-a835-1c282da489d2 tempest-VolumesNegativeTest-579746364 tempest-VolumesNegativeTest-579746364-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:14:43.280234 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-42d2226f-52d5-4eda-a835-1c282da489d2 tempest-VolumesNegativeTest-579746364 tempest-VolumesNegativeTest-579746364-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:14:43.281175 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-42d2226f-52d5-4eda-a835-1c282da489d2 tempest-VolumesNegativeTest-579746364 tempest-VolumesNegativeTest-579746364-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:14:43.281725 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-42d2226f-52d5-4eda-a835-1c282da489d2 tempest-VolumesNegativeTest-579746364 tempest-VolumesNegativeTest-579746364-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:14:43.282848 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-42d2226f-52d5-4eda-a835-1c282da489d2 tempest-VolumesNegativeTest-579746364 tempest-VolumesNegativeTest-579746364-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:14:43.409536 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-42d2226f-52d5-4eda-a835-1c282da489d2 tempest-VolumesNegativeTest-579746364 tempest-VolumesNegativeTest-579746364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abf719b5d31043cc937217f4610e4190', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c7dd358b27c46c39025fc95f3d56997', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:14:43.417950 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-42d2226f-52d5-4eda-a835-1c282da489d2 tempest-VolumesNegativeTest-579746364 tempest-VolumesNegativeTest-579746364-project] 10.222.0.50 "GET /compute/v2.1/servers/67460808-bbd6-44c0-90ed-ef732020e5c0" status: 200 len: 1469 microversion: 2.1 time: 0.151030 Sep 24 05:14:43.418617 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 641/1310] 10.222.0.50 () {58 vars in 1236 bytes} [Sat Sep 24 05:14:43 2022] GET /compute/v2.1/servers/67460808-bbd6-44c0-90ed-ef732020e5c0 => generated 1469 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 05:14:44.440829 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-01bd51d7-9440-4ef3-8f1d-bd1e6707bc9d tempest-VolumesNegativeTest-579746364 tempest-VolumesNegativeTest-579746364-project] Calling method '>' {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:14:44.441721 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.compute.api [None req-01bd51d7-9440-4ef3-8f1d-bd1e6707bc9d tempest-VolumesNegativeTest-579746364 tempest-VolumesNegativeTest-579746364-project] [instance: 67460808-bbd6-44c0-90ed-ef732020e5c0] Fetching instance by UUID {{(pid=120594) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:14:44.459990 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-01bd51d7-9440-4ef3-8f1d-bd1e6707bc9d tempest-VolumesNegativeTest-579746364 tempest-VolumesNegativeTest-579746364-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:14:44.460477 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-01bd51d7-9440-4ef3-8f1d-bd1e6707bc9d tempest-VolumesNegativeTest-579746364 tempest-VolumesNegativeTest-579746364-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:14:44.460936 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-01bd51d7-9440-4ef3-8f1d-bd1e6707bc9d tempest-VolumesNegativeTest-579746364 tempest-VolumesNegativeTest-579746364-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:14:44.462207 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-01bd51d7-9440-4ef3-8f1d-bd1e6707bc9d tempest-VolumesNegativeTest-579746364 tempest-VolumesNegativeTest-579746364-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:14:44.462652 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-01bd51d7-9440-4ef3-8f1d-bd1e6707bc9d tempest-VolumesNegativeTest-579746364 tempest-VolumesNegativeTest-579746364-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:14:44.463066 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-01bd51d7-9440-4ef3-8f1d-bd1e6707bc9d tempest-VolumesNegativeTest-579746364 tempest-VolumesNegativeTest-579746364-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:14:44.615426 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.policy [None req-01bd51d7-9440-4ef3-8f1d-bd1e6707bc9d tempest-VolumesNegativeTest-579746364 tempest-VolumesNegativeTest-579746364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abf719b5d31043cc937217f4610e4190', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c7dd358b27c46c39025fc95f3d56997', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:14:44.624768 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [None req-01bd51d7-9440-4ef3-8f1d-bd1e6707bc9d tempest-VolumesNegativeTest-579746364 tempest-VolumesNegativeTest-579746364-project] 10.222.0.50 "GET /compute/v2.1/servers/67460808-bbd6-44c0-90ed-ef732020e5c0" status: 200 len: 1469 microversion: 2.1 time: 0.188303 Sep 24 05:14:44.625559 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 670/1311] 10.222.0.50 () {58 vars in 1236 bytes} [Sat Sep 24 05:14:44 2022] GET /compute/v2.1/servers/67460808-bbd6-44c0-90ed-ef732020e5c0 => generated 1469 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 05:14:45.490956 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [req-fe9cf25c-46f9-45cc-9d73-e63e2ee90ba0 req-0c2b3791-c672-40a2-a4c7-137dc51585b2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "67460808-bbd6-44c0-90ed-ef732020e5c0", "name": "network-vif-deleted", "tag": "6b9c8dd3-2d3a-4ce3-ba3a-61ad10888be3"}]} {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 05:14:45.513116 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [req-fe9cf25c-46f9-45cc-9d73-e63e2ee90ba0 req-0c2b3791-c672-40a2-a4c7-137dc51585b2 service nova] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:14:45.513784 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [req-fe9cf25c-46f9-45cc-9d73-e63e2ee90ba0 req-0c2b3791-c672-40a2-a4c7-137dc51585b2 service nova] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:14:45.514412 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [req-fe9cf25c-46f9-45cc-9d73-e63e2ee90ba0 req-0c2b3791-c672-40a2-a4c7-137dc51585b2 service nova] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:14:45.527084 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.compute.server_external_events [req-fe9cf25c-46f9-45cc-9d73-e63e2ee90ba0 req-0c2b3791-c672-40a2-a4c7-137dc51585b2 service nova] Creating event network-vif-deleted:6b9c8dd3-2d3a-4ce3-ba3a-61ad10888be3 for instance 67460808-bbd6-44c0-90ed-ef732020e5c0 on hv-cinder-85918 Sep 24 05:14:45.534201 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [req-fe9cf25c-46f9-45cc-9d73-e63e2ee90ba0 req-0c2b3791-c672-40a2-a4c7-137dc51585b2 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046128 Sep 24 05:14:45.534805 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 642/1312] 10.222.0.50 () {64 vars in 1317 bytes} [Sat Sep 24 05:14:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 05:14:45.649664 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-41536713-aa94-4da4-b79b-c595eb35d1fd tempest-VolumesNegativeTest-579746364 tempest-VolumesNegativeTest-579746364-project] Calling method '>' {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:14:45.650473 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.compute.api [None req-41536713-aa94-4da4-b79b-c595eb35d1fd tempest-VolumesNegativeTest-579746364 tempest-VolumesNegativeTest-579746364-project] [instance: 67460808-bbd6-44c0-90ed-ef732020e5c0] Fetching instance by UUID {{(pid=120594) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:14:45.661488 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-41536713-aa94-4da4-b79b-c595eb35d1fd tempest-VolumesNegativeTest-579746364 tempest-VolumesNegativeTest-579746364-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:14:45.662282 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-41536713-aa94-4da4-b79b-c595eb35d1fd tempest-VolumesNegativeTest-579746364 tempest-VolumesNegativeTest-579746364-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:14:45.662726 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-41536713-aa94-4da4-b79b-c595eb35d1fd tempest-VolumesNegativeTest-579746364 tempest-VolumesNegativeTest-579746364-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:14:45.663450 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-41536713-aa94-4da4-b79b-c595eb35d1fd tempest-VolumesNegativeTest-579746364 tempest-VolumesNegativeTest-579746364-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:14:45.672807 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-41536713-aa94-4da4-b79b-c595eb35d1fd tempest-VolumesNegativeTest-579746364 tempest-VolumesNegativeTest-579746364-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:14:45.674452 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-41536713-aa94-4da4-b79b-c595eb35d1fd tempest-VolumesNegativeTest-579746364 tempest-VolumesNegativeTest-579746364-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:14:45.708073 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-41536713-aa94-4da4-b79b-c595eb35d1fd tempest-VolumesNegativeTest-579746364 tempest-VolumesNegativeTest-579746364-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:14:45.708631 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-41536713-aa94-4da4-b79b-c595eb35d1fd tempest-VolumesNegativeTest-579746364 tempest-VolumesNegativeTest-579746364-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:14:45.709185 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-41536713-aa94-4da4-b79b-c595eb35d1fd tempest-VolumesNegativeTest-579746364 tempest-VolumesNegativeTest-579746364-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:14:45.709637 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.objects.instance [None req-41536713-aa94-4da4-b79b-c595eb35d1fd tempest-VolumesNegativeTest-579746364 tempest-VolumesNegativeTest-579746364-project] Lazy-loading 'fault' on Instance uuid 67460808-bbd6-44c0-90ed-ef732020e5c0 {{(pid=120594) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 24 05:14:45.756336 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.policy [None req-41536713-aa94-4da4-b79b-c595eb35d1fd tempest-VolumesNegativeTest-579746364 tempest-VolumesNegativeTest-579746364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abf719b5d31043cc937217f4610e4190', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c7dd358b27c46c39025fc95f3d56997', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:14:45.764561 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [None req-41536713-aa94-4da4-b79b-c595eb35d1fd tempest-VolumesNegativeTest-579746364 tempest-VolumesNegativeTest-579746364-project] 10.222.0.50 "GET /compute/v2.1/servers/67460808-bbd6-44c0-90ed-ef732020e5c0" status: 200 len: 1305 microversion: 2.1 time: 0.120642 Sep 24 05:14:45.765147 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 671/1313] 10.222.0.50 () {58 vars in 1236 bytes} [Sat Sep 24 05:14:45 2022] GET /compute/v2.1/servers/67460808-bbd6-44c0-90ed-ef732020e5c0 => generated 1305 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 24 05:14:46.789398 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-ed0ed3d4-ed42-472c-b226-709655c7d3f0 tempest-VolumesNegativeTest-579746364 tempest-VolumesNegativeTest-579746364-project] Calling method '>' {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:14:46.790062 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.compute.api [None req-ed0ed3d4-ed42-472c-b226-709655c7d3f0 tempest-VolumesNegativeTest-579746364 tempest-VolumesNegativeTest-579746364-project] [instance: 67460808-bbd6-44c0-90ed-ef732020e5c0] Fetching instance by UUID {{(pid=120593) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:14:46.796550 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-ed0ed3d4-ed42-472c-b226-709655c7d3f0 tempest-VolumesNegativeTest-579746364 tempest-VolumesNegativeTest-579746364-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:14:46.797029 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-ed0ed3d4-ed42-472c-b226-709655c7d3f0 tempest-VolumesNegativeTest-579746364 tempest-VolumesNegativeTest-579746364-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:14:46.797463 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-ed0ed3d4-ed42-472c-b226-709655c7d3f0 tempest-VolumesNegativeTest-579746364 tempest-VolumesNegativeTest-579746364-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:14:46.798182 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-ed0ed3d4-ed42-472c-b226-709655c7d3f0 tempest-VolumesNegativeTest-579746364 tempest-VolumesNegativeTest-579746364-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:14:46.798637 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-ed0ed3d4-ed42-472c-b226-709655c7d3f0 tempest-VolumesNegativeTest-579746364 tempest-VolumesNegativeTest-579746364-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:14:46.799057 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-ed0ed3d4-ed42-472c-b226-709655c7d3f0 tempest-VolumesNegativeTest-579746364 tempest-VolumesNegativeTest-579746364-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:14:46.812651 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.wsgi [None req-ed0ed3d4-ed42-472c-b226-709655c7d3f0 tempest-VolumesNegativeTest-579746364 tempest-VolumesNegativeTest-579746364-project] HTTP exception thrown: Instance 67460808-bbd6-44c0-90ed-ef732020e5c0 could not be found. Sep 24 05:14:46.814315 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-ed0ed3d4-ed42-472c-b226-709655c7d3f0 tempest-VolumesNegativeTest-579746364 tempest-VolumesNegativeTest-579746364-project] Request method failure captured: Sep 24 05:14:46.814315 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: request: GET /compute/v2.1/servers/67460808-bbd6-44c0-90ed-ef732020e5c0 HTTP/1.1 Sep 24 05:14:46.814315 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: Accept: application/json Sep 24 05:14:46.814315 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: Accept-Encoding: identity Sep 24 05:14:46.814315 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: Connection: close Sep 24 05:14:46.814315 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: Content-Length: 0 Sep 24 05:14:46.814315 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: Content-Type: application/json Sep 24 05:14:46.814315 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: Host: 10.222.0.50 Sep 24 05:14:46.814315 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: Openstack-System-Scope: None Sep 24 05:14:46.814315 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: User-Agent: python-urllib3/1.26.12 Sep 24 05:14:46.814315 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: X-Auth-Token: gAAAAABjLpI0gi6Ws0v7QjdZ92mDJ0_cT1mVwXqck56tK0hOV3ji5Qchcq7fIb_AWH_DuTx3yiPPPHmPBY0JvqHBiEbi4TAZ9bER9_amTObu2WT7kOQqivnSZC6eHx3iEc2_sroxje7kJF6RZ1_B83-Rd7pL5hfLxyyaduSfP-FXwtnggcNtUV8 Sep 24 05:14:46.814315 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: X-Domain-Id: None Sep 24 05:14:46.814315 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: X-Domain-Name: None Sep 24 05:14:46.814315 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: X-Identity-Status: Confirmed Sep 24 05:14:46.814315 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: X-Is-Admin-Project: True Sep 24 05:14:46.814315 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: X-Project-Domain-Id: default Sep 24 05:14:46.814315 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: X-Project-Domain-Name: Default Sep 24 05:14:46.814315 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: X-Project-Id: 3c7dd358b27c46c39025fc95f3d56997 Sep 24 05:14:46.814315 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: X-Project-Name: tempest-VolumesNegativeTest-579746364 Sep 24 05:14:46.814315 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: X-Role: member,reader Sep 24 05:14:46.814315 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: X-Roles: member,reader Sep 24 05:14:46.816175 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/3c7dd358b27c46c39025fc95f3d56997"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/3c7dd358b27c46c39025fc95f3d56997"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/3c7dd358b27c46c39025fc95f3d56997"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.50:8080", "publicURL": "http://10.222.0.50:8080/v1/AUTH_3c7dd358b27c46c39025fc95f3d56997"}]}] Sep 24 05:14:46.816175 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: X-Tenant: tempest-VolumesNegativeTest-579746364 Sep 24 05:14:46.816175 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: X-Tenant-Id: 3c7dd358b27c46c39025fc95f3d56997 Sep 24 05:14:46.816175 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: X-Tenant-Name: tempest-VolumesNegativeTest-579746364 Sep 24 05:14:46.816175 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: X-User: tempest-VolumesNegativeTest-579746364-project Sep 24 05:14:46.816175 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: X-User-Domain-Id: default Sep 24 05:14:46.816175 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: X-User-Domain-Name: Default Sep 24 05:14:46.816175 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: X-User-Id: abf719b5d31043cc937217f4610e4190 Sep 24 05:14:46.816175 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: X-User-Name: tempest-VolumesNegativeTest-579746364-project Sep 24 05:14:46.816175 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: method: > Sep 24 05:14:46.816175 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: exception: Instance 67460808-bbd6-44c0-90ed-ef732020e5c0 could not be found. Sep 24 05:14:46.816175 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: action_args: {'id': '67460808-bbd6-44c0-90ed-ef732020e5c0'} Sep 24 05:14:46.817370 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 24 05:14:46.817370 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 05:14:46.817370 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 24 05:14:46.817370 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 24 05:14:46.817370 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 24 05:14:46.817370 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 24 05:14:46.817370 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 24 05:14:46.817370 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 24 05:14:46.817370 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 24 05:14:46.817370 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 24 05:14:46.817370 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 67460808-bbd6-44c0-90ed-ef732020e5c0 could not be found. Sep 24 05:14:46.817370 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi Sep 24 05:14:46.817370 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 05:14:46.817370 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi Sep 24 05:14:46.817370 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 05:14:46.817370 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 05:14:46.817370 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 05:14:46.817370 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 24 05:14:46.817370 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 24 05:14:46.817370 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 24 05:14:46.819179 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 24 05:14:46.819179 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 24 05:14:46.819179 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 24 05:14:46.819179 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 24 05:14:46.819179 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 24 05:14:46.819179 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 24 05:14:46.819179 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 24 05:14:46.819179 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 67460808-bbd6-44c0-90ed-ef732020e5c0 could not be found. Sep 24 05:14:46.819179 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi Sep 24 05:14:46.819179 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 05:14:46.819179 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi Sep 24 05:14:46.819179 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 05:14:46.819179 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 05:14:46.819179 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 05:14:46.819179 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 24 05:14:46.819179 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 24 05:14:46.819179 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 67460808-bbd6-44c0-90ed-ef732020e5c0 could not be found. Sep 24 05:14:46.819179 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi Sep 24 05:14:46.821455 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-ed0ed3d4-ed42-472c-b226-709655c7d3f0 tempest-VolumesNegativeTest-579746364 tempest-VolumesNegativeTest-579746364-project] Returning 404 to user: Instance 67460808-bbd6-44c0-90ed-ef732020e5c0 could not be found. {{(pid=120593) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 24 05:14:46.821455 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-ed0ed3d4-ed42-472c-b226-709655c7d3f0 tempest-VolumesNegativeTest-579746364 tempest-VolumesNegativeTest-579746364-project] 10.222.0.50 "GET /compute/v2.1/servers/67460808-bbd6-44c0-90ed-ef732020e5c0" status: 404 len: 111 microversion: 2.1 time: 0.030832 Sep 24 05:14:46.821455 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 643/1314] 10.222.0.50 () {58 vars in 1236 bytes} [Sat Sep 24 05:14:46 2022] GET /compute/v2.1/servers/67460808-bbd6-44c0-90ed-ef732020e5c0 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 24 05:15:33.787627 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-5cb3ac55-f273-4999-b100-b0521a30cf9f tempest-VolumesActionsTest-1197709314 tempest-VolumesActionsTest-1197709314-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1799162770", "imageRef": "75ab730a-d8cc-4ea2-b58f-0f3eb476c976", "flavorRef": "452", "networks": [{"uuid": "7657fa99-1efa-43a4-86ce-ec9364576730"}]}} {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 05:15:33.796783 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG dbcounter [-] [120594] Writing DB stats nova_api:SELECT=18,nova_api:UPDATE=1 {{(pid=120594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 05:15:33.797436 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG dbcounter [-] [120594] Writing DB stats nova_cell1:SELECT=90,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 05:15:33.842677 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.network.neutron [None req-5cb3ac55-f273-4999-b100-b0521a30cf9f tempest-VolumesActionsTest-1197709314 tempest-VolumesActionsTest-1197709314-project] validate_networks() for [('7657fa99-1efa-43a4-86ce-ec9364576730', None, None, None, None, None)] {{(pid=120594) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 24 05:15:34.240414 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.virt.hardware [None req-5cb3ac55-f273-4999-b100-b0521a30cf9f tempest-VolumesActionsTest-1197709314 tempest-VolumesActionsTest-1197709314-project] Flavor limits 0:0:0 {{(pid=120594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 24 05:15:34.240840 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.virt.hardware [None req-5cb3ac55-f273-4999-b100-b0521a30cf9f tempest-VolumesActionsTest-1197709314 tempest-VolumesActionsTest-1197709314-project] Image limits 0:0:0 {{(pid=120594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 24 05:15:34.241311 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.virt.hardware [None req-5cb3ac55-f273-4999-b100-b0521a30cf9f tempest-VolumesActionsTest-1197709314 tempest-VolumesActionsTest-1197709314-project] Flavor pref 0:0:0 {{(pid=120594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 24 05:15:34.241721 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.virt.hardware [None req-5cb3ac55-f273-4999-b100-b0521a30cf9f tempest-VolumesActionsTest-1197709314 tempest-VolumesActionsTest-1197709314-project] Image pref 0:0:0 {{(pid=120594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 24 05:15:34.242157 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.virt.hardware [None req-5cb3ac55-f273-4999-b100-b0521a30cf9f tempest-VolumesActionsTest-1197709314 tempest-VolumesActionsTest-1197709314-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120594) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 24 05:15:34.250733 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-5cb3ac55-f273-4999-b100-b0521a30cf9f tempest-VolumesActionsTest-1197709314 tempest-VolumesActionsTest-1197709314-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:15:34.251205 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-5cb3ac55-f273-4999-b100-b0521a30cf9f tempest-VolumesActionsTest-1197709314 tempest-VolumesActionsTest-1197709314-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:15:34.251633 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-5cb3ac55-f273-4999-b100-b0521a30cf9f tempest-VolumesActionsTest-1197709314 tempest-VolumesActionsTest-1197709314-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:15:34.252354 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-5cb3ac55-f273-4999-b100-b0521a30cf9f tempest-VolumesActionsTest-1197709314 tempest-VolumesActionsTest-1197709314-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:15:34.252803 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-5cb3ac55-f273-4999-b100-b0521a30cf9f tempest-VolumesActionsTest-1197709314 tempest-VolumesActionsTest-1197709314-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:15:34.253228 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-5cb3ac55-f273-4999-b100-b0521a30cf9f tempest-VolumesActionsTest-1197709314 tempest-VolumesActionsTest-1197709314-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:15:34.271265 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.quota [None req-5cb3ac55-f273-4999-b100-b0521a30cf9f tempest-VolumesActionsTest-1197709314 tempest-VolumesActionsTest-1197709314-project] Getting quotas for project 0ce523f87745437e9c3d6630d1fb2e51. Resources: {'instances', 'ram', 'cores'} {{(pid=120594) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 24 05:15:34.275466 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.quota [None req-5cb3ac55-f273-4999-b100-b0521a30cf9f tempest-VolumesActionsTest-1197709314 tempest-VolumesActionsTest-1197709314-project] Getting quotas for user 67e8948aca7b4a1da87d81830cc819fe and project 0ce523f87745437e9c3d6630d1fb2e51. Resources: {'instances', 'ram', 'cores'} {{(pid=120594) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 24 05:15:34.287191 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.compute.api [None req-5cb3ac55-f273-4999-b100-b0521a30cf9f tempest-VolumesActionsTest-1197709314 tempest-VolumesActionsTest-1197709314-project] Going to run 1 instances... {{(pid=120594) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 24 05:15:34.289454 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.compute.api [None req-5cb3ac55-f273-4999-b100-b0521a30cf9f tempest-VolumesActionsTest-1197709314 tempest-VolumesActionsTest-1197709314-project] [instance: 1a6da782-b5af-4299-b70e-71ee85178c15] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='75ab730a-d8cc-4ea2-b58f-0f3eb476c976',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120594) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 24 05:15:34.334287 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [None req-5cb3ac55-f273-4999-b100-b0521a30cf9f tempest-VolumesActionsTest-1197709314 tempest-VolumesActionsTest-1197709314-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.550780 Sep 24 05:15:34.334929 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 672/1315] 10.222.0.50 () {60 vars in 1147 bytes} [Sat Sep 24 05:15:33 2022] POST /compute/v2.1/servers => generated 380 bytes in 552 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 24 05:15:34.346821 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-d08b7e35-2199-4efb-a701-e59650a6bf9d tempest-VolumesActionsTest-1197709314 tempest-VolumesActionsTest-1197709314-project] Calling method '>' {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:15:34.347471 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.compute.api [None req-d08b7e35-2199-4efb-a701-e59650a6bf9d tempest-VolumesActionsTest-1197709314 tempest-VolumesActionsTest-1197709314-project] [instance: 1a6da782-b5af-4299-b70e-71ee85178c15] Fetching instance by UUID {{(pid=120593) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:15:34.349802 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG dbcounter [-] [120593] Writing DB stats nova_api:SELECT=11 {{(pid=120593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 05:15:34.354363 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG dbcounter [-] [120593] Writing DB stats nova_cell1:SELECT=76 {{(pid=120593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 05:15:34.409163 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-d08b7e35-2199-4efb-a701-e59650a6bf9d tempest-VolumesActionsTest-1197709314 tempest-VolumesActionsTest-1197709314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67e8948aca7b4a1da87d81830cc819fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ce523f87745437e9c3d6630d1fb2e51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:15:34.415852 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-d08b7e35-2199-4efb-a701-e59650a6bf9d tempest-VolumesActionsTest-1197709314 tempest-VolumesActionsTest-1197709314-project] 10.222.0.50 "GET /compute/v2.1/servers/1a6da782-b5af-4299-b70e-71ee85178c15" status: 200 len: 1214 microversion: 2.1 time: 0.072974 Sep 24 05:15:34.416390 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 644/1316] 10.222.0.50 () {58 vars in 1236 bytes} [Sat Sep 24 05:15:34 2022] GET /compute/v2.1/servers/1a6da782-b5af-4299-b70e-71ee85178c15 => generated 1214 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 05:15:35.439306 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-3141b568-45ab-436e-9d59-1d4797d78aee tempest-VolumesActionsTest-1197709314 tempest-VolumesActionsTest-1197709314-project] Calling method '>' {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:15:35.439880 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.compute.api [None req-3141b568-45ab-436e-9d59-1d4797d78aee tempest-VolumesActionsTest-1197709314 tempest-VolumesActionsTest-1197709314-project] [instance: 1a6da782-b5af-4299-b70e-71ee85178c15] Fetching instance by UUID {{(pid=120594) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:15:35.445816 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-3141b568-45ab-436e-9d59-1d4797d78aee tempest-VolumesActionsTest-1197709314 tempest-VolumesActionsTest-1197709314-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:15:35.446617 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-3141b568-45ab-436e-9d59-1d4797d78aee tempest-VolumesActionsTest-1197709314 tempest-VolumesActionsTest-1197709314-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:15:35.447050 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-3141b568-45ab-436e-9d59-1d4797d78aee tempest-VolumesActionsTest-1197709314 tempest-VolumesActionsTest-1197709314-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:15:35.447998 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-3141b568-45ab-436e-9d59-1d4797d78aee tempest-VolumesActionsTest-1197709314 tempest-VolumesActionsTest-1197709314-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:15:35.448592 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-3141b568-45ab-436e-9d59-1d4797d78aee tempest-VolumesActionsTest-1197709314 tempest-VolumesActionsTest-1197709314-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:15:35.448839 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-3141b568-45ab-436e-9d59-1d4797d78aee tempest-VolumesActionsTest-1197709314 tempest-VolumesActionsTest-1197709314-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:15:35.545077 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.policy [None req-3141b568-45ab-436e-9d59-1d4797d78aee tempest-VolumesActionsTest-1197709314 tempest-VolumesActionsTest-1197709314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67e8948aca7b4a1da87d81830cc819fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ce523f87745437e9c3d6630d1fb2e51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:15:35.552652 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [None req-3141b568-45ab-436e-9d59-1d4797d78aee tempest-VolumesActionsTest-1197709314 tempest-VolumesActionsTest-1197709314-project] 10.222.0.50 "GET /compute/v2.1/servers/1a6da782-b5af-4299-b70e-71ee85178c15" status: 200 len: 1284 microversion: 2.1 time: 0.118062 Sep 24 05:15:35.553222 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 673/1317] 10.222.0.50 () {58 vars in 1236 bytes} [Sat Sep 24 05:15:35 2022] GET /compute/v2.1/servers/1a6da782-b5af-4299-b70e-71ee85178c15 => generated 1284 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 05:15:36.575936 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-33033839-ec14-4248-9b98-b20bb90a3e99 tempest-VolumesActionsTest-1197709314 tempest-VolumesActionsTest-1197709314-project] Calling method '>' {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:15:36.576546 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.compute.api [None req-33033839-ec14-4248-9b98-b20bb90a3e99 tempest-VolumesActionsTest-1197709314 tempest-VolumesActionsTest-1197709314-project] [instance: 1a6da782-b5af-4299-b70e-71ee85178c15] Fetching instance by UUID {{(pid=120593) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:15:36.584087 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-33033839-ec14-4248-9b98-b20bb90a3e99 tempest-VolumesActionsTest-1197709314 tempest-VolumesActionsTest-1197709314-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:15:36.584560 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-33033839-ec14-4248-9b98-b20bb90a3e99 tempest-VolumesActionsTest-1197709314 tempest-VolumesActionsTest-1197709314-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:15:36.584991 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-33033839-ec14-4248-9b98-b20bb90a3e99 tempest-VolumesActionsTest-1197709314 tempest-VolumesActionsTest-1197709314-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:15:36.585694 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-33033839-ec14-4248-9b98-b20bb90a3e99 tempest-VolumesActionsTest-1197709314 tempest-VolumesActionsTest-1197709314-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:15:36.586157 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-33033839-ec14-4248-9b98-b20bb90a3e99 tempest-VolumesActionsTest-1197709314 tempest-VolumesActionsTest-1197709314-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:15:36.586576 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-33033839-ec14-4248-9b98-b20bb90a3e99 tempest-VolumesActionsTest-1197709314 tempest-VolumesActionsTest-1197709314-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:15:36.728174 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [req-0f576c1b-1d04-4537-b494-eb8d7a579287 req-8bb52cc9-1888-48bc-b7d3-46f28630d07b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1a6da782-b5af-4299-b70e-71ee85178c15", "tag": "606897af-a0ea-4092-b06e-95cbde00c99d"}]} {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 05:15:36.738755 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [req-0f576c1b-1d04-4537-b494-eb8d7a579287 req-8bb52cc9-1888-48bc-b7d3-46f28630d07b service nova] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:15:36.739240 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [req-0f576c1b-1d04-4537-b494-eb8d7a579287 req-8bb52cc9-1888-48bc-b7d3-46f28630d07b service nova] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:15:36.739670 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [req-0f576c1b-1d04-4537-b494-eb8d7a579287 req-8bb52cc9-1888-48bc-b7d3-46f28630d07b service nova] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:15:36.751177 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: INFO nova.api.openstack.compute.server_external_events [req-0f576c1b-1d04-4537-b494-eb8d7a579287 req-8bb52cc9-1888-48bc-b7d3-46f28630d07b service nova] Creating event network-changed:606897af-a0ea-4092-b06e-95cbde00c99d for instance 1a6da782-b5af-4299-b70e-71ee85178c15 on hv-cinder-85918 Sep 24 05:15:36.756105 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [req-0f576c1b-1d04-4537-b494-eb8d7a579287 req-8bb52cc9-1888-48bc-b7d3-46f28630d07b service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033180 Sep 24 05:15:36.756764 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 674/1318] 10.222.0.50 () {64 vars in 1317 bytes} [Sat Sep 24 05:15:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 24 05:15:36.833406 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-33033839-ec14-4248-9b98-b20bb90a3e99 tempest-VolumesActionsTest-1197709314 tempest-VolumesActionsTest-1197709314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67e8948aca7b4a1da87d81830cc819fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ce523f87745437e9c3d6630d1fb2e51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:15:36.841736 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-33033839-ec14-4248-9b98-b20bb90a3e99 tempest-VolumesActionsTest-1197709314 tempest-VolumesActionsTest-1197709314-project] 10.222.0.50 "GET /compute/v2.1/servers/1a6da782-b5af-4299-b70e-71ee85178c15" status: 200 len: 1314 microversion: 2.1 time: 0.269732 Sep 24 05:15:36.842346 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 645/1319] 10.222.0.50 () {58 vars in 1236 bytes} [Sat Sep 24 05:15:36 2022] GET /compute/v2.1/servers/1a6da782-b5af-4299-b70e-71ee85178c15 => generated 1314 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 24 05:15:37.865592 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-00d2a98d-1298-445b-8ff2-33685143a6f7 tempest-VolumesActionsTest-1197709314 tempest-VolumesActionsTest-1197709314-project] Calling method '>' {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:15:37.866359 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.compute.api [None req-00d2a98d-1298-445b-8ff2-33685143a6f7 tempest-VolumesActionsTest-1197709314 tempest-VolumesActionsTest-1197709314-project] [instance: 1a6da782-b5af-4299-b70e-71ee85178c15] Fetching instance by UUID {{(pid=120594) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:15:37.873893 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-00d2a98d-1298-445b-8ff2-33685143a6f7 tempest-VolumesActionsTest-1197709314 tempest-VolumesActionsTest-1197709314-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:15:37.874397 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-00d2a98d-1298-445b-8ff2-33685143a6f7 tempest-VolumesActionsTest-1197709314 tempest-VolumesActionsTest-1197709314-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:15:37.874833 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-00d2a98d-1298-445b-8ff2-33685143a6f7 tempest-VolumesActionsTest-1197709314 tempest-VolumesActionsTest-1197709314-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:15:37.875518 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-00d2a98d-1298-445b-8ff2-33685143a6f7 tempest-VolumesActionsTest-1197709314 tempest-VolumesActionsTest-1197709314-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:15:37.875971 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-00d2a98d-1298-445b-8ff2-33685143a6f7 tempest-VolumesActionsTest-1197709314 tempest-VolumesActionsTest-1197709314-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:15:37.876395 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-00d2a98d-1298-445b-8ff2-33685143a6f7 tempest-VolumesActionsTest-1197709314 tempest-VolumesActionsTest-1197709314-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:15:38.001025 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.policy [None req-00d2a98d-1298-445b-8ff2-33685143a6f7 tempest-VolumesActionsTest-1197709314 tempest-VolumesActionsTest-1197709314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67e8948aca7b4a1da87d81830cc819fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ce523f87745437e9c3d6630d1fb2e51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:15:38.008557 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [None req-00d2a98d-1298-445b-8ff2-33685143a6f7 tempest-VolumesActionsTest-1197709314 tempest-VolumesActionsTest-1197709314-project] 10.222.0.50 "GET /compute/v2.1/servers/1a6da782-b5af-4299-b70e-71ee85178c15" status: 200 len: 1314 microversion: 2.1 time: 0.147323 Sep 24 05:15:38.009115 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 675/1320] 10.222.0.50 () {58 vars in 1236 bytes} [Sat Sep 24 05:15:37 2022] GET /compute/v2.1/servers/1a6da782-b5af-4299-b70e-71ee85178c15 => generated 1314 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 05:15:39.031351 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-aa40a844-2ec5-4e92-ba07-4b2e5fe5b14f tempest-VolumesActionsTest-1197709314 tempest-VolumesActionsTest-1197709314-project] Calling method '>' {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:15:39.031960 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.compute.api [None req-aa40a844-2ec5-4e92-ba07-4b2e5fe5b14f tempest-VolumesActionsTest-1197709314 tempest-VolumesActionsTest-1197709314-project] [instance: 1a6da782-b5af-4299-b70e-71ee85178c15] Fetching instance by UUID {{(pid=120593) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:15:39.038349 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-aa40a844-2ec5-4e92-ba07-4b2e5fe5b14f tempest-VolumesActionsTest-1197709314 tempest-VolumesActionsTest-1197709314-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:15:39.038824 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-aa40a844-2ec5-4e92-ba07-4b2e5fe5b14f tempest-VolumesActionsTest-1197709314 tempest-VolumesActionsTest-1197709314-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:15:39.039254 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-aa40a844-2ec5-4e92-ba07-4b2e5fe5b14f tempest-VolumesActionsTest-1197709314 tempest-VolumesActionsTest-1197709314-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:15:39.039936 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-aa40a844-2ec5-4e92-ba07-4b2e5fe5b14f tempest-VolumesActionsTest-1197709314 tempest-VolumesActionsTest-1197709314-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:15:39.040386 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-aa40a844-2ec5-4e92-ba07-4b2e5fe5b14f tempest-VolumesActionsTest-1197709314 tempest-VolumesActionsTest-1197709314-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:15:39.040803 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-aa40a844-2ec5-4e92-ba07-4b2e5fe5b14f tempest-VolumesActionsTest-1197709314 tempest-VolumesActionsTest-1197709314-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:15:39.165206 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-aa40a844-2ec5-4e92-ba07-4b2e5fe5b14f tempest-VolumesActionsTest-1197709314 tempest-VolumesActionsTest-1197709314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67e8948aca7b4a1da87d81830cc819fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ce523f87745437e9c3d6630d1fb2e51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:15:39.172746 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-aa40a844-2ec5-4e92-ba07-4b2e5fe5b14f tempest-VolumesActionsTest-1197709314 tempest-VolumesActionsTest-1197709314-project] 10.222.0.50 "GET /compute/v2.1/servers/1a6da782-b5af-4299-b70e-71ee85178c15" status: 200 len: 1314 microversion: 2.1 time: 0.146129 Sep 24 05:15:39.173316 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 646/1321] 10.222.0.50 () {58 vars in 1236 bytes} [Sat Sep 24 05:15:39 2022] GET /compute/v2.1/servers/1a6da782-b5af-4299-b70e-71ee85178c15 => generated 1314 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 05:15:40.195721 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-f31540e6-660b-40bf-ac8e-fc7f95977a18 tempest-VolumesActionsTest-1197709314 tempest-VolumesActionsTest-1197709314-project] Calling method '>' {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:15:40.196470 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.compute.api [None req-f31540e6-660b-40bf-ac8e-fc7f95977a18 tempest-VolumesActionsTest-1197709314 tempest-VolumesActionsTest-1197709314-project] [instance: 1a6da782-b5af-4299-b70e-71ee85178c15] Fetching instance by UUID {{(pid=120594) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:15:40.202876 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-f31540e6-660b-40bf-ac8e-fc7f95977a18 tempest-VolumesActionsTest-1197709314 tempest-VolumesActionsTest-1197709314-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:15:40.203356 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-f31540e6-660b-40bf-ac8e-fc7f95977a18 tempest-VolumesActionsTest-1197709314 tempest-VolumesActionsTest-1197709314-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:15:40.203977 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-f31540e6-660b-40bf-ac8e-fc7f95977a18 tempest-VolumesActionsTest-1197709314 tempest-VolumesActionsTest-1197709314-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:15:40.204672 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-f31540e6-660b-40bf-ac8e-fc7f95977a18 tempest-VolumesActionsTest-1197709314 tempest-VolumesActionsTest-1197709314-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:15:40.205121 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-f31540e6-660b-40bf-ac8e-fc7f95977a18 tempest-VolumesActionsTest-1197709314 tempest-VolumesActionsTest-1197709314-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:15:40.205538 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-f31540e6-660b-40bf-ac8e-fc7f95977a18 tempest-VolumesActionsTest-1197709314 tempest-VolumesActionsTest-1197709314-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:15:40.358663 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.policy [None req-f31540e6-660b-40bf-ac8e-fc7f95977a18 tempest-VolumesActionsTest-1197709314 tempest-VolumesActionsTest-1197709314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67e8948aca7b4a1da87d81830cc819fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ce523f87745437e9c3d6630d1fb2e51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:15:40.366208 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [None req-f31540e6-660b-40bf-ac8e-fc7f95977a18 tempest-VolumesActionsTest-1197709314 tempest-VolumesActionsTest-1197709314-project] 10.222.0.50 "GET /compute/v2.1/servers/1a6da782-b5af-4299-b70e-71ee85178c15" status: 200 len: 1314 microversion: 2.1 time: 0.174547 Sep 24 05:15:40.366769 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 676/1322] 10.222.0.50 () {58 vars in 1236 bytes} [Sat Sep 24 05:15:40 2022] GET /compute/v2.1/servers/1a6da782-b5af-4299-b70e-71ee85178c15 => generated 1314 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 05:15:41.389175 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-8d20684b-794f-4c9b-ab1b-b7f3dd7ee59f tempest-VolumesActionsTest-1197709314 tempest-VolumesActionsTest-1197709314-project] Calling method '>' {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:15:41.389882 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.compute.api [None req-8d20684b-794f-4c9b-ab1b-b7f3dd7ee59f tempest-VolumesActionsTest-1197709314 tempest-VolumesActionsTest-1197709314-project] [instance: 1a6da782-b5af-4299-b70e-71ee85178c15] Fetching instance by UUID {{(pid=120593) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:15:41.396102 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-8d20684b-794f-4c9b-ab1b-b7f3dd7ee59f tempest-VolumesActionsTest-1197709314 tempest-VolumesActionsTest-1197709314-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:15:41.396576 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-8d20684b-794f-4c9b-ab1b-b7f3dd7ee59f tempest-VolumesActionsTest-1197709314 tempest-VolumesActionsTest-1197709314-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:15:41.397004 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-8d20684b-794f-4c9b-ab1b-b7f3dd7ee59f tempest-VolumesActionsTest-1197709314 tempest-VolumesActionsTest-1197709314-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:15:41.397688 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-8d20684b-794f-4c9b-ab1b-b7f3dd7ee59f tempest-VolumesActionsTest-1197709314 tempest-VolumesActionsTest-1197709314-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:15:41.398157 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-8d20684b-794f-4c9b-ab1b-b7f3dd7ee59f tempest-VolumesActionsTest-1197709314 tempest-VolumesActionsTest-1197709314-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:15:41.398584 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-8d20684b-794f-4c9b-ab1b-b7f3dd7ee59f tempest-VolumesActionsTest-1197709314 tempest-VolumesActionsTest-1197709314-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:15:41.528636 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-8d20684b-794f-4c9b-ab1b-b7f3dd7ee59f tempest-VolumesActionsTest-1197709314 tempest-VolumesActionsTest-1197709314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67e8948aca7b4a1da87d81830cc819fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ce523f87745437e9c3d6630d1fb2e51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:15:41.536701 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-8d20684b-794f-4c9b-ab1b-b7f3dd7ee59f tempest-VolumesActionsTest-1197709314 tempest-VolumesActionsTest-1197709314-project] 10.222.0.50 "GET /compute/v2.1/servers/1a6da782-b5af-4299-b70e-71ee85178c15" status: 200 len: 1314 microversion: 2.1 time: 0.152043 Sep 24 05:15:41.537271 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 647/1323] 10.222.0.50 () {58 vars in 1236 bytes} [Sat Sep 24 05:15:41 2022] GET /compute/v2.1/servers/1a6da782-b5af-4299-b70e-71ee85178c15 => generated 1314 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 05:15:42.559190 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-28acb3bb-9321-4b7e-9db8-93762edea7bd tempest-VolumesActionsTest-1197709314 tempest-VolumesActionsTest-1197709314-project] Calling method '>' {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:15:42.559792 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.compute.api [None req-28acb3bb-9321-4b7e-9db8-93762edea7bd tempest-VolumesActionsTest-1197709314 tempest-VolumesActionsTest-1197709314-project] [instance: 1a6da782-b5af-4299-b70e-71ee85178c15] Fetching instance by UUID {{(pid=120594) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:15:42.566285 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-28acb3bb-9321-4b7e-9db8-93762edea7bd tempest-VolumesActionsTest-1197709314 tempest-VolumesActionsTest-1197709314-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:15:42.566758 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-28acb3bb-9321-4b7e-9db8-93762edea7bd tempest-VolumesActionsTest-1197709314 tempest-VolumesActionsTest-1197709314-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:15:42.567184 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-28acb3bb-9321-4b7e-9db8-93762edea7bd tempest-VolumesActionsTest-1197709314 tempest-VolumesActionsTest-1197709314-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:15:42.567862 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-28acb3bb-9321-4b7e-9db8-93762edea7bd tempest-VolumesActionsTest-1197709314 tempest-VolumesActionsTest-1197709314-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:15:42.568305 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-28acb3bb-9321-4b7e-9db8-93762edea7bd tempest-VolumesActionsTest-1197709314 tempest-VolumesActionsTest-1197709314-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:15:42.568722 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-28acb3bb-9321-4b7e-9db8-93762edea7bd tempest-VolumesActionsTest-1197709314 tempest-VolumesActionsTest-1197709314-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:15:42.803934 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.policy [None req-28acb3bb-9321-4b7e-9db8-93762edea7bd tempest-VolumesActionsTest-1197709314 tempest-VolumesActionsTest-1197709314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67e8948aca7b4a1da87d81830cc819fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ce523f87745437e9c3d6630d1fb2e51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:15:42.812073 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [None req-28acb3bb-9321-4b7e-9db8-93762edea7bd tempest-VolumesActionsTest-1197709314 tempest-VolumesActionsTest-1197709314-project] 10.222.0.50 "GET /compute/v2.1/servers/1a6da782-b5af-4299-b70e-71ee85178c15" status: 200 len: 1314 microversion: 2.1 time: 0.256669 Sep 24 05:15:42.812569 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 677/1324] 10.222.0.50 () {58 vars in 1236 bytes} [Sat Sep 24 05:15:42 2022] GET /compute/v2.1/servers/1a6da782-b5af-4299-b70e-71ee85178c15 => generated 1314 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 05:15:43.536468 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [req-a87b034b-3b06-4089-b599-8ecfc0d6e693 req-59e670cd-1714-45d2-b5c9-f8cf68db9e9e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1a6da782-b5af-4299-b70e-71ee85178c15", "name": "network-vif-plugged", "status": "completed", "tag": "606897af-a0ea-4092-b06e-95cbde00c99d"}]} {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 05:15:43.547263 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [req-a87b034b-3b06-4089-b599-8ecfc0d6e693 req-59e670cd-1714-45d2-b5c9-f8cf68db9e9e service nova] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:15:43.547737 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [req-a87b034b-3b06-4089-b599-8ecfc0d6e693 req-59e670cd-1714-45d2-b5c9-f8cf68db9e9e service nova] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:15:43.548165 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [req-a87b034b-3b06-4089-b599-8ecfc0d6e693 req-59e670cd-1714-45d2-b5c9-f8cf68db9e9e service nova] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:15:43.564530 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.compute.server_external_events [req-a87b034b-3b06-4089-b599-8ecfc0d6e693 req-59e670cd-1714-45d2-b5c9-f8cf68db9e9e service nova] Creating event network-vif-plugged:606897af-a0ea-4092-b06e-95cbde00c99d for instance 1a6da782-b5af-4299-b70e-71ee85178c15 on hv-cinder-85918 Sep 24 05:15:43.569787 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [req-a87b034b-3b06-4089-b599-8ecfc0d6e693 req-59e670cd-1714-45d2-b5c9-f8cf68db9e9e service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036973 Sep 24 05:15:43.570416 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 648/1325] 10.222.0.50 () {64 vars in 1317 bytes} [Sat Sep 24 05:15:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 24 05:15:43.836030 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-7e6c5cb4-e995-43b9-b655-bc7c5839ee22 tempest-VolumesActionsTest-1197709314 tempest-VolumesActionsTest-1197709314-project] Calling method '>' {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:15:43.836634 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.compute.api [None req-7e6c5cb4-e995-43b9-b655-bc7c5839ee22 tempest-VolumesActionsTest-1197709314 tempest-VolumesActionsTest-1197709314-project] [instance: 1a6da782-b5af-4299-b70e-71ee85178c15] Fetching instance by UUID {{(pid=120594) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:15:43.843374 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-7e6c5cb4-e995-43b9-b655-bc7c5839ee22 tempest-VolumesActionsTest-1197709314 tempest-VolumesActionsTest-1197709314-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:15:43.843845 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-7e6c5cb4-e995-43b9-b655-bc7c5839ee22 tempest-VolumesActionsTest-1197709314 tempest-VolumesActionsTest-1197709314-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:15:43.844271 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-7e6c5cb4-e995-43b9-b655-bc7c5839ee22 tempest-VolumesActionsTest-1197709314 tempest-VolumesActionsTest-1197709314-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:15:43.844947 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-7e6c5cb4-e995-43b9-b655-bc7c5839ee22 tempest-VolumesActionsTest-1197709314 tempest-VolumesActionsTest-1197709314-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:15:43.845389 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-7e6c5cb4-e995-43b9-b655-bc7c5839ee22 tempest-VolumesActionsTest-1197709314 tempest-VolumesActionsTest-1197709314-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:15:43.845800 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-7e6c5cb4-e995-43b9-b655-bc7c5839ee22 tempest-VolumesActionsTest-1197709314 tempest-VolumesActionsTest-1197709314-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:15:43.970852 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.policy [None req-7e6c5cb4-e995-43b9-b655-bc7c5839ee22 tempest-VolumesActionsTest-1197709314 tempest-VolumesActionsTest-1197709314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67e8948aca7b4a1da87d81830cc819fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ce523f87745437e9c3d6630d1fb2e51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:15:43.978462 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [None req-7e6c5cb4-e995-43b9-b655-bc7c5839ee22 tempest-VolumesActionsTest-1197709314 tempest-VolumesActionsTest-1197709314-project] 10.222.0.50 "GET /compute/v2.1/servers/1a6da782-b5af-4299-b70e-71ee85178c15" status: 200 len: 1314 microversion: 2.1 time: 0.146272 Sep 24 05:15:43.979031 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 678/1326] 10.222.0.50 () {58 vars in 1236 bytes} [Sat Sep 24 05:15:43 2022] GET /compute/v2.1/servers/1a6da782-b5af-4299-b70e-71ee85178c15 => generated 1314 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 05:15:44.998771 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG dbcounter [-] [120593] Writing DB stats nova_cell0:SELECT=2 {{(pid=120593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 05:15:45.003386 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-0c1aaa9e-0563-4407-8f0d-59f5c20e407c tempest-VolumesActionsTest-1197709314 tempest-VolumesActionsTest-1197709314-project] Calling method '>' {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:15:45.004110 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.compute.api [None req-0c1aaa9e-0563-4407-8f0d-59f5c20e407c tempest-VolumesActionsTest-1197709314 tempest-VolumesActionsTest-1197709314-project] [instance: 1a6da782-b5af-4299-b70e-71ee85178c15] Fetching instance by UUID {{(pid=120593) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:15:45.010456 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-0c1aaa9e-0563-4407-8f0d-59f5c20e407c tempest-VolumesActionsTest-1197709314 tempest-VolumesActionsTest-1197709314-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:15:45.010939 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-0c1aaa9e-0563-4407-8f0d-59f5c20e407c tempest-VolumesActionsTest-1197709314 tempest-VolumesActionsTest-1197709314-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:15:45.011373 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-0c1aaa9e-0563-4407-8f0d-59f5c20e407c tempest-VolumesActionsTest-1197709314 tempest-VolumesActionsTest-1197709314-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:15:45.012058 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-0c1aaa9e-0563-4407-8f0d-59f5c20e407c tempest-VolumesActionsTest-1197709314 tempest-VolumesActionsTest-1197709314-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:15:45.012515 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-0c1aaa9e-0563-4407-8f0d-59f5c20e407c tempest-VolumesActionsTest-1197709314 tempest-VolumesActionsTest-1197709314-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:15:45.012939 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-0c1aaa9e-0563-4407-8f0d-59f5c20e407c tempest-VolumesActionsTest-1197709314 tempest-VolumesActionsTest-1197709314-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:15:45.194892 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-0c1aaa9e-0563-4407-8f0d-59f5c20e407c tempest-VolumesActionsTest-1197709314 tempest-VolumesActionsTest-1197709314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67e8948aca7b4a1da87d81830cc819fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ce523f87745437e9c3d6630d1fb2e51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:15:45.202710 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-0c1aaa9e-0563-4407-8f0d-59f5c20e407c tempest-VolumesActionsTest-1197709314 tempest-VolumesActionsTest-1197709314-project] 10.222.0.50 "GET /compute/v2.1/servers/1a6da782-b5af-4299-b70e-71ee85178c15" status: 200 len: 1314 microversion: 2.1 time: 0.205009 Sep 24 05:15:45.203288 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 649/1327] 10.222.0.50 () {58 vars in 1236 bytes} [Sat Sep 24 05:15:44 2022] GET /compute/v2.1/servers/1a6da782-b5af-4299-b70e-71ee85178c15 => generated 1314 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 05:15:46.224667 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-3c9d4a7f-4ea8-49d2-a148-4aed4e3cbfa4 tempest-VolumesActionsTest-1197709314 tempest-VolumesActionsTest-1197709314-project] Calling method '>' {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:15:46.225261 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.compute.api [None req-3c9d4a7f-4ea8-49d2-a148-4aed4e3cbfa4 tempest-VolumesActionsTest-1197709314 tempest-VolumesActionsTest-1197709314-project] [instance: 1a6da782-b5af-4299-b70e-71ee85178c15] Fetching instance by UUID {{(pid=120594) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:15:46.227218 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG dbcounter [-] [120594] Writing DB stats nova_cell0:SELECT=2 {{(pid=120594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 05:15:46.227863 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG dbcounter [-] [120594] Writing DB stats nova_cell0:SELECT=6 {{(pid=120594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 05:15:46.234413 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-3c9d4a7f-4ea8-49d2-a148-4aed4e3cbfa4 tempest-VolumesActionsTest-1197709314 tempest-VolumesActionsTest-1197709314-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:15:46.234880 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-3c9d4a7f-4ea8-49d2-a148-4aed4e3cbfa4 tempest-VolumesActionsTest-1197709314 tempest-VolumesActionsTest-1197709314-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:15:46.235333 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-3c9d4a7f-4ea8-49d2-a148-4aed4e3cbfa4 tempest-VolumesActionsTest-1197709314 tempest-VolumesActionsTest-1197709314-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:15:46.236013 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-3c9d4a7f-4ea8-49d2-a148-4aed4e3cbfa4 tempest-VolumesActionsTest-1197709314 tempest-VolumesActionsTest-1197709314-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:15:46.236454 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-3c9d4a7f-4ea8-49d2-a148-4aed4e3cbfa4 tempest-VolumesActionsTest-1197709314 tempest-VolumesActionsTest-1197709314-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:15:46.236869 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-3c9d4a7f-4ea8-49d2-a148-4aed4e3cbfa4 tempest-VolumesActionsTest-1197709314 tempest-VolumesActionsTest-1197709314-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:15:46.362161 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.policy [None req-3c9d4a7f-4ea8-49d2-a148-4aed4e3cbfa4 tempest-VolumesActionsTest-1197709314 tempest-VolumesActionsTest-1197709314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67e8948aca7b4a1da87d81830cc819fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ce523f87745437e9c3d6630d1fb2e51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:15:46.369978 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [None req-3c9d4a7f-4ea8-49d2-a148-4aed4e3cbfa4 tempest-VolumesActionsTest-1197709314 tempest-VolumesActionsTest-1197709314-project] 10.222.0.50 "GET /compute/v2.1/servers/1a6da782-b5af-4299-b70e-71ee85178c15" status: 200 len: 1498 microversion: 2.1 time: 0.149110 Sep 24 05:15:46.371208 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 679/1328] 10.222.0.50 () {58 vars in 1236 bytes} [Sat Sep 24 05:15:46 2022] GET /compute/v2.1/servers/1a6da782-b5af-4299-b70e-71ee85178c15 => generated 1498 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 05:15:46.772121 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-69bd71c6-91d7-41bd-be16-55ef41a6f322 tempest-VolumesActionsTest-1197709314 tempest-VolumesActionsTest-1197709314-project] Calling method '>' {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:15:46.772622 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.compute.api [None req-69bd71c6-91d7-41bd-be16-55ef41a6f322 tempest-VolumesActionsTest-1197709314 tempest-VolumesActionsTest-1197709314-project] [instance: 1a6da782-b5af-4299-b70e-71ee85178c15] Fetching instance by UUID {{(pid=120593) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:15:46.779917 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-69bd71c6-91d7-41bd-be16-55ef41a6f322 tempest-VolumesActionsTest-1197709314 tempest-VolumesActionsTest-1197709314-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:15:46.780393 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-69bd71c6-91d7-41bd-be16-55ef41a6f322 tempest-VolumesActionsTest-1197709314 tempest-VolumesActionsTest-1197709314-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:15:46.780880 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-69bd71c6-91d7-41bd-be16-55ef41a6f322 tempest-VolumesActionsTest-1197709314 tempest-VolumesActionsTest-1197709314-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:15:46.781931 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-69bd71c6-91d7-41bd-be16-55ef41a6f322 tempest-VolumesActionsTest-1197709314 tempest-VolumesActionsTest-1197709314-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:15:46.781931 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-69bd71c6-91d7-41bd-be16-55ef41a6f322 tempest-VolumesActionsTest-1197709314 tempest-VolumesActionsTest-1197709314-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:15:46.782396 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-69bd71c6-91d7-41bd-be16-55ef41a6f322 tempest-VolumesActionsTest-1197709314 tempest-VolumesActionsTest-1197709314-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:15:46.807883 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.compute.api [None req-69bd71c6-91d7-41bd-be16-55ef41a6f322 tempest-VolumesActionsTest-1197709314 tempest-VolumesActionsTest-1197709314-project] [instance: 1a6da782-b5af-4299-b70e-71ee85178c15] Going to try to terminate instance {{(pid=120593) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 24 05:15:46.880621 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-69bd71c6-91d7-41bd-be16-55ef41a6f322 tempest-VolumesActionsTest-1197709314 tempest-VolumesActionsTest-1197709314-project] 10.222.0.50 "DELETE /compute/v2.1/servers/1a6da782-b5af-4299-b70e-71ee85178c15" status: 204 len: 0 microversion: 2.1 time: 0.112032 Sep 24 05:15:46.881399 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 650/1329] 10.222.0.50 () {58 vars in 1239 bytes} [Sat Sep 24 05:15:46 2022] DELETE /compute/v2.1/servers/1a6da782-b5af-4299-b70e-71ee85178c15 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 24 05:15:46.890260 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-1e3db177-b60c-41c7-b458-fd5acccf9421 tempest-VolumesActionsTest-1197709314 tempest-VolumesActionsTest-1197709314-project] Calling method '>' {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:15:46.890866 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.compute.api [None req-1e3db177-b60c-41c7-b458-fd5acccf9421 tempest-VolumesActionsTest-1197709314 tempest-VolumesActionsTest-1197709314-project] [instance: 1a6da782-b5af-4299-b70e-71ee85178c15] Fetching instance by UUID {{(pid=120594) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:15:46.896699 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-1e3db177-b60c-41c7-b458-fd5acccf9421 tempest-VolumesActionsTest-1197709314 tempest-VolumesActionsTest-1197709314-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:15:46.897167 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-1e3db177-b60c-41c7-b458-fd5acccf9421 tempest-VolumesActionsTest-1197709314 tempest-VolumesActionsTest-1197709314-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:15:46.897590 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-1e3db177-b60c-41c7-b458-fd5acccf9421 tempest-VolumesActionsTest-1197709314 tempest-VolumesActionsTest-1197709314-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:15:46.898296 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-1e3db177-b60c-41c7-b458-fd5acccf9421 tempest-VolumesActionsTest-1197709314 tempest-VolumesActionsTest-1197709314-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:15:46.898738 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-1e3db177-b60c-41c7-b458-fd5acccf9421 tempest-VolumesActionsTest-1197709314 tempest-VolumesActionsTest-1197709314-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:15:46.899153 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-1e3db177-b60c-41c7-b458-fd5acccf9421 tempest-VolumesActionsTest-1197709314 tempest-VolumesActionsTest-1197709314-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:15:47.027032 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.policy [None req-1e3db177-b60c-41c7-b458-fd5acccf9421 tempest-VolumesActionsTest-1197709314 tempest-VolumesActionsTest-1197709314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67e8948aca7b4a1da87d81830cc819fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ce523f87745437e9c3d6630d1fb2e51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:15:47.034924 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [None req-1e3db177-b60c-41c7-b458-fd5acccf9421 tempest-VolumesActionsTest-1197709314 tempest-VolumesActionsTest-1197709314-project] 10.222.0.50 "GET /compute/v2.1/servers/1a6da782-b5af-4299-b70e-71ee85178c15" status: 200 len: 1504 microversion: 2.1 time: 0.148915 Sep 24 05:15:47.035441 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 680/1330] 10.222.0.50 () {58 vars in 1236 bytes} [Sat Sep 24 05:15:46 2022] GET /compute/v2.1/servers/1a6da782-b5af-4299-b70e-71ee85178c15 => generated 1504 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 05:15:48.058892 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-b74882a9-b8f0-4eea-892d-20c70e6fce33 tempest-VolumesActionsTest-1197709314 tempest-VolumesActionsTest-1197709314-project] Calling method '>' {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:15:48.059588 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.compute.api [None req-b74882a9-b8f0-4eea-892d-20c70e6fce33 tempest-VolumesActionsTest-1197709314 tempest-VolumesActionsTest-1197709314-project] [instance: 1a6da782-b5af-4299-b70e-71ee85178c15] Fetching instance by UUID {{(pid=120593) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:15:48.066237 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-b74882a9-b8f0-4eea-892d-20c70e6fce33 tempest-VolumesActionsTest-1197709314 tempest-VolumesActionsTest-1197709314-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:15:48.066733 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-b74882a9-b8f0-4eea-892d-20c70e6fce33 tempest-VolumesActionsTest-1197709314 tempest-VolumesActionsTest-1197709314-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:15:48.067172 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-b74882a9-b8f0-4eea-892d-20c70e6fce33 tempest-VolumesActionsTest-1197709314 tempest-VolumesActionsTest-1197709314-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:15:48.067858 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-b74882a9-b8f0-4eea-892d-20c70e6fce33 tempest-VolumesActionsTest-1197709314 tempest-VolumesActionsTest-1197709314-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:15:48.068305 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-b74882a9-b8f0-4eea-892d-20c70e6fce33 tempest-VolumesActionsTest-1197709314 tempest-VolumesActionsTest-1197709314-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:15:48.068726 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-b74882a9-b8f0-4eea-892d-20c70e6fce33 tempest-VolumesActionsTest-1197709314 tempest-VolumesActionsTest-1197709314-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:15:48.197303 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-b74882a9-b8f0-4eea-892d-20c70e6fce33 tempest-VolumesActionsTest-1197709314 tempest-VolumesActionsTest-1197709314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67e8948aca7b4a1da87d81830cc819fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ce523f87745437e9c3d6630d1fb2e51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:15:48.205664 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-b74882a9-b8f0-4eea-892d-20c70e6fce33 tempest-VolumesActionsTest-1197709314 tempest-VolumesActionsTest-1197709314-project] 10.222.0.50 "GET /compute/v2.1/servers/1a6da782-b5af-4299-b70e-71ee85178c15" status: 200 len: 1504 microversion: 2.1 time: 0.151542 Sep 24 05:15:48.206277 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 651/1331] 10.222.0.50 () {58 vars in 1236 bytes} [Sat Sep 24 05:15:48 2022] GET /compute/v2.1/servers/1a6da782-b5af-4299-b70e-71ee85178c15 => generated 1504 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 05:15:48.858695 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [req-d28c62d5-94fc-4f39-ab95-21aaddab4a71 req-f5825276-539e-4992-9968-18ce0e543bb6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1a6da782-b5af-4299-b70e-71ee85178c15", "name": "network-vif-deleted", "tag": "606897af-a0ea-4092-b06e-95cbde00c99d"}]} {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 05:15:48.873846 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [req-d28c62d5-94fc-4f39-ab95-21aaddab4a71 req-f5825276-539e-4992-9968-18ce0e543bb6 service nova] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:15:48.874639 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [req-d28c62d5-94fc-4f39-ab95-21aaddab4a71 req-f5825276-539e-4992-9968-18ce0e543bb6 service nova] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:15:48.875076 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [req-d28c62d5-94fc-4f39-ab95-21aaddab4a71 req-f5825276-539e-4992-9968-18ce0e543bb6 service nova] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:15:48.888598 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: INFO nova.api.openstack.compute.server_external_events [req-d28c62d5-94fc-4f39-ab95-21aaddab4a71 req-f5825276-539e-4992-9968-18ce0e543bb6 service nova] Creating event network-vif-deleted:606897af-a0ea-4092-b06e-95cbde00c99d for instance 1a6da782-b5af-4299-b70e-71ee85178c15 on hv-cinder-85918 Sep 24 05:15:48.894650 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [req-d28c62d5-94fc-4f39-ab95-21aaddab4a71 req-f5825276-539e-4992-9968-18ce0e543bb6 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041705 Sep 24 05:15:48.895253 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 681/1332] 10.222.0.50 () {64 vars in 1317 bytes} [Sat Sep 24 05:15:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 24 05:15:49.228561 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-6a5f7ee8-20ef-4dee-b065-415095588344 tempest-VolumesActionsTest-1197709314 tempest-VolumesActionsTest-1197709314-project] Calling method '>' {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:15:49.229171 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.compute.api [None req-6a5f7ee8-20ef-4dee-b065-415095588344 tempest-VolumesActionsTest-1197709314 tempest-VolumesActionsTest-1197709314-project] [instance: 1a6da782-b5af-4299-b70e-71ee85178c15] Fetching instance by UUID {{(pid=120593) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:15:49.235618 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-6a5f7ee8-20ef-4dee-b065-415095588344 tempest-VolumesActionsTest-1197709314 tempest-VolumesActionsTest-1197709314-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:15:49.236095 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-6a5f7ee8-20ef-4dee-b065-415095588344 tempest-VolumesActionsTest-1197709314 tempest-VolumesActionsTest-1197709314-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:15:49.236530 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-6a5f7ee8-20ef-4dee-b065-415095588344 tempest-VolumesActionsTest-1197709314 tempest-VolumesActionsTest-1197709314-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:15:49.237218 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-6a5f7ee8-20ef-4dee-b065-415095588344 tempest-VolumesActionsTest-1197709314 tempest-VolumesActionsTest-1197709314-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:15:49.237671 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-6a5f7ee8-20ef-4dee-b065-415095588344 tempest-VolumesActionsTest-1197709314 tempest-VolumesActionsTest-1197709314-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:15:49.238200 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-6a5f7ee8-20ef-4dee-b065-415095588344 tempest-VolumesActionsTest-1197709314 tempest-VolumesActionsTest-1197709314-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:15:49.268211 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-6a5f7ee8-20ef-4dee-b065-415095588344 tempest-VolumesActionsTest-1197709314 tempest-VolumesActionsTest-1197709314-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:15:49.268679 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-6a5f7ee8-20ef-4dee-b065-415095588344 tempest-VolumesActionsTest-1197709314 tempest-VolumesActionsTest-1197709314-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:15:49.269108 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-6a5f7ee8-20ef-4dee-b065-415095588344 tempest-VolumesActionsTest-1197709314 tempest-VolumesActionsTest-1197709314-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:15:49.269549 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.objects.instance [None req-6a5f7ee8-20ef-4dee-b065-415095588344 tempest-VolumesActionsTest-1197709314 tempest-VolumesActionsTest-1197709314-project] Lazy-loading 'fault' on Instance uuid 1a6da782-b5af-4299-b70e-71ee85178c15 {{(pid=120593) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 24 05:15:49.309924 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-6a5f7ee8-20ef-4dee-b065-415095588344 tempest-VolumesActionsTest-1197709314 tempest-VolumesActionsTest-1197709314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67e8948aca7b4a1da87d81830cc819fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ce523f87745437e9c3d6630d1fb2e51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:15:49.317435 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-6a5f7ee8-20ef-4dee-b065-415095588344 tempest-VolumesActionsTest-1197709314 tempest-VolumesActionsTest-1197709314-project] 10.222.0.50 "GET /compute/v2.1/servers/1a6da782-b5af-4299-b70e-71ee85178c15" status: 200 len: 1304 microversion: 2.1 time: 0.092844 Sep 24 05:15:49.318022 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 652/1333] 10.222.0.50 () {58 vars in 1236 bytes} [Sat Sep 24 05:15:49 2022] GET /compute/v2.1/servers/1a6da782-b5af-4299-b70e-71ee85178c15 => generated 1304 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 05:15:50.341815 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-b6e557a2-8fa9-42fa-9b80-139831230c42 tempest-VolumesActionsTest-1197709314 tempest-VolumesActionsTest-1197709314-project] Calling method '>' {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:15:50.342526 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.compute.api [None req-b6e557a2-8fa9-42fa-9b80-139831230c42 tempest-VolumesActionsTest-1197709314 tempest-VolumesActionsTest-1197709314-project] [instance: 1a6da782-b5af-4299-b70e-71ee85178c15] Fetching instance by UUID {{(pid=120594) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:15:50.349074 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-b6e557a2-8fa9-42fa-9b80-139831230c42 tempest-VolumesActionsTest-1197709314 tempest-VolumesActionsTest-1197709314-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:15:50.349546 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-b6e557a2-8fa9-42fa-9b80-139831230c42 tempest-VolumesActionsTest-1197709314 tempest-VolumesActionsTest-1197709314-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:15:50.349971 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-b6e557a2-8fa9-42fa-9b80-139831230c42 tempest-VolumesActionsTest-1197709314 tempest-VolumesActionsTest-1197709314-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:15:50.350674 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-b6e557a2-8fa9-42fa-9b80-139831230c42 tempest-VolumesActionsTest-1197709314 tempest-VolumesActionsTest-1197709314-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:15:50.351113 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-b6e557a2-8fa9-42fa-9b80-139831230c42 tempest-VolumesActionsTest-1197709314 tempest-VolumesActionsTest-1197709314-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:15:50.351527 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-b6e557a2-8fa9-42fa-9b80-139831230c42 tempest-VolumesActionsTest-1197709314 tempest-VolumesActionsTest-1197709314-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:15:50.364952 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: INFO nova.api.openstack.wsgi [None req-b6e557a2-8fa9-42fa-9b80-139831230c42 tempest-VolumesActionsTest-1197709314 tempest-VolumesActionsTest-1197709314-project] HTTP exception thrown: Instance 1a6da782-b5af-4299-b70e-71ee85178c15 could not be found. Sep 24 05:15:50.366553 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-b6e557a2-8fa9-42fa-9b80-139831230c42 tempest-VolumesActionsTest-1197709314 tempest-VolumesActionsTest-1197709314-project] Request method failure captured: Sep 24 05:15:50.366553 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: request: GET /compute/v2.1/servers/1a6da782-b5af-4299-b70e-71ee85178c15 HTTP/1.1 Sep 24 05:15:50.366553 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: Accept: application/json Sep 24 05:15:50.366553 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: Accept-Encoding: identity Sep 24 05:15:50.366553 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: Connection: close Sep 24 05:15:50.366553 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: Content-Length: 0 Sep 24 05:15:50.366553 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: Content-Type: application/json Sep 24 05:15:50.366553 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: Host: 10.222.0.50 Sep 24 05:15:50.366553 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: Openstack-System-Scope: None Sep 24 05:15:50.366553 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: User-Agent: python-urllib3/1.26.12 Sep 24 05:15:50.366553 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: X-Auth-Token: gAAAAABjLpJ0n-JhoCWaENLpr9CN1RlLuizZJdDQjEbunqLI16BvgJ1o5rz11M2w22uAyK1o-vnxUvZ5KiTHDrPf7fzbPW80Pi4Rvt9U0IdYIYn2YkGU_z0dSQ3Im6kRbiPGnyHgkQqNO0uxe5J_UNFkjfj_NOdt9tN1so6-6ENpcZwlMTHJBFY Sep 24 05:15:50.366553 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: X-Domain-Id: None Sep 24 05:15:50.366553 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: X-Domain-Name: None Sep 24 05:15:50.366553 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: X-Identity-Status: Confirmed Sep 24 05:15:50.366553 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: X-Is-Admin-Project: True Sep 24 05:15:50.366553 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: X-Project-Domain-Id: default Sep 24 05:15:50.366553 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: X-Project-Domain-Name: Default Sep 24 05:15:50.366553 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: X-Project-Id: 0ce523f87745437e9c3d6630d1fb2e51 Sep 24 05:15:50.366553 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: X-Project-Name: tempest-VolumesActionsTest-1197709314 Sep 24 05:15:50.366553 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: X-Role: member,reader Sep 24 05:15:50.366553 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: X-Roles: member,reader Sep 24 05:15:50.368367 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/0ce523f87745437e9c3d6630d1fb2e51"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/0ce523f87745437e9c3d6630d1fb2e51"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/0ce523f87745437e9c3d6630d1fb2e51"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.50:8080", "publicURL": "http://10.222.0.50:8080/v1/AUTH_0ce523f87745437e9c3d6630d1fb2e51"}]}] Sep 24 05:15:50.368367 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: X-Tenant: tempest-VolumesActionsTest-1197709314 Sep 24 05:15:50.368367 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: X-Tenant-Id: 0ce523f87745437e9c3d6630d1fb2e51 Sep 24 05:15:50.368367 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: X-Tenant-Name: tempest-VolumesActionsTest-1197709314 Sep 24 05:15:50.368367 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: X-User: tempest-VolumesActionsTest-1197709314-project Sep 24 05:15:50.368367 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: X-User-Domain-Id: default Sep 24 05:15:50.368367 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: X-User-Domain-Name: Default Sep 24 05:15:50.368367 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: X-User-Id: 67e8948aca7b4a1da87d81830cc819fe Sep 24 05:15:50.368367 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: X-User-Name: tempest-VolumesActionsTest-1197709314-project Sep 24 05:15:50.368367 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: method: > Sep 24 05:15:50.368367 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: exception: Instance 1a6da782-b5af-4299-b70e-71ee85178c15 could not be found. Sep 24 05:15:50.368367 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: action_args: {'id': '1a6da782-b5af-4299-b70e-71ee85178c15'} Sep 24 05:15:50.369436 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 24 05:15:50.369436 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 05:15:50.369436 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 24 05:15:50.369436 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 24 05:15:50.369436 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 24 05:15:50.369436 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 24 05:15:50.369436 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 24 05:15:50.369436 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 24 05:15:50.369436 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 24 05:15:50.369436 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 24 05:15:50.369436 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1a6da782-b5af-4299-b70e-71ee85178c15 could not be found. Sep 24 05:15:50.369436 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi Sep 24 05:15:50.369436 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 05:15:50.369436 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi Sep 24 05:15:50.369436 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 05:15:50.369436 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 05:15:50.369436 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 05:15:50.369436 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 24 05:15:50.369436 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 24 05:15:50.369436 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 24 05:15:50.371529 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 24 05:15:50.371529 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 24 05:15:50.371529 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 24 05:15:50.371529 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 24 05:15:50.371529 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 24 05:15:50.371529 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 24 05:15:50.371529 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 24 05:15:50.371529 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1a6da782-b5af-4299-b70e-71ee85178c15 could not be found. Sep 24 05:15:50.371529 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi Sep 24 05:15:50.371529 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 05:15:50.371529 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi Sep 24 05:15:50.371529 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 05:15:50.371529 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 05:15:50.371529 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 05:15:50.371529 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 24 05:15:50.371529 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 24 05:15:50.371529 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1a6da782-b5af-4299-b70e-71ee85178c15 could not be found. Sep 24 05:15:50.371529 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi Sep 24 05:15:50.373034 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-b6e557a2-8fa9-42fa-9b80-139831230c42 tempest-VolumesActionsTest-1197709314 tempest-VolumesActionsTest-1197709314-project] Returning 404 to user: Instance 1a6da782-b5af-4299-b70e-71ee85178c15 could not be found. {{(pid=120594) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 24 05:15:50.373034 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [None req-b6e557a2-8fa9-42fa-9b80-139831230c42 tempest-VolumesActionsTest-1197709314 tempest-VolumesActionsTest-1197709314-project] 10.222.0.50 "GET /compute/v2.1/servers/1a6da782-b5af-4299-b70e-71ee85178c15" status: 404 len: 111 microversion: 2.1 time: 0.031106 Sep 24 05:15:50.373034 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 682/1334] 10.222.0.50 () {58 vars in 1236 bytes} [Sat Sep 24 05:15:50 2022] GET /compute/v2.1/servers/1a6da782-b5af-4299-b70e-71ee85178c15 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 24 05:15:50.416413 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-6f7452e3-ae34-498a-b1a4-4912da6be6b1 tempest-VolumesActionsTest-1197709314 tempest-VolumesActionsTest-1197709314-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1325472868", "imageRef": "75ab730a-d8cc-4ea2-b58f-0f3eb476c976", "flavorRef": "452", "networks": [{"uuid": "7657fa99-1efa-43a4-86ce-ec9364576730"}]}} {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 05:15:50.468572 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.network.neutron [None req-6f7452e3-ae34-498a-b1a4-4912da6be6b1 tempest-VolumesActionsTest-1197709314 tempest-VolumesActionsTest-1197709314-project] validate_networks() for [('7657fa99-1efa-43a4-86ce-ec9364576730', None, None, None, None, None)] {{(pid=120593) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 24 05:15:50.808595 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.virt.hardware [None req-6f7452e3-ae34-498a-b1a4-4912da6be6b1 tempest-VolumesActionsTest-1197709314 tempest-VolumesActionsTest-1197709314-project] Flavor limits 0:0:0 {{(pid=120593) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 24 05:15:50.809009 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.virt.hardware [None req-6f7452e3-ae34-498a-b1a4-4912da6be6b1 tempest-VolumesActionsTest-1197709314 tempest-VolumesActionsTest-1197709314-project] Image limits 0:0:0 {{(pid=120593) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 24 05:15:50.809481 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.virt.hardware [None req-6f7452e3-ae34-498a-b1a4-4912da6be6b1 tempest-VolumesActionsTest-1197709314 tempest-VolumesActionsTest-1197709314-project] Flavor pref 0:0:0 {{(pid=120593) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 24 05:15:50.809883 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.virt.hardware [None req-6f7452e3-ae34-498a-b1a4-4912da6be6b1 tempest-VolumesActionsTest-1197709314 tempest-VolumesActionsTest-1197709314-project] Image pref 0:0:0 {{(pid=120593) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 24 05:15:50.810441 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.virt.hardware [None req-6f7452e3-ae34-498a-b1a4-4912da6be6b1 tempest-VolumesActionsTest-1197709314 tempest-VolumesActionsTest-1197709314-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120593) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 24 05:15:50.819261 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-6f7452e3-ae34-498a-b1a4-4912da6be6b1 tempest-VolumesActionsTest-1197709314 tempest-VolumesActionsTest-1197709314-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:15:50.819764 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-6f7452e3-ae34-498a-b1a4-4912da6be6b1 tempest-VolumesActionsTest-1197709314 tempest-VolumesActionsTest-1197709314-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:15:50.820218 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-6f7452e3-ae34-498a-b1a4-4912da6be6b1 tempest-VolumesActionsTest-1197709314 tempest-VolumesActionsTest-1197709314-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:15:50.820937 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-6f7452e3-ae34-498a-b1a4-4912da6be6b1 tempest-VolumesActionsTest-1197709314 tempest-VolumesActionsTest-1197709314-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:15:50.821384 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-6f7452e3-ae34-498a-b1a4-4912da6be6b1 tempest-VolumesActionsTest-1197709314 tempest-VolumesActionsTest-1197709314-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:15:50.821834 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-6f7452e3-ae34-498a-b1a4-4912da6be6b1 tempest-VolumesActionsTest-1197709314 tempest-VolumesActionsTest-1197709314-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:15:50.838321 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.quota [None req-6f7452e3-ae34-498a-b1a4-4912da6be6b1 tempest-VolumesActionsTest-1197709314 tempest-VolumesActionsTest-1197709314-project] Getting quotas for project 0ce523f87745437e9c3d6630d1fb2e51. Resources: {'instances', 'ram', 'cores'} {{(pid=120593) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 24 05:15:50.842878 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.quota [None req-6f7452e3-ae34-498a-b1a4-4912da6be6b1 tempest-VolumesActionsTest-1197709314 tempest-VolumesActionsTest-1197709314-project] Getting quotas for user 67e8948aca7b4a1da87d81830cc819fe and project 0ce523f87745437e9c3d6630d1fb2e51. Resources: {'instances', 'ram', 'cores'} {{(pid=120593) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 24 05:15:50.853438 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.compute.api [None req-6f7452e3-ae34-498a-b1a4-4912da6be6b1 tempest-VolumesActionsTest-1197709314 tempest-VolumesActionsTest-1197709314-project] Going to run 1 instances... {{(pid=120593) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 24 05:15:50.855753 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.compute.api [None req-6f7452e3-ae34-498a-b1a4-4912da6be6b1 tempest-VolumesActionsTest-1197709314 tempest-VolumesActionsTest-1197709314-project] [instance: 1134e812-41e9-4532-a9af-e1d267d7ce74] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='75ab730a-d8cc-4ea2-b58f-0f3eb476c976',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120593) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 24 05:15:50.900107 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-6f7452e3-ae34-498a-b1a4-4912da6be6b1 tempest-VolumesActionsTest-1197709314 tempest-VolumesActionsTest-1197709314-project] 10.222.0.50 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.487342 Sep 24 05:15:50.900674 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 653/1335] 10.222.0.50 () {60 vars in 1147 bytes} [Sat Sep 24 05:15:50 2022] POST /compute/v2.1/servers => generated 380 bytes in 489 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 24 05:15:50.912361 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-0d209f3f-b342-452d-8b55-49dd1712c3c7 tempest-VolumesActionsTest-1197709314 tempest-VolumesActionsTest-1197709314-project] Calling method '>' {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:15:50.912961 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.compute.api [None req-0d209f3f-b342-452d-8b55-49dd1712c3c7 tempest-VolumesActionsTest-1197709314 tempest-VolumesActionsTest-1197709314-project] [instance: 1134e812-41e9-4532-a9af-e1d267d7ce74] Fetching instance by UUID {{(pid=120594) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:15:50.965657 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.policy [None req-0d209f3f-b342-452d-8b55-49dd1712c3c7 tempest-VolumesActionsTest-1197709314 tempest-VolumesActionsTest-1197709314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67e8948aca7b4a1da87d81830cc819fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ce523f87745437e9c3d6630d1fb2e51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:15:50.972442 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [None req-0d209f3f-b342-452d-8b55-49dd1712c3c7 tempest-VolumesActionsTest-1197709314 tempest-VolumesActionsTest-1197709314-project] 10.222.0.50 "GET /compute/v2.1/servers/1134e812-41e9-4532-a9af-e1d267d7ce74" status: 200 len: 1214 microversion: 2.1 time: 0.063886 Sep 24 05:15:50.973035 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 683/1336] 10.222.0.50 () {58 vars in 1236 bytes} [Sat Sep 24 05:15:50 2022] GET /compute/v2.1/servers/1134e812-41e9-4532-a9af-e1d267d7ce74 => generated 1214 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 05:15:51.994500 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-cbc10042-cc0a-4d1e-8ef3-b0e5f68fc3d2 tempest-VolumesActionsTest-1197709314 tempest-VolumesActionsTest-1197709314-project] Calling method '>' {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:15:51.995160 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.compute.api [None req-cbc10042-cc0a-4d1e-8ef3-b0e5f68fc3d2 tempest-VolumesActionsTest-1197709314 tempest-VolumesActionsTest-1197709314-project] [instance: 1134e812-41e9-4532-a9af-e1d267d7ce74] Fetching instance by UUID {{(pid=120593) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:15:52.006565 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-cbc10042-cc0a-4d1e-8ef3-b0e5f68fc3d2 tempest-VolumesActionsTest-1197709314 tempest-VolumesActionsTest-1197709314-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:15:52.007060 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-cbc10042-cc0a-4d1e-8ef3-b0e5f68fc3d2 tempest-VolumesActionsTest-1197709314 tempest-VolumesActionsTest-1197709314-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:15:52.007515 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-cbc10042-cc0a-4d1e-8ef3-b0e5f68fc3d2 tempest-VolumesActionsTest-1197709314 tempest-VolumesActionsTest-1197709314-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:15:52.008525 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-cbc10042-cc0a-4d1e-8ef3-b0e5f68fc3d2 tempest-VolumesActionsTest-1197709314 tempest-VolumesActionsTest-1197709314-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:15:52.008988 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-cbc10042-cc0a-4d1e-8ef3-b0e5f68fc3d2 tempest-VolumesActionsTest-1197709314 tempest-VolumesActionsTest-1197709314-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:15:52.009436 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-cbc10042-cc0a-4d1e-8ef3-b0e5f68fc3d2 tempest-VolumesActionsTest-1197709314 tempest-VolumesActionsTest-1197709314-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:15:52.107230 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-cbc10042-cc0a-4d1e-8ef3-b0e5f68fc3d2 tempest-VolumesActionsTest-1197709314 tempest-VolumesActionsTest-1197709314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67e8948aca7b4a1da87d81830cc819fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ce523f87745437e9c3d6630d1fb2e51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:15:52.115858 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-cbc10042-cc0a-4d1e-8ef3-b0e5f68fc3d2 tempest-VolumesActionsTest-1197709314 tempest-VolumesActionsTest-1197709314-project] 10.222.0.50 "GET /compute/v2.1/servers/1134e812-41e9-4532-a9af-e1d267d7ce74" status: 200 len: 1274 microversion: 2.1 time: 0.124489 Sep 24 05:15:52.115858 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 654/1337] 10.222.0.50 () {58 vars in 1236 bytes} [Sat Sep 24 05:15:51 2022] GET /compute/v2.1/servers/1134e812-41e9-4532-a9af-e1d267d7ce74 => generated 1274 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 05:15:53.137445 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-1a855bef-ad9b-415a-982e-1c5ba95bdcb5 tempest-VolumesActionsTest-1197709314 tempest-VolumesActionsTest-1197709314-project] Calling method '>' {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:15:53.138137 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.compute.api [None req-1a855bef-ad9b-415a-982e-1c5ba95bdcb5 tempest-VolumesActionsTest-1197709314 tempest-VolumesActionsTest-1197709314-project] [instance: 1134e812-41e9-4532-a9af-e1d267d7ce74] Fetching instance by UUID {{(pid=120594) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:15:53.146076 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-1a855bef-ad9b-415a-982e-1c5ba95bdcb5 tempest-VolumesActionsTest-1197709314 tempest-VolumesActionsTest-1197709314-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:15:53.146557 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-1a855bef-ad9b-415a-982e-1c5ba95bdcb5 tempest-VolumesActionsTest-1197709314 tempest-VolumesActionsTest-1197709314-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:15:53.146985 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-1a855bef-ad9b-415a-982e-1c5ba95bdcb5 tempest-VolumesActionsTest-1197709314 tempest-VolumesActionsTest-1197709314-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:15:53.147673 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-1a855bef-ad9b-415a-982e-1c5ba95bdcb5 tempest-VolumesActionsTest-1197709314 tempest-VolumesActionsTest-1197709314-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:15:53.148113 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-1a855bef-ad9b-415a-982e-1c5ba95bdcb5 tempest-VolumesActionsTest-1197709314 tempest-VolumesActionsTest-1197709314-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:15:53.148527 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-1a855bef-ad9b-415a-982e-1c5ba95bdcb5 tempest-VolumesActionsTest-1197709314 tempest-VolumesActionsTest-1197709314-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:15:53.342656 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.policy [None req-1a855bef-ad9b-415a-982e-1c5ba95bdcb5 tempest-VolumesActionsTest-1197709314 tempest-VolumesActionsTest-1197709314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67e8948aca7b4a1da87d81830cc819fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ce523f87745437e9c3d6630d1fb2e51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:15:53.350191 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [None req-1a855bef-ad9b-415a-982e-1c5ba95bdcb5 tempest-VolumesActionsTest-1197709314 tempest-VolumesActionsTest-1197709314-project] 10.222.0.50 "GET /compute/v2.1/servers/1134e812-41e9-4532-a9af-e1d267d7ce74" status: 200 len: 1314 microversion: 2.1 time: 0.216826 Sep 24 05:15:53.350747 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 684/1338] 10.222.0.50 () {58 vars in 1236 bytes} [Sat Sep 24 05:15:53 2022] GET /compute/v2.1/servers/1134e812-41e9-4532-a9af-e1d267d7ce74 => generated 1314 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 05:15:53.418926 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [req-e06955f1-1784-4ada-8479-a2cdf10475e7 req-7e9cd9a7-02b1-4452-9137-1f8534d2abf8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1134e812-41e9-4532-a9af-e1d267d7ce74", "tag": "972b071d-782c-4431-b178-52f6a28b21b3"}]} {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 05:15:53.433179 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [req-e06955f1-1784-4ada-8479-a2cdf10475e7 req-7e9cd9a7-02b1-4452-9137-1f8534d2abf8 service nova] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:15:53.433664 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [req-e06955f1-1784-4ada-8479-a2cdf10475e7 req-7e9cd9a7-02b1-4452-9137-1f8534d2abf8 service nova] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:15:53.434130 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [req-e06955f1-1784-4ada-8479-a2cdf10475e7 req-7e9cd9a7-02b1-4452-9137-1f8534d2abf8 service nova] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:15:53.446709 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.compute.server_external_events [req-e06955f1-1784-4ada-8479-a2cdf10475e7 req-7e9cd9a7-02b1-4452-9137-1f8534d2abf8 service nova] Creating event network-changed:972b071d-782c-4431-b178-52f6a28b21b3 for instance 1134e812-41e9-4532-a9af-e1d267d7ce74 on hv-cinder-85918 Sep 24 05:15:53.452521 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [req-e06955f1-1784-4ada-8479-a2cdf10475e7 req-7e9cd9a7-02b1-4452-9137-1f8534d2abf8 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038236 Sep 24 05:15:53.453822 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 655/1339] 10.222.0.50 () {64 vars in 1317 bytes} [Sat Sep 24 05:15:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 24 05:15:54.373191 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-354e2f3e-a238-4bb7-ab47-355eff151042 tempest-VolumesActionsTest-1197709314 tempest-VolumesActionsTest-1197709314-project] Calling method '>' {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:15:54.373797 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.compute.api [None req-354e2f3e-a238-4bb7-ab47-355eff151042 tempest-VolumesActionsTest-1197709314 tempest-VolumesActionsTest-1197709314-project] [instance: 1134e812-41e9-4532-a9af-e1d267d7ce74] Fetching instance by UUID {{(pid=120594) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:15:54.380287 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-354e2f3e-a238-4bb7-ab47-355eff151042 tempest-VolumesActionsTest-1197709314 tempest-VolumesActionsTest-1197709314-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:15:54.380769 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-354e2f3e-a238-4bb7-ab47-355eff151042 tempest-VolumesActionsTest-1197709314 tempest-VolumesActionsTest-1197709314-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:15:54.381202 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-354e2f3e-a238-4bb7-ab47-355eff151042 tempest-VolumesActionsTest-1197709314 tempest-VolumesActionsTest-1197709314-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:15:54.381888 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-354e2f3e-a238-4bb7-ab47-355eff151042 tempest-VolumesActionsTest-1197709314 tempest-VolumesActionsTest-1197709314-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:15:54.382365 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-354e2f3e-a238-4bb7-ab47-355eff151042 tempest-VolumesActionsTest-1197709314 tempest-VolumesActionsTest-1197709314-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:15:54.382787 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-354e2f3e-a238-4bb7-ab47-355eff151042 tempest-VolumesActionsTest-1197709314 tempest-VolumesActionsTest-1197709314-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:15:54.512683 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.policy [None req-354e2f3e-a238-4bb7-ab47-355eff151042 tempest-VolumesActionsTest-1197709314 tempest-VolumesActionsTest-1197709314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67e8948aca7b4a1da87d81830cc819fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ce523f87745437e9c3d6630d1fb2e51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:15:54.520424 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [None req-354e2f3e-a238-4bb7-ab47-355eff151042 tempest-VolumesActionsTest-1197709314 tempest-VolumesActionsTest-1197709314-project] 10.222.0.50 "GET /compute/v2.1/servers/1134e812-41e9-4532-a9af-e1d267d7ce74" status: 200 len: 1314 microversion: 2.1 time: 0.151638 Sep 24 05:15:54.520982 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 685/1340] 10.222.0.50 () {58 vars in 1236 bytes} [Sat Sep 24 05:15:54 2022] GET /compute/v2.1/servers/1134e812-41e9-4532-a9af-e1d267d7ce74 => generated 1314 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 05:15:55.543852 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-d542cf9a-441a-48e2-968a-48bbdc67f45d tempest-VolumesActionsTest-1197709314 tempest-VolumesActionsTest-1197709314-project] Calling method '>' {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:15:55.544641 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.compute.api [None req-d542cf9a-441a-48e2-968a-48bbdc67f45d tempest-VolumesActionsTest-1197709314 tempest-VolumesActionsTest-1197709314-project] [instance: 1134e812-41e9-4532-a9af-e1d267d7ce74] Fetching instance by UUID {{(pid=120593) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:15:55.551413 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-d542cf9a-441a-48e2-968a-48bbdc67f45d tempest-VolumesActionsTest-1197709314 tempest-VolumesActionsTest-1197709314-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:15:55.551889 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-d542cf9a-441a-48e2-968a-48bbdc67f45d tempest-VolumesActionsTest-1197709314 tempest-VolumesActionsTest-1197709314-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:15:55.552326 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-d542cf9a-441a-48e2-968a-48bbdc67f45d tempest-VolumesActionsTest-1197709314 tempest-VolumesActionsTest-1197709314-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:15:55.553007 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-d542cf9a-441a-48e2-968a-48bbdc67f45d tempest-VolumesActionsTest-1197709314 tempest-VolumesActionsTest-1197709314-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:15:55.553455 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-d542cf9a-441a-48e2-968a-48bbdc67f45d tempest-VolumesActionsTest-1197709314 tempest-VolumesActionsTest-1197709314-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:15:55.554028 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-d542cf9a-441a-48e2-968a-48bbdc67f45d tempest-VolumesActionsTest-1197709314 tempest-VolumesActionsTest-1197709314-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:15:55.681049 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-d542cf9a-441a-48e2-968a-48bbdc67f45d tempest-VolumesActionsTest-1197709314 tempest-VolumesActionsTest-1197709314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67e8948aca7b4a1da87d81830cc819fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ce523f87745437e9c3d6630d1fb2e51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:15:55.689207 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-d542cf9a-441a-48e2-968a-48bbdc67f45d tempest-VolumesActionsTest-1197709314 tempest-VolumesActionsTest-1197709314-project] 10.222.0.50 "GET /compute/v2.1/servers/1134e812-41e9-4532-a9af-e1d267d7ce74" status: 200 len: 1314 microversion: 2.1 time: 0.149727 Sep 24 05:15:55.689765 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 656/1341] 10.222.0.50 () {58 vars in 1236 bytes} [Sat Sep 24 05:15:55 2022] GET /compute/v2.1/servers/1134e812-41e9-4532-a9af-e1d267d7ce74 => generated 1314 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 05:15:56.712136 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-70676240-85e0-4383-bee8-b57b26fadc7d tempest-VolumesActionsTest-1197709314 tempest-VolumesActionsTest-1197709314-project] Calling method '>' {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:15:56.712738 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.compute.api [None req-70676240-85e0-4383-bee8-b57b26fadc7d tempest-VolumesActionsTest-1197709314 tempest-VolumesActionsTest-1197709314-project] [instance: 1134e812-41e9-4532-a9af-e1d267d7ce74] Fetching instance by UUID {{(pid=120594) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:15:56.719822 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-70676240-85e0-4383-bee8-b57b26fadc7d tempest-VolumesActionsTest-1197709314 tempest-VolumesActionsTest-1197709314-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:15:56.720296 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-70676240-85e0-4383-bee8-b57b26fadc7d tempest-VolumesActionsTest-1197709314 tempest-VolumesActionsTest-1197709314-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:15:56.720727 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-70676240-85e0-4383-bee8-b57b26fadc7d tempest-VolumesActionsTest-1197709314 tempest-VolumesActionsTest-1197709314-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:15:56.721413 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-70676240-85e0-4383-bee8-b57b26fadc7d tempest-VolumesActionsTest-1197709314 tempest-VolumesActionsTest-1197709314-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:15:56.721857 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-70676240-85e0-4383-bee8-b57b26fadc7d tempest-VolumesActionsTest-1197709314 tempest-VolumesActionsTest-1197709314-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:15:56.722304 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-70676240-85e0-4383-bee8-b57b26fadc7d tempest-VolumesActionsTest-1197709314 tempest-VolumesActionsTest-1197709314-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:15:56.846317 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.policy [None req-70676240-85e0-4383-bee8-b57b26fadc7d tempest-VolumesActionsTest-1197709314 tempest-VolumesActionsTest-1197709314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67e8948aca7b4a1da87d81830cc819fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ce523f87745437e9c3d6630d1fb2e51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:15:56.853833 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [None req-70676240-85e0-4383-bee8-b57b26fadc7d tempest-VolumesActionsTest-1197709314 tempest-VolumesActionsTest-1197709314-project] 10.222.0.50 "GET /compute/v2.1/servers/1134e812-41e9-4532-a9af-e1d267d7ce74" status: 200 len: 1314 microversion: 2.1 time: 0.145683 Sep 24 05:15:56.854803 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 686/1342] 10.222.0.50 () {58 vars in 1236 bytes} [Sat Sep 24 05:15:56 2022] GET /compute/v2.1/servers/1134e812-41e9-4532-a9af-e1d267d7ce74 => generated 1314 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 05:15:57.876037 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-9f1c364e-1d2c-47bc-a0f6-fbbf22b304bb tempest-VolumesActionsTest-1197709314 tempest-VolumesActionsTest-1197709314-project] Calling method '>' {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:15:57.876642 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.compute.api [None req-9f1c364e-1d2c-47bc-a0f6-fbbf22b304bb tempest-VolumesActionsTest-1197709314 tempest-VolumesActionsTest-1197709314-project] [instance: 1134e812-41e9-4532-a9af-e1d267d7ce74] Fetching instance by UUID {{(pid=120593) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:15:57.883048 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-9f1c364e-1d2c-47bc-a0f6-fbbf22b304bb tempest-VolumesActionsTest-1197709314 tempest-VolumesActionsTest-1197709314-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:15:57.883522 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-9f1c364e-1d2c-47bc-a0f6-fbbf22b304bb tempest-VolumesActionsTest-1197709314 tempest-VolumesActionsTest-1197709314-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:15:57.883953 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-9f1c364e-1d2c-47bc-a0f6-fbbf22b304bb tempest-VolumesActionsTest-1197709314 tempest-VolumesActionsTest-1197709314-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:15:57.884632 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-9f1c364e-1d2c-47bc-a0f6-fbbf22b304bb tempest-VolumesActionsTest-1197709314 tempest-VolumesActionsTest-1197709314-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:15:57.885076 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-9f1c364e-1d2c-47bc-a0f6-fbbf22b304bb tempest-VolumesActionsTest-1197709314 tempest-VolumesActionsTest-1197709314-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:15:57.885523 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-9f1c364e-1d2c-47bc-a0f6-fbbf22b304bb tempest-VolumesActionsTest-1197709314 tempest-VolumesActionsTest-1197709314-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:15:58.013574 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-9f1c364e-1d2c-47bc-a0f6-fbbf22b304bb tempest-VolumesActionsTest-1197709314 tempest-VolumesActionsTest-1197709314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67e8948aca7b4a1da87d81830cc819fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ce523f87745437e9c3d6630d1fb2e51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:15:58.021126 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-9f1c364e-1d2c-47bc-a0f6-fbbf22b304bb tempest-VolumesActionsTest-1197709314 tempest-VolumesActionsTest-1197709314-project] 10.222.0.50 "GET /compute/v2.1/servers/1134e812-41e9-4532-a9af-e1d267d7ce74" status: 200 len: 1314 microversion: 2.1 time: 0.148938 Sep 24 05:15:58.021680 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 657/1343] 10.222.0.50 () {58 vars in 1236 bytes} [Sat Sep 24 05:15:57 2022] GET /compute/v2.1/servers/1134e812-41e9-4532-a9af-e1d267d7ce74 => generated 1314 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 24 05:15:59.043613 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-f19a3b46-8bc3-44fc-b567-2a8a2ad194b1 tempest-VolumesActionsTest-1197709314 tempest-VolumesActionsTest-1197709314-project] Calling method '>' {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:15:59.044224 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.compute.api [None req-f19a3b46-8bc3-44fc-b567-2a8a2ad194b1 tempest-VolumesActionsTest-1197709314 tempest-VolumesActionsTest-1197709314-project] [instance: 1134e812-41e9-4532-a9af-e1d267d7ce74] Fetching instance by UUID {{(pid=120594) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:15:59.050594 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-f19a3b46-8bc3-44fc-b567-2a8a2ad194b1 tempest-VolumesActionsTest-1197709314 tempest-VolumesActionsTest-1197709314-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:15:59.051068 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-f19a3b46-8bc3-44fc-b567-2a8a2ad194b1 tempest-VolumesActionsTest-1197709314 tempest-VolumesActionsTest-1197709314-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:15:59.051501 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-f19a3b46-8bc3-44fc-b567-2a8a2ad194b1 tempest-VolumesActionsTest-1197709314 tempest-VolumesActionsTest-1197709314-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:15:59.052185 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-f19a3b46-8bc3-44fc-b567-2a8a2ad194b1 tempest-VolumesActionsTest-1197709314 tempest-VolumesActionsTest-1197709314-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:15:59.052633 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-f19a3b46-8bc3-44fc-b567-2a8a2ad194b1 tempest-VolumesActionsTest-1197709314 tempest-VolumesActionsTest-1197709314-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:15:59.053055 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-f19a3b46-8bc3-44fc-b567-2a8a2ad194b1 tempest-VolumesActionsTest-1197709314 tempest-VolumesActionsTest-1197709314-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:15:59.177280 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.policy [None req-f19a3b46-8bc3-44fc-b567-2a8a2ad194b1 tempest-VolumesActionsTest-1197709314 tempest-VolumesActionsTest-1197709314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67e8948aca7b4a1da87d81830cc819fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ce523f87745437e9c3d6630d1fb2e51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:15:59.184795 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [None req-f19a3b46-8bc3-44fc-b567-2a8a2ad194b1 tempest-VolumesActionsTest-1197709314 tempest-VolumesActionsTest-1197709314-project] 10.222.0.50 "GET /compute/v2.1/servers/1134e812-41e9-4532-a9af-e1d267d7ce74" status: 200 len: 1314 microversion: 2.1 time: 0.145059 Sep 24 05:15:59.185355 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 687/1344] 10.222.0.50 () {58 vars in 1236 bytes} [Sat Sep 24 05:15:59 2022] GET /compute/v2.1/servers/1134e812-41e9-4532-a9af-e1d267d7ce74 => generated 1314 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 05:15:59.609231 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [req-7975cdf7-6909-4ba7-bdb1-b882b94059a8 req-75c2b660-1028-4cbf-b468-c0f36e4421b9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1134e812-41e9-4532-a9af-e1d267d7ce74", "name": "network-vif-plugged", "status": "completed", "tag": "972b071d-782c-4431-b178-52f6a28b21b3"}]} {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 05:15:59.620018 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [req-7975cdf7-6909-4ba7-bdb1-b882b94059a8 req-75c2b660-1028-4cbf-b468-c0f36e4421b9 service nova] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:15:59.620018 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [req-7975cdf7-6909-4ba7-bdb1-b882b94059a8 req-75c2b660-1028-4cbf-b468-c0f36e4421b9 service nova] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:15:59.620436 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [req-7975cdf7-6909-4ba7-bdb1-b882b94059a8 req-75c2b660-1028-4cbf-b468-c0f36e4421b9 service nova] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:15:59.631266 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.compute.server_external_events [req-7975cdf7-6909-4ba7-bdb1-b882b94059a8 req-75c2b660-1028-4cbf-b468-c0f36e4421b9 service nova] Creating event network-vif-plugged:972b071d-782c-4431-b178-52f6a28b21b3 for instance 1134e812-41e9-4532-a9af-e1d267d7ce74 on hv-cinder-85918 Sep 24 05:15:59.636435 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [req-7975cdf7-6909-4ba7-bdb1-b882b94059a8 req-75c2b660-1028-4cbf-b468-c0f36e4421b9 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031039 Sep 24 05:15:59.637068 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 658/1345] 10.222.0.50 () {64 vars in 1317 bytes} [Sat Sep 24 05:15:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 05:16:00.207834 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-3b1901ff-b793-4352-9946-02d2273dc05a tempest-VolumesActionsTest-1197709314 tempest-VolumesActionsTest-1197709314-project] Calling method '>' {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:16:00.208437 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.compute.api [None req-3b1901ff-b793-4352-9946-02d2273dc05a tempest-VolumesActionsTest-1197709314 tempest-VolumesActionsTest-1197709314-project] [instance: 1134e812-41e9-4532-a9af-e1d267d7ce74] Fetching instance by UUID {{(pid=120594) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:16:00.214911 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-3b1901ff-b793-4352-9946-02d2273dc05a tempest-VolumesActionsTest-1197709314 tempest-VolumesActionsTest-1197709314-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:16:00.215377 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-3b1901ff-b793-4352-9946-02d2273dc05a tempest-VolumesActionsTest-1197709314 tempest-VolumesActionsTest-1197709314-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:16:00.215807 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-3b1901ff-b793-4352-9946-02d2273dc05a tempest-VolumesActionsTest-1197709314 tempest-VolumesActionsTest-1197709314-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:16:00.216484 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-3b1901ff-b793-4352-9946-02d2273dc05a tempest-VolumesActionsTest-1197709314 tempest-VolumesActionsTest-1197709314-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:16:00.216923 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-3b1901ff-b793-4352-9946-02d2273dc05a tempest-VolumesActionsTest-1197709314 tempest-VolumesActionsTest-1197709314-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:16:00.217335 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-3b1901ff-b793-4352-9946-02d2273dc05a tempest-VolumesActionsTest-1197709314 tempest-VolumesActionsTest-1197709314-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:16:00.343144 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.policy [None req-3b1901ff-b793-4352-9946-02d2273dc05a tempest-VolumesActionsTest-1197709314 tempest-VolumesActionsTest-1197709314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67e8948aca7b4a1da87d81830cc819fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ce523f87745437e9c3d6630d1fb2e51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:16:00.351028 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [None req-3b1901ff-b793-4352-9946-02d2273dc05a tempest-VolumesActionsTest-1197709314 tempest-VolumesActionsTest-1197709314-project] 10.222.0.50 "GET /compute/v2.1/servers/1134e812-41e9-4532-a9af-e1d267d7ce74" status: 200 len: 1314 microversion: 2.1 time: 0.147060 Sep 24 05:16:00.352093 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 688/1346] 10.222.0.50 () {58 vars in 1236 bytes} [Sat Sep 24 05:16:00 2022] GET /compute/v2.1/servers/1134e812-41e9-4532-a9af-e1d267d7ce74 => generated 1314 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 05:16:01.372041 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG dbcounter [-] [120593] Writing DB stats nova_cell0:SELECT=2 {{(pid=120593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 05:16:01.372722 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG dbcounter [-] [120593] Writing DB stats nova_cell0:SELECT=6 {{(pid=120593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 05:16:01.376750 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-ca252295-3863-400a-a38f-cb1e89e38999 tempest-VolumesActionsTest-1197709314 tempest-VolumesActionsTest-1197709314-project] Calling method '>' {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:16:01.377453 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.compute.api [None req-ca252295-3863-400a-a38f-cb1e89e38999 tempest-VolumesActionsTest-1197709314 tempest-VolumesActionsTest-1197709314-project] [instance: 1134e812-41e9-4532-a9af-e1d267d7ce74] Fetching instance by UUID {{(pid=120593) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:16:01.384395 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-ca252295-3863-400a-a38f-cb1e89e38999 tempest-VolumesActionsTest-1197709314 tempest-VolumesActionsTest-1197709314-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:16:01.384876 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-ca252295-3863-400a-a38f-cb1e89e38999 tempest-VolumesActionsTest-1197709314 tempest-VolumesActionsTest-1197709314-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:16:01.385312 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-ca252295-3863-400a-a38f-cb1e89e38999 tempest-VolumesActionsTest-1197709314 tempest-VolumesActionsTest-1197709314-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:16:01.386530 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-ca252295-3863-400a-a38f-cb1e89e38999 tempest-VolumesActionsTest-1197709314 tempest-VolumesActionsTest-1197709314-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:16:01.386989 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-ca252295-3863-400a-a38f-cb1e89e38999 tempest-VolumesActionsTest-1197709314 tempest-VolumesActionsTest-1197709314-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:16:01.387418 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-ca252295-3863-400a-a38f-cb1e89e38999 tempest-VolumesActionsTest-1197709314 tempest-VolumesActionsTest-1197709314-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:16:01.518446 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-ca252295-3863-400a-a38f-cb1e89e38999 tempest-VolumesActionsTest-1197709314 tempest-VolumesActionsTest-1197709314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67e8948aca7b4a1da87d81830cc819fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ce523f87745437e9c3d6630d1fb2e51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:16:01.526082 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-ca252295-3863-400a-a38f-cb1e89e38999 tempest-VolumesActionsTest-1197709314 tempest-VolumesActionsTest-1197709314-project] 10.222.0.50 "GET /compute/v2.1/servers/1134e812-41e9-4532-a9af-e1d267d7ce74" status: 200 len: 1497 microversion: 2.1 time: 0.155492 Sep 24 05:16:01.526640 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 659/1347] 10.222.0.50 () {58 vars in 1236 bytes} [Sat Sep 24 05:16:01 2022] GET /compute/v2.1/servers/1134e812-41e9-4532-a9af-e1d267d7ce74 => generated 1497 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 05:16:01.988286 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-50f15080-a7b6-4f6c-b72e-3a30ad4b8b98 tempest-VolumesActionsTest-1197709314 tempest-VolumesActionsTest-1197709314-project] Calling method '>' {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:16:01.988818 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.compute.api [None req-50f15080-a7b6-4f6c-b72e-3a30ad4b8b98 tempest-VolumesActionsTest-1197709314 tempest-VolumesActionsTest-1197709314-project] [instance: 1134e812-41e9-4532-a9af-e1d267d7ce74] Fetching instance by UUID {{(pid=120594) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:16:01.990782 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG dbcounter [-] [120594] Writing DB stats nova_cell0:SELECT=2 {{(pid=120594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 05:16:01.997658 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-50f15080-a7b6-4f6c-b72e-3a30ad4b8b98 tempest-VolumesActionsTest-1197709314 tempest-VolumesActionsTest-1197709314-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:16:01.998164 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-50f15080-a7b6-4f6c-b72e-3a30ad4b8b98 tempest-VolumesActionsTest-1197709314 tempest-VolumesActionsTest-1197709314-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:16:01.998602 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-50f15080-a7b6-4f6c-b72e-3a30ad4b8b98 tempest-VolumesActionsTest-1197709314 tempest-VolumesActionsTest-1197709314-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:16:01.999287 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-50f15080-a7b6-4f6c-b72e-3a30ad4b8b98 tempest-VolumesActionsTest-1197709314 tempest-VolumesActionsTest-1197709314-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:16:01.999734 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-50f15080-a7b6-4f6c-b72e-3a30ad4b8b98 tempest-VolumesActionsTest-1197709314 tempest-VolumesActionsTest-1197709314-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:16:02.000155 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-50f15080-a7b6-4f6c-b72e-3a30ad4b8b98 tempest-VolumesActionsTest-1197709314 tempest-VolumesActionsTest-1197709314-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:16:02.024836 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.compute.api [None req-50f15080-a7b6-4f6c-b72e-3a30ad4b8b98 tempest-VolumesActionsTest-1197709314 tempest-VolumesActionsTest-1197709314-project] [instance: 1134e812-41e9-4532-a9af-e1d267d7ce74] Going to try to terminate instance {{(pid=120594) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 24 05:16:02.097123 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [None req-50f15080-a7b6-4f6c-b72e-3a30ad4b8b98 tempest-VolumesActionsTest-1197709314 tempest-VolumesActionsTest-1197709314-project] 10.222.0.50 "DELETE /compute/v2.1/servers/1134e812-41e9-4532-a9af-e1d267d7ce74" status: 204 len: 0 microversion: 2.1 time: 0.112424 Sep 24 05:16:02.097705 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 689/1348] 10.222.0.50 () {58 vars in 1239 bytes} [Sat Sep 24 05:16:01 2022] DELETE /compute/v2.1/servers/1134e812-41e9-4532-a9af-e1d267d7ce74 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 24 05:16:02.108120 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-748eff8a-f926-46b9-9873-fa0283973007 tempest-VolumesActionsTest-1197709314 tempest-VolumesActionsTest-1197709314-project] Calling method '>' {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:16:02.108737 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.compute.api [None req-748eff8a-f926-46b9-9873-fa0283973007 tempest-VolumesActionsTest-1197709314 tempest-VolumesActionsTest-1197709314-project] [instance: 1134e812-41e9-4532-a9af-e1d267d7ce74] Fetching instance by UUID {{(pid=120593) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:16:02.114869 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-748eff8a-f926-46b9-9873-fa0283973007 tempest-VolumesActionsTest-1197709314 tempest-VolumesActionsTest-1197709314-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:16:02.115348 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-748eff8a-f926-46b9-9873-fa0283973007 tempest-VolumesActionsTest-1197709314 tempest-VolumesActionsTest-1197709314-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:16:02.115807 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-748eff8a-f926-46b9-9873-fa0283973007 tempest-VolumesActionsTest-1197709314 tempest-VolumesActionsTest-1197709314-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:16:02.116495 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-748eff8a-f926-46b9-9873-fa0283973007 tempest-VolumesActionsTest-1197709314 tempest-VolumesActionsTest-1197709314-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:16:02.116941 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-748eff8a-f926-46b9-9873-fa0283973007 tempest-VolumesActionsTest-1197709314 tempest-VolumesActionsTest-1197709314-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:16:02.117356 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-748eff8a-f926-46b9-9873-fa0283973007 tempest-VolumesActionsTest-1197709314 tempest-VolumesActionsTest-1197709314-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:16:02.482518 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-748eff8a-f926-46b9-9873-fa0283973007 tempest-VolumesActionsTest-1197709314 tempest-VolumesActionsTest-1197709314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67e8948aca7b4a1da87d81830cc819fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ce523f87745437e9c3d6630d1fb2e51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:16:02.490051 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-748eff8a-f926-46b9-9873-fa0283973007 tempest-VolumesActionsTest-1197709314 tempest-VolumesActionsTest-1197709314-project] 10.222.0.50 "GET /compute/v2.1/servers/1134e812-41e9-4532-a9af-e1d267d7ce74" status: 200 len: 1503 microversion: 2.1 time: 0.387687 Sep 24 05:16:02.490624 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 660/1349] 10.222.0.50 () {58 vars in 1236 bytes} [Sat Sep 24 05:16:02 2022] GET /compute/v2.1/servers/1134e812-41e9-4532-a9af-e1d267d7ce74 => generated 1503 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 05:16:03.513220 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-8aeb99f8-e2d3-47e7-be02-faa70f2abeef tempest-VolumesActionsTest-1197709314 tempest-VolumesActionsTest-1197709314-project] Calling method '>' {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:16:03.513913 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.compute.api [None req-8aeb99f8-e2d3-47e7-be02-faa70f2abeef tempest-VolumesActionsTest-1197709314 tempest-VolumesActionsTest-1197709314-project] [instance: 1134e812-41e9-4532-a9af-e1d267d7ce74] Fetching instance by UUID {{(pid=120594) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:16:03.520116 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-8aeb99f8-e2d3-47e7-be02-faa70f2abeef tempest-VolumesActionsTest-1197709314 tempest-VolumesActionsTest-1197709314-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:16:03.520590 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-8aeb99f8-e2d3-47e7-be02-faa70f2abeef tempest-VolumesActionsTest-1197709314 tempest-VolumesActionsTest-1197709314-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:16:03.521019 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-8aeb99f8-e2d3-47e7-be02-faa70f2abeef tempest-VolumesActionsTest-1197709314 tempest-VolumesActionsTest-1197709314-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:16:03.521709 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-8aeb99f8-e2d3-47e7-be02-faa70f2abeef tempest-VolumesActionsTest-1197709314 tempest-VolumesActionsTest-1197709314-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:16:03.522184 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-8aeb99f8-e2d3-47e7-be02-faa70f2abeef tempest-VolumesActionsTest-1197709314 tempest-VolumesActionsTest-1197709314-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:16:03.522614 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-8aeb99f8-e2d3-47e7-be02-faa70f2abeef tempest-VolumesActionsTest-1197709314 tempest-VolumesActionsTest-1197709314-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:16:03.540820 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG dbcounter [-] [120594] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 05:16:03.651907 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.policy [None req-8aeb99f8-e2d3-47e7-be02-faa70f2abeef tempest-VolumesActionsTest-1197709314 tempest-VolumesActionsTest-1197709314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67e8948aca7b4a1da87d81830cc819fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ce523f87745437e9c3d6630d1fb2e51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:16:03.659916 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [None req-8aeb99f8-e2d3-47e7-be02-faa70f2abeef tempest-VolumesActionsTest-1197709314 tempest-VolumesActionsTest-1197709314-project] 10.222.0.50 "GET /compute/v2.1/servers/1134e812-41e9-4532-a9af-e1d267d7ce74" status: 200 len: 1503 microversion: 2.1 time: 0.150883 Sep 24 05:16:03.660483 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 690/1350] 10.222.0.50 () {58 vars in 1236 bytes} [Sat Sep 24 05:16:03 2022] GET /compute/v2.1/servers/1134e812-41e9-4532-a9af-e1d267d7ce74 => generated 1503 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 05:16:04.280073 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [req-cf30c741-dda3-4f1c-8f62-7df20a8189fa req-d5cb01fb-2220-4c1a-b6e9-cea44bcfcc00 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1134e812-41e9-4532-a9af-e1d267d7ce74", "name": "network-vif-deleted", "tag": "972b071d-782c-4431-b178-52f6a28b21b3"}]} {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 05:16:04.290146 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [req-cf30c741-dda3-4f1c-8f62-7df20a8189fa req-d5cb01fb-2220-4c1a-b6e9-cea44bcfcc00 service nova] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:16:04.290626 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [req-cf30c741-dda3-4f1c-8f62-7df20a8189fa req-d5cb01fb-2220-4c1a-b6e9-cea44bcfcc00 service nova] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:16:04.291074 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [req-cf30c741-dda3-4f1c-8f62-7df20a8189fa req-d5cb01fb-2220-4c1a-b6e9-cea44bcfcc00 service nova] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:16:04.305333 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.compute.server_external_events [req-cf30c741-dda3-4f1c-8f62-7df20a8189fa req-d5cb01fb-2220-4c1a-b6e9-cea44bcfcc00 service nova] Creating event network-vif-deleted:972b071d-782c-4431-b178-52f6a28b21b3 for instance 1134e812-41e9-4532-a9af-e1d267d7ce74 on hv-cinder-85918 Sep 24 05:16:04.310019 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [req-cf30c741-dda3-4f1c-8f62-7df20a8189fa req-d5cb01fb-2220-4c1a-b6e9-cea44bcfcc00 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034491 Sep 24 05:16:04.310615 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 661/1351] 10.222.0.50 () {64 vars in 1317 bytes} [Sat Sep 24 05:16:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 05:16:04.682922 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-6013c685-ac2e-4611-a5b6-eb1045a49d88 tempest-VolumesActionsTest-1197709314 tempest-VolumesActionsTest-1197709314-project] Calling method '>' {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:16:04.684090 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.compute.api [None req-6013c685-ac2e-4611-a5b6-eb1045a49d88 tempest-VolumesActionsTest-1197709314 tempest-VolumesActionsTest-1197709314-project] [instance: 1134e812-41e9-4532-a9af-e1d267d7ce74] Fetching instance by UUID {{(pid=120594) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:16:04.686486 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG dbcounter [-] [120594] Writing DB stats nova_api:SELECT=57,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=120594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 05:16:04.692277 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-6013c685-ac2e-4611-a5b6-eb1045a49d88 tempest-VolumesActionsTest-1197709314 tempest-VolumesActionsTest-1197709314-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:16:04.692784 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-6013c685-ac2e-4611-a5b6-eb1045a49d88 tempest-VolumesActionsTest-1197709314 tempest-VolumesActionsTest-1197709314-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:16:04.693228 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-6013c685-ac2e-4611-a5b6-eb1045a49d88 tempest-VolumesActionsTest-1197709314 tempest-VolumesActionsTest-1197709314-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:16:04.693914 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-6013c685-ac2e-4611-a5b6-eb1045a49d88 tempest-VolumesActionsTest-1197709314 tempest-VolumesActionsTest-1197709314-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:16:04.694465 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-6013c685-ac2e-4611-a5b6-eb1045a49d88 tempest-VolumesActionsTest-1197709314 tempest-VolumesActionsTest-1197709314-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:16:04.694873 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-6013c685-ac2e-4611-a5b6-eb1045a49d88 tempest-VolumesActionsTest-1197709314 tempest-VolumesActionsTest-1197709314-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:16:04.729214 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-6013c685-ac2e-4611-a5b6-eb1045a49d88 tempest-VolumesActionsTest-1197709314 tempest-VolumesActionsTest-1197709314-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:16:04.729692 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-6013c685-ac2e-4611-a5b6-eb1045a49d88 tempest-VolumesActionsTest-1197709314 tempest-VolumesActionsTest-1197709314-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:16:04.730181 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-6013c685-ac2e-4611-a5b6-eb1045a49d88 tempest-VolumesActionsTest-1197709314 tempest-VolumesActionsTest-1197709314-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:16:04.730670 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.objects.instance [None req-6013c685-ac2e-4611-a5b6-eb1045a49d88 tempest-VolumesActionsTest-1197709314 tempest-VolumesActionsTest-1197709314-project] Lazy-loading 'fault' on Instance uuid 1134e812-41e9-4532-a9af-e1d267d7ce74 {{(pid=120594) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 24 05:16:04.775147 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.policy [None req-6013c685-ac2e-4611-a5b6-eb1045a49d88 tempest-VolumesActionsTest-1197709314 tempest-VolumesActionsTest-1197709314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67e8948aca7b4a1da87d81830cc819fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ce523f87745437e9c3d6630d1fb2e51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:16:04.783093 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [None req-6013c685-ac2e-4611-a5b6-eb1045a49d88 tempest-VolumesActionsTest-1197709314 tempest-VolumesActionsTest-1197709314-project] 10.222.0.50 "GET /compute/v2.1/servers/1134e812-41e9-4532-a9af-e1d267d7ce74" status: 200 len: 1304 microversion: 2.1 time: 0.104141 Sep 24 05:16:04.783691 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 691/1352] 10.222.0.50 () {58 vars in 1236 bytes} [Sat Sep 24 05:16:04 2022] GET /compute/v2.1/servers/1134e812-41e9-4532-a9af-e1d267d7ce74 => generated 1304 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 05:16:05.807694 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-99a8f27f-e102-4932-ae06-be4bae2f8db1 tempest-VolumesActionsTest-1197709314 tempest-VolumesActionsTest-1197709314-project] Calling method '>' {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:16:05.808397 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.compute.api [None req-99a8f27f-e102-4932-ae06-be4bae2f8db1 tempest-VolumesActionsTest-1197709314 tempest-VolumesActionsTest-1197709314-project] [instance: 1134e812-41e9-4532-a9af-e1d267d7ce74] Fetching instance by UUID {{(pid=120593) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:16:05.810286 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG dbcounter [-] [120593] Writing DB stats nova_api:SELECT=57,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=120593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 05:16:05.815724 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-99a8f27f-e102-4932-ae06-be4bae2f8db1 tempest-VolumesActionsTest-1197709314 tempest-VolumesActionsTest-1197709314-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:16:05.816200 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-99a8f27f-e102-4932-ae06-be4bae2f8db1 tempest-VolumesActionsTest-1197709314 tempest-VolumesActionsTest-1197709314-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:16:05.816640 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-99a8f27f-e102-4932-ae06-be4bae2f8db1 tempest-VolumesActionsTest-1197709314 tempest-VolumesActionsTest-1197709314-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:16:05.817322 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-99a8f27f-e102-4932-ae06-be4bae2f8db1 tempest-VolumesActionsTest-1197709314 tempest-VolumesActionsTest-1197709314-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:16:05.817773 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-99a8f27f-e102-4932-ae06-be4bae2f8db1 tempest-VolumesActionsTest-1197709314 tempest-VolumesActionsTest-1197709314-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:16:05.818222 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-99a8f27f-e102-4932-ae06-be4bae2f8db1 tempest-VolumesActionsTest-1197709314 tempest-VolumesActionsTest-1197709314-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:16:05.821595 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG dbcounter [-] [120593] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 05:16:05.835644 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.wsgi [None req-99a8f27f-e102-4932-ae06-be4bae2f8db1 tempest-VolumesActionsTest-1197709314 tempest-VolumesActionsTest-1197709314-project] HTTP exception thrown: Instance 1134e812-41e9-4532-a9af-e1d267d7ce74 could not be found. Sep 24 05:16:05.837247 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-99a8f27f-e102-4932-ae06-be4bae2f8db1 tempest-VolumesActionsTest-1197709314 tempest-VolumesActionsTest-1197709314-project] Request method failure captured: Sep 24 05:16:05.837247 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: request: GET /compute/v2.1/servers/1134e812-41e9-4532-a9af-e1d267d7ce74 HTTP/1.1 Sep 24 05:16:05.837247 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: Accept: application/json Sep 24 05:16:05.837247 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: Accept-Encoding: identity Sep 24 05:16:05.837247 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: Connection: close Sep 24 05:16:05.837247 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: Content-Length: 0 Sep 24 05:16:05.837247 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: Content-Type: application/json Sep 24 05:16:05.837247 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: Host: 10.222.0.50 Sep 24 05:16:05.837247 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: Openstack-System-Scope: None Sep 24 05:16:05.837247 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: User-Agent: python-urllib3/1.26.12 Sep 24 05:16:05.837247 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: X-Auth-Token: gAAAAABjLpJ0n-JhoCWaENLpr9CN1RlLuizZJdDQjEbunqLI16BvgJ1o5rz11M2w22uAyK1o-vnxUvZ5KiTHDrPf7fzbPW80Pi4Rvt9U0IdYIYn2YkGU_z0dSQ3Im6kRbiPGnyHgkQqNO0uxe5J_UNFkjfj_NOdt9tN1so6-6ENpcZwlMTHJBFY Sep 24 05:16:05.837247 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: X-Domain-Id: None Sep 24 05:16:05.837247 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: X-Domain-Name: None Sep 24 05:16:05.837247 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: X-Identity-Status: Confirmed Sep 24 05:16:05.837247 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: X-Is-Admin-Project: True Sep 24 05:16:05.837247 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: X-Project-Domain-Id: default Sep 24 05:16:05.837247 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: X-Project-Domain-Name: Default Sep 24 05:16:05.837247 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: X-Project-Id: 0ce523f87745437e9c3d6630d1fb2e51 Sep 24 05:16:05.837247 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: X-Project-Name: tempest-VolumesActionsTest-1197709314 Sep 24 05:16:05.837247 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: X-Role: member,reader Sep 24 05:16:05.837247 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: X-Roles: member,reader Sep 24 05:16:05.838985 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/0ce523f87745437e9c3d6630d1fb2e51"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/0ce523f87745437e9c3d6630d1fb2e51"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/0ce523f87745437e9c3d6630d1fb2e51"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.50:8080", "publicURL": "http://10.222.0.50:8080/v1/AUTH_0ce523f87745437e9c3d6630d1fb2e51"}]}] Sep 24 05:16:05.838985 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: X-Tenant: tempest-VolumesActionsTest-1197709314 Sep 24 05:16:05.838985 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: X-Tenant-Id: 0ce523f87745437e9c3d6630d1fb2e51 Sep 24 05:16:05.838985 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: X-Tenant-Name: tempest-VolumesActionsTest-1197709314 Sep 24 05:16:05.838985 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: X-User: tempest-VolumesActionsTest-1197709314-project Sep 24 05:16:05.838985 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: X-User-Domain-Id: default Sep 24 05:16:05.838985 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: X-User-Domain-Name: Default Sep 24 05:16:05.838985 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: X-User-Id: 67e8948aca7b4a1da87d81830cc819fe Sep 24 05:16:05.838985 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: X-User-Name: tempest-VolumesActionsTest-1197709314-project Sep 24 05:16:05.838985 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: method: > Sep 24 05:16:05.838985 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: exception: Instance 1134e812-41e9-4532-a9af-e1d267d7ce74 could not be found. Sep 24 05:16:05.838985 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: action_args: {'id': '1134e812-41e9-4532-a9af-e1d267d7ce74'} Sep 24 05:16:05.840550 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 24 05:16:05.840550 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 05:16:05.840550 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 24 05:16:05.840550 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 24 05:16:05.840550 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 24 05:16:05.840550 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 24 05:16:05.840550 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 24 05:16:05.840550 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 24 05:16:05.840550 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 24 05:16:05.840550 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 24 05:16:05.840550 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1134e812-41e9-4532-a9af-e1d267d7ce74 could not be found. Sep 24 05:16:05.840550 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi Sep 24 05:16:05.840550 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 05:16:05.840550 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi Sep 24 05:16:05.840550 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 05:16:05.840550 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 05:16:05.840550 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 05:16:05.840550 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 24 05:16:05.840550 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 24 05:16:05.840550 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 24 05:16:05.842211 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 24 05:16:05.842211 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 24 05:16:05.842211 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 24 05:16:05.842211 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 24 05:16:05.842211 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 24 05:16:05.842211 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 24 05:16:05.842211 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 24 05:16:05.842211 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1134e812-41e9-4532-a9af-e1d267d7ce74 could not be found. Sep 24 05:16:05.842211 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi Sep 24 05:16:05.842211 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 05:16:05.842211 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi Sep 24 05:16:05.842211 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 05:16:05.842211 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 05:16:05.842211 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 05:16:05.842211 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 24 05:16:05.842211 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 24 05:16:05.842211 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1134e812-41e9-4532-a9af-e1d267d7ce74 could not be found. Sep 24 05:16:05.842211 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi Sep 24 05:16:05.843703 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-99a8f27f-e102-4932-ae06-be4bae2f8db1 tempest-VolumesActionsTest-1197709314 tempest-VolumesActionsTest-1197709314-project] Returning 404 to user: Instance 1134e812-41e9-4532-a9af-e1d267d7ce74 could not be found. {{(pid=120593) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 24 05:16:05.843703 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-99a8f27f-e102-4932-ae06-be4bae2f8db1 tempest-VolumesActionsTest-1197709314 tempest-VolumesActionsTest-1197709314-project] 10.222.0.50 "GET /compute/v2.1/servers/1134e812-41e9-4532-a9af-e1d267d7ce74" status: 404 len: 111 microversion: 2.1 time: 0.035803 Sep 24 05:16:05.843703 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 662/1353] 10.222.0.50 () {58 vars in 1236 bytes} [Sat Sep 24 05:16:05 2022] GET /compute/v2.1/servers/1134e812-41e9-4532-a9af-e1d267d7ce74 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 24 05:16:53.860242 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-9ab4a141-0fe9-44a8-8158-696807b7d69c tempest-TestVolumeBootPattern-1339481357 tempest-TestVolumeBootPattern-1339481357-project] Calling method '>' {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:16:53.865684 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [req-17a56532-d978-4338-871c-c25a66ea1eb0 req-cf740dee-8044-440a-a96e-145ab196d737 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "af77c184-6aa4-4f31-b736-bf19ec7c1482", "tag": "b3fe81c9-e8d5-4709-aba9-c58720d8684a"}]} {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 05:16:53.866218 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.compute.api [None req-9ab4a141-0fe9-44a8-8158-696807b7d69c tempest-TestVolumeBootPattern-1339481357 tempest-TestVolumeBootPattern-1339481357-project] [instance: af77c184-6aa4-4f31-b736-bf19ec7c1482] Fetching instance by UUID {{(pid=120594) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:16:53.868902 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG dbcounter [-] [120594] Writing DB stats nova_api:SELECT=3 {{(pid=120594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 05:16:53.869543 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG dbcounter [-] [120594] Writing DB stats nova_cell1:SELECT=10 {{(pid=120594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 05:16:53.873876 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG dbcounter [-] [120593] Writing DB stats nova_api:SELECT=1 {{(pid=120593) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 05:16:53.875244 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-9ab4a141-0fe9-44a8-8158-696807b7d69c tempest-TestVolumeBootPattern-1339481357 tempest-TestVolumeBootPattern-1339481357-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:16:53.875961 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-9ab4a141-0fe9-44a8-8158-696807b7d69c tempest-TestVolumeBootPattern-1339481357 tempest-TestVolumeBootPattern-1339481357-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:16:53.876710 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-9ab4a141-0fe9-44a8-8158-696807b7d69c tempest-TestVolumeBootPattern-1339481357 tempest-TestVolumeBootPattern-1339481357-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:16:53.877434 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-9ab4a141-0fe9-44a8-8158-696807b7d69c tempest-TestVolumeBootPattern-1339481357 tempest-TestVolumeBootPattern-1339481357-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:16:53.877865 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-9ab4a141-0fe9-44a8-8158-696807b7d69c tempest-TestVolumeBootPattern-1339481357 tempest-TestVolumeBootPattern-1339481357-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:16:53.878579 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-9ab4a141-0fe9-44a8-8158-696807b7d69c tempest-TestVolumeBootPattern-1339481357 tempest-TestVolumeBootPattern-1339481357-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:16:53.881829 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [req-17a56532-d978-4338-871c-c25a66ea1eb0 req-cf740dee-8044-440a-a96e-145ab196d737 service nova] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:16:53.882137 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [req-17a56532-d978-4338-871c-c25a66ea1eb0 req-cf740dee-8044-440a-a96e-145ab196d737 service nova] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:16:53.883174 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [req-17a56532-d978-4338-871c-c25a66ea1eb0 req-cf740dee-8044-440a-a96e-145ab196d737 service nova] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:16:53.897973 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.compute.server_external_events [req-17a56532-d978-4338-871c-c25a66ea1eb0 req-cf740dee-8044-440a-a96e-145ab196d737 service nova] Creating event network-changed:b3fe81c9-e8d5-4709-aba9-c58720d8684a for instance af77c184-6aa4-4f31-b736-bf19ec7c1482 on hv-cinder-85918 Sep 24 05:16:53.904997 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [req-17a56532-d978-4338-871c-c25a66ea1eb0 req-cf740dee-8044-440a-a96e-145ab196d737 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042416 Sep 24 05:16:53.906602 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 663/1354] 10.222.0.50 () {64 vars in 1317 bytes} [Sat Sep 24 05:16:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 05:16:53.909802 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.compute.api [None req-9ab4a141-0fe9-44a8-8158-696807b7d69c tempest-TestVolumeBootPattern-1339481357 tempest-TestVolumeBootPattern-1339481357-project] [instance: af77c184-6aa4-4f31-b736-bf19ec7c1482] Going to try to terminate instance {{(pid=120594) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 24 05:16:53.992974 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [None req-9ab4a141-0fe9-44a8-8158-696807b7d69c tempest-TestVolumeBootPattern-1339481357 tempest-TestVolumeBootPattern-1339481357-project] 10.222.0.50 "DELETE /compute/v2.1/servers/af77c184-6aa4-4f31-b736-bf19ec7c1482" status: 204 len: 0 microversion: 2.1 time: 0.136478 Sep 24 05:16:53.995203 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 692/1355] 10.222.0.50 () {58 vars in 1239 bytes} [Sat Sep 24 05:16:53 2022] DELETE /compute/v2.1/servers/af77c184-6aa4-4f31-b736-bf19ec7c1482 => generated 0 bytes in 140 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 24 05:16:54.004729 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-edd3db54-1b8f-4b7c-975b-8e977f4f3078 tempest-TestVolumeBootPattern-1339481357 tempest-TestVolumeBootPattern-1339481357-project] Calling method '>' {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:16:54.005429 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.compute.api [None req-edd3db54-1b8f-4b7c-975b-8e977f4f3078 tempest-TestVolumeBootPattern-1339481357 tempest-TestVolumeBootPattern-1339481357-project] [instance: af77c184-6aa4-4f31-b736-bf19ec7c1482] Fetching instance by UUID {{(pid=120593) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:16:54.011839 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-edd3db54-1b8f-4b7c-975b-8e977f4f3078 tempest-TestVolumeBootPattern-1339481357 tempest-TestVolumeBootPattern-1339481357-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:16:54.012343 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-edd3db54-1b8f-4b7c-975b-8e977f4f3078 tempest-TestVolumeBootPattern-1339481357 tempest-TestVolumeBootPattern-1339481357-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:16:54.012774 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-edd3db54-1b8f-4b7c-975b-8e977f4f3078 tempest-TestVolumeBootPattern-1339481357 tempest-TestVolumeBootPattern-1339481357-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:16:54.014265 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-edd3db54-1b8f-4b7c-975b-8e977f4f3078 tempest-TestVolumeBootPattern-1339481357 tempest-TestVolumeBootPattern-1339481357-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:16:54.014715 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-edd3db54-1b8f-4b7c-975b-8e977f4f3078 tempest-TestVolumeBootPattern-1339481357 tempest-TestVolumeBootPattern-1339481357-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:16:54.015143 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-edd3db54-1b8f-4b7c-975b-8e977f4f3078 tempest-TestVolumeBootPattern-1339481357 tempest-TestVolumeBootPattern-1339481357-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:16:54.190909 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-edd3db54-1b8f-4b7c-975b-8e977f4f3078 tempest-TestVolumeBootPattern-1339481357 tempest-TestVolumeBootPattern-1339481357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60edcebcccaa4da99ffddadd3e27c1c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fef19544ec414094953daea6d545a361', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:16:54.198890 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-edd3db54-1b8f-4b7c-975b-8e977f4f3078 tempest-TestVolumeBootPattern-1339481357 tempest-TestVolumeBootPattern-1339481357-project] 10.222.0.50 "GET /compute/v2.1/servers/af77c184-6aa4-4f31-b736-bf19ec7c1482" status: 200 len: 1575 microversion: 2.1 time: 0.198813 Sep 24 05:16:54.199469 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 664/1356] 10.222.0.50 () {58 vars in 1236 bytes} [Sat Sep 24 05:16:53 2022] GET /compute/v2.1/servers/af77c184-6aa4-4f31-b736-bf19ec7c1482 => generated 1575 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 05:16:55.224265 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-20055f29-8910-4ef0-b9d1-0900eb27ac1d tempest-TestVolumeBootPattern-1339481357 tempest-TestVolumeBootPattern-1339481357-project] Calling method '>' {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:16:55.224968 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.compute.api [None req-20055f29-8910-4ef0-b9d1-0900eb27ac1d tempest-TestVolumeBootPattern-1339481357 tempest-TestVolumeBootPattern-1339481357-project] [instance: af77c184-6aa4-4f31-b736-bf19ec7c1482] Fetching instance by UUID {{(pid=120594) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:16:55.231379 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-20055f29-8910-4ef0-b9d1-0900eb27ac1d tempest-TestVolumeBootPattern-1339481357 tempest-TestVolumeBootPattern-1339481357-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:16:55.231860 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-20055f29-8910-4ef0-b9d1-0900eb27ac1d tempest-TestVolumeBootPattern-1339481357 tempest-TestVolumeBootPattern-1339481357-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:16:55.232296 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-20055f29-8910-4ef0-b9d1-0900eb27ac1d tempest-TestVolumeBootPattern-1339481357 tempest-TestVolumeBootPattern-1339481357-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:16:55.232984 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-20055f29-8910-4ef0-b9d1-0900eb27ac1d tempest-TestVolumeBootPattern-1339481357 tempest-TestVolumeBootPattern-1339481357-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:16:55.233440 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-20055f29-8910-4ef0-b9d1-0900eb27ac1d tempest-TestVolumeBootPattern-1339481357 tempest-TestVolumeBootPattern-1339481357-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:16:55.233866 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-20055f29-8910-4ef0-b9d1-0900eb27ac1d tempest-TestVolumeBootPattern-1339481357 tempest-TestVolumeBootPattern-1339481357-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:16:55.446810 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.policy [None req-20055f29-8910-4ef0-b9d1-0900eb27ac1d tempest-TestVolumeBootPattern-1339481357 tempest-TestVolumeBootPattern-1339481357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60edcebcccaa4da99ffddadd3e27c1c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fef19544ec414094953daea6d545a361', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120594) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:16:55.455130 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [None req-20055f29-8910-4ef0-b9d1-0900eb27ac1d tempest-TestVolumeBootPattern-1339481357 tempest-TestVolumeBootPattern-1339481357-project] 10.222.0.50 "GET /compute/v2.1/servers/af77c184-6aa4-4f31-b736-bf19ec7c1482" status: 200 len: 1575 microversion: 2.1 time: 0.235104 Sep 24 05:16:55.455698 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 693/1357] 10.222.0.50 () {58 vars in 1236 bytes} [Sat Sep 24 05:16:55 2022] GET /compute/v2.1/servers/af77c184-6aa4-4f31-b736-bf19ec7c1482 => generated 1575 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 05:16:56.478310 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-9ea7ed48-d173-4c93-bd28-52da5ba61ff2 tempest-TestVolumeBootPattern-1339481357 tempest-TestVolumeBootPattern-1339481357-project] Calling method '>' {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:16:56.479532 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.compute.api [None req-9ea7ed48-d173-4c93-bd28-52da5ba61ff2 tempest-TestVolumeBootPattern-1339481357 tempest-TestVolumeBootPattern-1339481357-project] [instance: af77c184-6aa4-4f31-b736-bf19ec7c1482] Fetching instance by UUID {{(pid=120593) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:16:56.487771 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-9ea7ed48-d173-4c93-bd28-52da5ba61ff2 tempest-TestVolumeBootPattern-1339481357 tempest-TestVolumeBootPattern-1339481357-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:16:56.488248 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-9ea7ed48-d173-4c93-bd28-52da5ba61ff2 tempest-TestVolumeBootPattern-1339481357 tempest-TestVolumeBootPattern-1339481357-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:16:56.488673 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-9ea7ed48-d173-4c93-bd28-52da5ba61ff2 tempest-TestVolumeBootPattern-1339481357 tempest-TestVolumeBootPattern-1339481357-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:16:56.489362 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-9ea7ed48-d173-4c93-bd28-52da5ba61ff2 tempest-TestVolumeBootPattern-1339481357 tempest-TestVolumeBootPattern-1339481357-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:16:56.489807 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-9ea7ed48-d173-4c93-bd28-52da5ba61ff2 tempest-TestVolumeBootPattern-1339481357 tempest-TestVolumeBootPattern-1339481357-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:16:56.490277 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-9ea7ed48-d173-4c93-bd28-52da5ba61ff2 tempest-TestVolumeBootPattern-1339481357 tempest-TestVolumeBootPattern-1339481357-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:16:56.582460 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-9ea7ed48-d173-4c93-bd28-52da5ba61ff2 tempest-TestVolumeBootPattern-1339481357 tempest-TestVolumeBootPattern-1339481357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60edcebcccaa4da99ffddadd3e27c1c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fef19544ec414094953daea6d545a361', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:16:56.592333 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-9ea7ed48-d173-4c93-bd28-52da5ba61ff2 tempest-TestVolumeBootPattern-1339481357 tempest-TestVolumeBootPattern-1339481357-project] 10.222.0.50 "GET /compute/v2.1/servers/af77c184-6aa4-4f31-b736-bf19ec7c1482" status: 200 len: 1389 microversion: 2.1 time: 0.117962 Sep 24 05:16:56.592924 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 665/1358] 10.222.0.50 () {58 vars in 1236 bytes} [Sat Sep 24 05:16:56 2022] GET /compute/v2.1/servers/af77c184-6aa4-4f31-b736-bf19ec7c1482 => generated 1389 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 05:16:56.728063 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [req-75345ecd-c544-4589-9c7e-ac4a37762f7c req-81b26872-2491-4010-b168-6457b81b8c55 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "af77c184-6aa4-4f31-b736-bf19ec7c1482", "name": "network-vif-deleted", "tag": "b3fe81c9-e8d5-4709-aba9-c58720d8684a"}]} {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 05:16:56.737367 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [req-75345ecd-c544-4589-9c7e-ac4a37762f7c req-81b26872-2491-4010-b168-6457b81b8c55 service nova] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:16:56.737835 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [req-75345ecd-c544-4589-9c7e-ac4a37762f7c req-81b26872-2491-4010-b168-6457b81b8c55 service nova] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:16:56.738296 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [req-75345ecd-c544-4589-9c7e-ac4a37762f7c req-81b26872-2491-4010-b168-6457b81b8c55 service nova] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:16:56.748688 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: INFO nova.api.openstack.compute.server_external_events [req-75345ecd-c544-4589-9c7e-ac4a37762f7c req-81b26872-2491-4010-b168-6457b81b8c55 service nova] Creating event network-vif-deleted:b3fe81c9-e8d5-4709-aba9-c58720d8684a for instance af77c184-6aa4-4f31-b736-bf19ec7c1482 on hv-cinder-85918 Sep 24 05:16:56.754060 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [req-75345ecd-c544-4589-9c7e-ac4a37762f7c req-81b26872-2491-4010-b168-6457b81b8c55 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.162317 Sep 24 05:16:56.754636 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 694/1359] 10.222.0.50 () {64 vars in 1317 bytes} [Sat Sep 24 05:16:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 24 05:16:57.616862 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-bf5b66d1-ba92-443d-94ae-b4e65732df74 tempest-TestVolumeBootPattern-1339481357 tempest-TestVolumeBootPattern-1339481357-project] Calling method '>' {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:16:57.617519 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.compute.api [None req-bf5b66d1-ba92-443d-94ae-b4e65732df74 tempest-TestVolumeBootPattern-1339481357 tempest-TestVolumeBootPattern-1339481357-project] [instance: af77c184-6aa4-4f31-b736-bf19ec7c1482] Fetching instance by UUID {{(pid=120593) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:16:57.624586 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-bf5b66d1-ba92-443d-94ae-b4e65732df74 tempest-TestVolumeBootPattern-1339481357 tempest-TestVolumeBootPattern-1339481357-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:16:57.625065 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-bf5b66d1-ba92-443d-94ae-b4e65732df74 tempest-TestVolumeBootPattern-1339481357 tempest-TestVolumeBootPattern-1339481357-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:16:57.625506 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-bf5b66d1-ba92-443d-94ae-b4e65732df74 tempest-TestVolumeBootPattern-1339481357 tempest-TestVolumeBootPattern-1339481357-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:16:57.626236 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-bf5b66d1-ba92-443d-94ae-b4e65732df74 tempest-TestVolumeBootPattern-1339481357 tempest-TestVolumeBootPattern-1339481357-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:16:57.626692 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-bf5b66d1-ba92-443d-94ae-b4e65732df74 tempest-TestVolumeBootPattern-1339481357 tempest-TestVolumeBootPattern-1339481357-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:16:57.627119 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-bf5b66d1-ba92-443d-94ae-b4e65732df74 tempest-TestVolumeBootPattern-1339481357 tempest-TestVolumeBootPattern-1339481357-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:16:57.640823 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.wsgi [None req-bf5b66d1-ba92-443d-94ae-b4e65732df74 tempest-TestVolumeBootPattern-1339481357 tempest-TestVolumeBootPattern-1339481357-project] HTTP exception thrown: Instance af77c184-6aa4-4f31-b736-bf19ec7c1482 could not be found. Sep 24 05:16:57.642460 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-bf5b66d1-ba92-443d-94ae-b4e65732df74 tempest-TestVolumeBootPattern-1339481357 tempest-TestVolumeBootPattern-1339481357-project] Request method failure captured: Sep 24 05:16:57.642460 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: request: GET /compute/v2.1/servers/af77c184-6aa4-4f31-b736-bf19ec7c1482 HTTP/1.1 Sep 24 05:16:57.642460 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: Accept: application/json Sep 24 05:16:57.642460 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: Accept-Encoding: identity Sep 24 05:16:57.642460 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: Connection: close Sep 24 05:16:57.642460 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: Content-Length: 0 Sep 24 05:16:57.642460 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: Content-Type: application/json Sep 24 05:16:57.642460 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: Host: 10.222.0.50 Sep 24 05:16:57.642460 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: Openstack-System-Scope: None Sep 24 05:16:57.642460 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: User-Agent: python-urllib3/1.26.12 Sep 24 05:16:57.642460 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: X-Auth-Token: gAAAAABjLpCeE6D8vgXPZLE3UBn0EhNuNAYlX4X3foH_VqnJAbIepC8Hc1OmT41Tw45wEmDv7hYnAhqK7ORd7IXvHMNstcXMw_K7lenr8Yq0POwG1OxUbYSMAfzKDSF3S9nluknty2XjO7EseuzEnqkeZNGMERgJ_Hq7ozqEKQYIgCWBxUwAM1U Sep 24 05:16:57.642460 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: X-Domain-Id: None Sep 24 05:16:57.642460 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: X-Domain-Name: None Sep 24 05:16:57.642460 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: X-Identity-Status: Confirmed Sep 24 05:16:57.642460 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: X-Is-Admin-Project: True Sep 24 05:16:57.642460 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: X-Project-Domain-Id: default Sep 24 05:16:57.642460 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: X-Project-Domain-Name: Default Sep 24 05:16:57.642460 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: X-Project-Id: fef19544ec414094953daea6d545a361 Sep 24 05:16:57.642460 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: X-Project-Name: tempest-TestVolumeBootPattern-1339481357 Sep 24 05:16:57.642460 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: X-Role: member,reader Sep 24 05:16:57.642460 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: X-Roles: member,reader Sep 24 05:16:57.644263 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/fef19544ec414094953daea6d545a361"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/fef19544ec414094953daea6d545a361"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/fef19544ec414094953daea6d545a361"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.50:8080", "publicURL": "http://10.222.0.50:8080/v1/AUTH_fef19544ec414094953daea6d545a361"}]}] Sep 24 05:16:57.644263 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: X-Tenant: tempest-TestVolumeBootPattern-1339481357 Sep 24 05:16:57.644263 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: X-Tenant-Id: fef19544ec414094953daea6d545a361 Sep 24 05:16:57.644263 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: X-Tenant-Name: tempest-TestVolumeBootPattern-1339481357 Sep 24 05:16:57.644263 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: X-User: tempest-TestVolumeBootPattern-1339481357-project Sep 24 05:16:57.644263 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: X-User-Domain-Id: default Sep 24 05:16:57.644263 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: X-User-Domain-Name: Default Sep 24 05:16:57.644263 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: X-User-Id: 60edcebcccaa4da99ffddadd3e27c1c0 Sep 24 05:16:57.644263 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: X-User-Name: tempest-TestVolumeBootPattern-1339481357-project Sep 24 05:16:57.644263 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: method: > Sep 24 05:16:57.644263 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: exception: Instance af77c184-6aa4-4f31-b736-bf19ec7c1482 could not be found. Sep 24 05:16:57.644263 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: action_args: {'id': 'af77c184-6aa4-4f31-b736-bf19ec7c1482'} Sep 24 05:16:57.645444 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 24 05:16:57.645444 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 05:16:57.645444 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 24 05:16:57.645444 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 24 05:16:57.645444 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 24 05:16:57.645444 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 24 05:16:57.645444 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 24 05:16:57.645444 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 24 05:16:57.645444 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 24 05:16:57.645444 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 24 05:16:57.645444 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance af77c184-6aa4-4f31-b736-bf19ec7c1482 could not be found. Sep 24 05:16:57.645444 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi Sep 24 05:16:57.645444 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 05:16:57.645444 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi Sep 24 05:16:57.645444 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 05:16:57.645444 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 05:16:57.645444 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 05:16:57.645444 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 24 05:16:57.645444 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 24 05:16:57.645444 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 24 05:16:57.647356 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 24 05:16:57.647356 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 24 05:16:57.647356 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 24 05:16:57.647356 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 24 05:16:57.647356 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 24 05:16:57.647356 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 24 05:16:57.647356 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 24 05:16:57.647356 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance af77c184-6aa4-4f31-b736-bf19ec7c1482 could not be found. Sep 24 05:16:57.647356 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi Sep 24 05:16:57.647356 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 05:16:57.647356 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi Sep 24 05:16:57.647356 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 05:16:57.647356 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 05:16:57.647356 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 05:16:57.647356 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 24 05:16:57.647356 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 24 05:16:57.647356 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance af77c184-6aa4-4f31-b736-bf19ec7c1482 could not be found. Sep 24 05:16:57.647356 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi Sep 24 05:16:57.649022 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-bf5b66d1-ba92-443d-94ae-b4e65732df74 tempest-TestVolumeBootPattern-1339481357 tempest-TestVolumeBootPattern-1339481357-project] Returning 404 to user: Instance af77c184-6aa4-4f31-b736-bf19ec7c1482 could not be found. {{(pid=120593) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 24 05:16:57.649022 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-bf5b66d1-ba92-443d-94ae-b4e65732df74 tempest-TestVolumeBootPattern-1339481357 tempest-TestVolumeBootPattern-1339481357-project] 10.222.0.50 "GET /compute/v2.1/servers/af77c184-6aa4-4f31-b736-bf19ec7c1482" status: 404 len: 111 microversion: 2.1 time: 0.030853 Sep 24 05:16:57.649022 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 666/1360] 10.222.0.50 () {58 vars in 1236 bytes} [Sat Sep 24 05:16:57 2022] GET /compute/v2.1/servers/af77c184-6aa4-4f31-b736-bf19ec7c1482 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 24 05:17:00.952020 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-f2a25e42-f89b-4188-a14a-d338b437db3b tempest-TestVolumeBootPattern-1339481357 tempest-TestVolumeBootPattern-1339481357-project] Calling method '>' {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:17:00.952665 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.compute.api [None req-f2a25e42-f89b-4188-a14a-d338b437db3b tempest-TestVolumeBootPattern-1339481357 tempest-TestVolumeBootPattern-1339481357-project] [instance: 27a6c52e-9545-4713-870a-1d553eb7d609] Fetching instance by UUID {{(pid=120594) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:17:00.954214 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [req-a67ea399-7850-4189-88f9-1c8a7cbb5f5c req-72c452a6-e056-4e06-83eb-e9f12175aab6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "27a6c52e-9545-4713-870a-1d553eb7d609", "tag": "19cc232a-7d00-42f7-b737-1cb2a22e6c05"}]} {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 05:17:00.958929 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-f2a25e42-f89b-4188-a14a-d338b437db3b tempest-TestVolumeBootPattern-1339481357 tempest-TestVolumeBootPattern-1339481357-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:17:00.959413 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-f2a25e42-f89b-4188-a14a-d338b437db3b tempest-TestVolumeBootPattern-1339481357 tempest-TestVolumeBootPattern-1339481357-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:17:00.959846 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-f2a25e42-f89b-4188-a14a-d338b437db3b tempest-TestVolumeBootPattern-1339481357 tempest-TestVolumeBootPattern-1339481357-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:17:00.960537 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-f2a25e42-f89b-4188-a14a-d338b437db3b tempest-TestVolumeBootPattern-1339481357 tempest-TestVolumeBootPattern-1339481357-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:17:00.960986 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-f2a25e42-f89b-4188-a14a-d338b437db3b tempest-TestVolumeBootPattern-1339481357 tempest-TestVolumeBootPattern-1339481357-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:17:00.961405 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-f2a25e42-f89b-4188-a14a-d338b437db3b tempest-TestVolumeBootPattern-1339481357 tempest-TestVolumeBootPattern-1339481357-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:17:00.965086 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [req-a67ea399-7850-4189-88f9-1c8a7cbb5f5c req-72c452a6-e056-4e06-83eb-e9f12175aab6 service nova] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:17:00.965647 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [req-a67ea399-7850-4189-88f9-1c8a7cbb5f5c req-72c452a6-e056-4e06-83eb-e9f12175aab6 service nova] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:17:00.966690 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [req-a67ea399-7850-4189-88f9-1c8a7cbb5f5c req-72c452a6-e056-4e06-83eb-e9f12175aab6 service nova] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:17:00.978476 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.compute.server_external_events [req-a67ea399-7850-4189-88f9-1c8a7cbb5f5c req-72c452a6-e056-4e06-83eb-e9f12175aab6 service nova] Creating event network-changed:19cc232a-7d00-42f7-b737-1cb2a22e6c05 for instance 27a6c52e-9545-4713-870a-1d553eb7d609 on hv-cinder-85918 Sep 24 05:17:00.984387 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [req-a67ea399-7850-4189-88f9-1c8a7cbb5f5c req-72c452a6-e056-4e06-83eb-e9f12175aab6 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034178 Sep 24 05:17:00.985333 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 667/1361] 10.222.0.50 () {64 vars in 1317 bytes} [Sat Sep 24 05:17:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 05:17:00.988715 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.compute.api [None req-f2a25e42-f89b-4188-a14a-d338b437db3b tempest-TestVolumeBootPattern-1339481357 tempest-TestVolumeBootPattern-1339481357-project] [instance: 27a6c52e-9545-4713-870a-1d553eb7d609] Going to try to terminate instance {{(pid=120594) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 24 05:17:01.075061 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [None req-f2a25e42-f89b-4188-a14a-d338b437db3b tempest-TestVolumeBootPattern-1339481357 tempest-TestVolumeBootPattern-1339481357-project] 10.222.0.50 "DELETE /compute/v2.1/servers/27a6c52e-9545-4713-870a-1d553eb7d609" status: 204 len: 0 microversion: 2.1 time: 0.126964 Sep 24 05:17:01.081225 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 695/1362] 10.222.0.50 () {58 vars in 1239 bytes} [Sat Sep 24 05:17:00 2022] DELETE /compute/v2.1/servers/27a6c52e-9545-4713-870a-1d553eb7d609 => generated 0 bytes in 131 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 24 05:17:01.088888 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-c6aa60cf-b82c-4608-a98a-f5bf06ae322e tempest-TestVolumeBootPattern-1339481357 tempest-TestVolumeBootPattern-1339481357-project] Calling method '>' {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:17:01.090685 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.compute.api [None req-c6aa60cf-b82c-4608-a98a-f5bf06ae322e tempest-TestVolumeBootPattern-1339481357 tempest-TestVolumeBootPattern-1339481357-project] [instance: 27a6c52e-9545-4713-870a-1d553eb7d609] Fetching instance by UUID {{(pid=120593) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:17:01.097720 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-c6aa60cf-b82c-4608-a98a-f5bf06ae322e tempest-TestVolumeBootPattern-1339481357 tempest-TestVolumeBootPattern-1339481357-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:17:01.098256 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-c6aa60cf-b82c-4608-a98a-f5bf06ae322e tempest-TestVolumeBootPattern-1339481357 tempest-TestVolumeBootPattern-1339481357-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:17:01.098704 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-c6aa60cf-b82c-4608-a98a-f5bf06ae322e tempest-TestVolumeBootPattern-1339481357 tempest-TestVolumeBootPattern-1339481357-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:17:01.099406 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-c6aa60cf-b82c-4608-a98a-f5bf06ae322e tempest-TestVolumeBootPattern-1339481357 tempest-TestVolumeBootPattern-1339481357-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:17:01.099858 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-c6aa60cf-b82c-4608-a98a-f5bf06ae322e tempest-TestVolumeBootPattern-1339481357 tempest-TestVolumeBootPattern-1339481357-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:17:01.100284 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-c6aa60cf-b82c-4608-a98a-f5bf06ae322e tempest-TestVolumeBootPattern-1339481357 tempest-TestVolumeBootPattern-1339481357-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:17:01.313460 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-c6aa60cf-b82c-4608-a98a-f5bf06ae322e tempest-TestVolumeBootPattern-1339481357 tempest-TestVolumeBootPattern-1339481357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60edcebcccaa4da99ffddadd3e27c1c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fef19544ec414094953daea6d545a361', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:17:01.321636 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-c6aa60cf-b82c-4608-a98a-f5bf06ae322e tempest-TestVolumeBootPattern-1339481357 tempest-TestVolumeBootPattern-1339481357-project] 10.222.0.50 "GET /compute/v2.1/servers/27a6c52e-9545-4713-870a-1d553eb7d609" status: 200 len: 1575 microversion: 2.1 time: 0.238211 Sep 24 05:17:01.322163 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 668/1363] 10.222.0.50 () {58 vars in 1236 bytes} [Sat Sep 24 05:17:01 2022] GET /compute/v2.1/servers/27a6c52e-9545-4713-870a-1d553eb7d609 => generated 1575 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 24 05:17:02.257987 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [req-2292ae35-d86b-40fb-a61b-0a538f27b66d req-124f8d80-2ec7-401c-b73b-163d036a1902 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "27a6c52e-9545-4713-870a-1d553eb7d609", "name": "network-vif-deleted", "tag": "19cc232a-7d00-42f7-b737-1cb2a22e6c05"}]} {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 24 05:17:02.268782 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [req-2292ae35-d86b-40fb-a61b-0a538f27b66d req-124f8d80-2ec7-401c-b73b-163d036a1902 service nova] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:17:02.269248 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [req-2292ae35-d86b-40fb-a61b-0a538f27b66d req-124f8d80-2ec7-401c-b73b-163d036a1902 service nova] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:17:02.269679 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [req-2292ae35-d86b-40fb-a61b-0a538f27b66d req-124f8d80-2ec7-401c-b73b-163d036a1902 service nova] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:17:02.282900 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: INFO nova.api.openstack.compute.server_external_events [req-2292ae35-d86b-40fb-a61b-0a538f27b66d req-124f8d80-2ec7-401c-b73b-163d036a1902 service nova] Creating event network-vif-deleted:19cc232a-7d00-42f7-b737-1cb2a22e6c05 for instance 27a6c52e-9545-4713-870a-1d553eb7d609 on hv-cinder-85918 Sep 24 05:17:02.287605 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [req-2292ae35-d86b-40fb-a61b-0a538f27b66d req-124f8d80-2ec7-401c-b73b-163d036a1902 service nova] 10.222.0.50 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033990 Sep 24 05:17:02.288196 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 696/1364] 10.222.0.50 () {64 vars in 1317 bytes} [Sat Sep 24 05:17:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 24 05:17:02.344964 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-295c4f79-11a1-49b4-9558-e0bdf4a6cacb tempest-TestVolumeBootPattern-1339481357 tempest-TestVolumeBootPattern-1339481357-project] Calling method '>' {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:17:02.345568 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.compute.api [None req-295c4f79-11a1-49b4-9558-e0bdf4a6cacb tempest-TestVolumeBootPattern-1339481357 tempest-TestVolumeBootPattern-1339481357-project] [instance: 27a6c52e-9545-4713-870a-1d553eb7d609] Fetching instance by UUID {{(pid=120593) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:17:02.351933 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-295c4f79-11a1-49b4-9558-e0bdf4a6cacb tempest-TestVolumeBootPattern-1339481357 tempest-TestVolumeBootPattern-1339481357-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:17:02.352348 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-295c4f79-11a1-49b4-9558-e0bdf4a6cacb tempest-TestVolumeBootPattern-1339481357 tempest-TestVolumeBootPattern-1339481357-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:17:02.352780 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-295c4f79-11a1-49b4-9558-e0bdf4a6cacb tempest-TestVolumeBootPattern-1339481357 tempest-TestVolumeBootPattern-1339481357-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:17:02.353491 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-295c4f79-11a1-49b4-9558-e0bdf4a6cacb tempest-TestVolumeBootPattern-1339481357 tempest-TestVolumeBootPattern-1339481357-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:17:02.353936 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-295c4f79-11a1-49b4-9558-e0bdf4a6cacb tempest-TestVolumeBootPattern-1339481357 tempest-TestVolumeBootPattern-1339481357-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:17:02.354382 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-295c4f79-11a1-49b4-9558-e0bdf4a6cacb tempest-TestVolumeBootPattern-1339481357 tempest-TestVolumeBootPattern-1339481357-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:17:02.421067 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.policy [None req-295c4f79-11a1-49b4-9558-e0bdf4a6cacb tempest-TestVolumeBootPattern-1339481357 tempest-TestVolumeBootPattern-1339481357-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60edcebcccaa4da99ffddadd3e27c1c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fef19544ec414094953daea6d545a361', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120593) authorize /opt/stack/nova/nova/policy.py:199}} Sep 24 05:17:02.429088 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-295c4f79-11a1-49b4-9558-e0bdf4a6cacb tempest-TestVolumeBootPattern-1339481357 tempest-TestVolumeBootPattern-1339481357-project] 10.222.0.50 "GET /compute/v2.1/servers/27a6c52e-9545-4713-870a-1d553eb7d609" status: 200 len: 1224 microversion: 2.1 time: 0.088357 Sep 24 05:17:02.429987 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 669/1365] 10.222.0.50 () {58 vars in 1236 bytes} [Sat Sep 24 05:17:02 2022] GET /compute/v2.1/servers/27a6c52e-9545-4713-870a-1d553eb7d609 => generated 1224 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 24 05:17:03.453463 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-fd7939dc-eb9a-4590-aacd-8005b13a5083 tempest-TestVolumeBootPattern-1339481357 tempest-TestVolumeBootPattern-1339481357-project] Calling method '>' {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:17:03.454184 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.compute.api [None req-fd7939dc-eb9a-4590-aacd-8005b13a5083 tempest-TestVolumeBootPattern-1339481357 tempest-TestVolumeBootPattern-1339481357-project] [instance: 27a6c52e-9545-4713-870a-1d553eb7d609] Fetching instance by UUID {{(pid=120594) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:17:03.460237 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-fd7939dc-eb9a-4590-aacd-8005b13a5083 tempest-TestVolumeBootPattern-1339481357 tempest-TestVolumeBootPattern-1339481357-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:17:03.460710 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-fd7939dc-eb9a-4590-aacd-8005b13a5083 tempest-TestVolumeBootPattern-1339481357 tempest-TestVolumeBootPattern-1339481357-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:17:03.461143 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-fd7939dc-eb9a-4590-aacd-8005b13a5083 tempest-TestVolumeBootPattern-1339481357 tempest-TestVolumeBootPattern-1339481357-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:17:03.461824 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-fd7939dc-eb9a-4590-aacd-8005b13a5083 tempest-TestVolumeBootPattern-1339481357 tempest-TestVolumeBootPattern-1339481357-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:17:03.462298 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-fd7939dc-eb9a-4590-aacd-8005b13a5083 tempest-TestVolumeBootPattern-1339481357 tempest-TestVolumeBootPattern-1339481357-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:17:03.462722 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-fd7939dc-eb9a-4590-aacd-8005b13a5083 tempest-TestVolumeBootPattern-1339481357 tempest-TestVolumeBootPattern-1339481357-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:17:03.476145 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: INFO nova.api.openstack.wsgi [None req-fd7939dc-eb9a-4590-aacd-8005b13a5083 tempest-TestVolumeBootPattern-1339481357 tempest-TestVolumeBootPattern-1339481357-project] HTTP exception thrown: Instance 27a6c52e-9545-4713-870a-1d553eb7d609 could not be found. Sep 24 05:17:03.477720 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-fd7939dc-eb9a-4590-aacd-8005b13a5083 tempest-TestVolumeBootPattern-1339481357 tempest-TestVolumeBootPattern-1339481357-project] Request method failure captured: Sep 24 05:17:03.477720 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: request: GET /compute/v2.1/servers/27a6c52e-9545-4713-870a-1d553eb7d609 HTTP/1.1 Sep 24 05:17:03.477720 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: Accept: application/json Sep 24 05:17:03.477720 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: Accept-Encoding: identity Sep 24 05:17:03.477720 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: Connection: close Sep 24 05:17:03.477720 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: Content-Length: 0 Sep 24 05:17:03.477720 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: Content-Type: application/json Sep 24 05:17:03.477720 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: Host: 10.222.0.50 Sep 24 05:17:03.477720 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: Openstack-System-Scope: None Sep 24 05:17:03.477720 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: User-Agent: python-urllib3/1.26.12 Sep 24 05:17:03.477720 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: X-Auth-Token: gAAAAABjLpCeE6D8vgXPZLE3UBn0EhNuNAYlX4X3foH_VqnJAbIepC8Hc1OmT41Tw45wEmDv7hYnAhqK7ORd7IXvHMNstcXMw_K7lenr8Yq0POwG1OxUbYSMAfzKDSF3S9nluknty2XjO7EseuzEnqkeZNGMERgJ_Hq7ozqEKQYIgCWBxUwAM1U Sep 24 05:17:03.477720 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: X-Domain-Id: None Sep 24 05:17:03.477720 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: X-Domain-Name: None Sep 24 05:17:03.477720 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: X-Identity-Status: Confirmed Sep 24 05:17:03.477720 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: X-Is-Admin-Project: True Sep 24 05:17:03.477720 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: X-Project-Domain-Id: default Sep 24 05:17:03.477720 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: X-Project-Domain-Name: Default Sep 24 05:17:03.477720 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: X-Project-Id: fef19544ec414094953daea6d545a361 Sep 24 05:17:03.477720 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: X-Project-Name: tempest-TestVolumeBootPattern-1339481357 Sep 24 05:17:03.477720 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: X-Role: member,reader Sep 24 05:17:03.477720 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: X-Roles: member,reader Sep 24 05:17:03.479433 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/fef19544ec414094953daea6d545a361"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/fef19544ec414094953daea6d545a361"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/fef19544ec414094953daea6d545a361"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.50:8080", "publicURL": "http://10.222.0.50:8080/v1/AUTH_fef19544ec414094953daea6d545a361"}]}] Sep 24 05:17:03.479433 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: X-Tenant: tempest-TestVolumeBootPattern-1339481357 Sep 24 05:17:03.479433 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: X-Tenant-Id: fef19544ec414094953daea6d545a361 Sep 24 05:17:03.479433 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: X-Tenant-Name: tempest-TestVolumeBootPattern-1339481357 Sep 24 05:17:03.479433 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: X-User: tempest-TestVolumeBootPattern-1339481357-project Sep 24 05:17:03.479433 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: X-User-Domain-Id: default Sep 24 05:17:03.479433 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: X-User-Domain-Name: Default Sep 24 05:17:03.479433 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: X-User-Id: 60edcebcccaa4da99ffddadd3e27c1c0 Sep 24 05:17:03.479433 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: X-User-Name: tempest-TestVolumeBootPattern-1339481357-project Sep 24 05:17:03.479433 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: method: > Sep 24 05:17:03.479433 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: exception: Instance 27a6c52e-9545-4713-870a-1d553eb7d609 could not be found. Sep 24 05:17:03.479433 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: action_args: {'id': '27a6c52e-9545-4713-870a-1d553eb7d609'} Sep 24 05:17:03.480445 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 24 05:17:03.480445 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 05:17:03.480445 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 24 05:17:03.480445 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 24 05:17:03.480445 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 24 05:17:03.480445 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 24 05:17:03.480445 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 24 05:17:03.480445 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 24 05:17:03.480445 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 24 05:17:03.480445 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 24 05:17:03.480445 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 27a6c52e-9545-4713-870a-1d553eb7d609 could not be found. Sep 24 05:17:03.480445 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi Sep 24 05:17:03.480445 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 05:17:03.480445 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi Sep 24 05:17:03.480445 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 05:17:03.480445 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 05:17:03.480445 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 05:17:03.480445 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 24 05:17:03.480445 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 24 05:17:03.480445 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 24 05:17:03.482254 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 24 05:17:03.482254 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 24 05:17:03.482254 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 24 05:17:03.482254 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 24 05:17:03.482254 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 24 05:17:03.482254 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 24 05:17:03.482254 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 24 05:17:03.482254 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 27a6c52e-9545-4713-870a-1d553eb7d609 could not be found. Sep 24 05:17:03.482254 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi Sep 24 05:17:03.482254 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 05:17:03.482254 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi Sep 24 05:17:03.482254 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 05:17:03.482254 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 05:17:03.482254 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 05:17:03.482254 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 24 05:17:03.482254 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 24 05:17:03.482254 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 27a6c52e-9545-4713-870a-1d553eb7d609 could not be found. Sep 24 05:17:03.482254 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi Sep 24 05:17:03.483672 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-fd7939dc-eb9a-4590-aacd-8005b13a5083 tempest-TestVolumeBootPattern-1339481357 tempest-TestVolumeBootPattern-1339481357-project] Returning 404 to user: Instance 27a6c52e-9545-4713-870a-1d553eb7d609 could not be found. {{(pid=120594) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 24 05:17:03.483672 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [None req-fd7939dc-eb9a-4590-aacd-8005b13a5083 tempest-TestVolumeBootPattern-1339481357 tempest-TestVolumeBootPattern-1339481357-project] 10.222.0.50 "GET /compute/v2.1/servers/27a6c52e-9545-4713-870a-1d553eb7d609" status: 404 len: 111 microversion: 2.1 time: 0.030880 Sep 24 05:17:03.483672 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 697/1366] 10.222.0.50 () {58 vars in 1236 bytes} [Sat Sep 24 05:17:03 2022] GET /compute/v2.1/servers/27a6c52e-9545-4713-870a-1d553eb7d609 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 24 05:17:03.904340 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-f2d152bd-69c8-41eb-8a5d-8990c110d590 tempest-TestVolumeBootPattern-1339481357 tempest-TestVolumeBootPattern-1339481357-project] Calling method '>' {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:17:03.904821 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.compute.api [None req-f2d152bd-69c8-41eb-8a5d-8990c110d590 tempest-TestVolumeBootPattern-1339481357 tempest-TestVolumeBootPattern-1339481357-project] [instance: dd7d8b54-2d8e-4a74-912f-4eab2ccf2125] Fetching instance by UUID {{(pid=120593) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:17:03.911372 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-f2d152bd-69c8-41eb-8a5d-8990c110d590 tempest-TestVolumeBootPattern-1339481357 tempest-TestVolumeBootPattern-1339481357-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:17:03.911851 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-f2d152bd-69c8-41eb-8a5d-8990c110d590 tempest-TestVolumeBootPattern-1339481357 tempest-TestVolumeBootPattern-1339481357-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:17:03.912283 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-f2d152bd-69c8-41eb-8a5d-8990c110d590 tempest-TestVolumeBootPattern-1339481357 tempest-TestVolumeBootPattern-1339481357-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:17:03.912964 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-f2d152bd-69c8-41eb-8a5d-8990c110d590 tempest-TestVolumeBootPattern-1339481357 tempest-TestVolumeBootPattern-1339481357-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:17:03.913417 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-f2d152bd-69c8-41eb-8a5d-8990c110d590 tempest-TestVolumeBootPattern-1339481357 tempest-TestVolumeBootPattern-1339481357-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:17:03.913841 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG oslo_concurrency.lockutils [None req-f2d152bd-69c8-41eb-8a5d-8990c110d590 tempest-TestVolumeBootPattern-1339481357 tempest-TestVolumeBootPattern-1339481357-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120593) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:17:03.927015 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.wsgi [None req-f2d152bd-69c8-41eb-8a5d-8990c110d590 tempest-TestVolumeBootPattern-1339481357 tempest-TestVolumeBootPattern-1339481357-project] HTTP exception thrown: Instance dd7d8b54-2d8e-4a74-912f-4eab2ccf2125 could not be found. Sep 24 05:17:03.928694 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-f2d152bd-69c8-41eb-8a5d-8990c110d590 tempest-TestVolumeBootPattern-1339481357 tempest-TestVolumeBootPattern-1339481357-project] Request method failure captured: Sep 24 05:17:03.928694 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: request: DELETE /compute/v2.1/servers/dd7d8b54-2d8e-4a74-912f-4eab2ccf2125 HTTP/1.1 Sep 24 05:17:03.928694 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: Accept: application/json Sep 24 05:17:03.928694 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: Accept-Encoding: identity Sep 24 05:17:03.928694 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: Connection: close Sep 24 05:17:03.928694 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: Content-Length: 0 Sep 24 05:17:03.928694 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: Content-Type: application/json Sep 24 05:17:03.928694 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: Host: 10.222.0.50 Sep 24 05:17:03.928694 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: Openstack-System-Scope: None Sep 24 05:17:03.928694 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: User-Agent: python-urllib3/1.26.12 Sep 24 05:17:03.928694 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: X-Auth-Token: gAAAAABjLpCeE6D8vgXPZLE3UBn0EhNuNAYlX4X3foH_VqnJAbIepC8Hc1OmT41Tw45wEmDv7hYnAhqK7ORd7IXvHMNstcXMw_K7lenr8Yq0POwG1OxUbYSMAfzKDSF3S9nluknty2XjO7EseuzEnqkeZNGMERgJ_Hq7ozqEKQYIgCWBxUwAM1U Sep 24 05:17:03.928694 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: X-Domain-Id: None Sep 24 05:17:03.928694 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: X-Domain-Name: None Sep 24 05:17:03.928694 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: X-Identity-Status: Confirmed Sep 24 05:17:03.928694 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: X-Is-Admin-Project: True Sep 24 05:17:03.928694 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: X-Project-Domain-Id: default Sep 24 05:17:03.928694 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: X-Project-Domain-Name: Default Sep 24 05:17:03.928694 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: X-Project-Id: fef19544ec414094953daea6d545a361 Sep 24 05:17:03.928694 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: X-Project-Name: tempest-TestVolumeBootPattern-1339481357 Sep 24 05:17:03.928694 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: X-Role: member,reader Sep 24 05:17:03.928694 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: X-Roles: member,reader Sep 24 05:17:03.930486 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/fef19544ec414094953daea6d545a361"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/fef19544ec414094953daea6d545a361"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/fef19544ec414094953daea6d545a361"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.50:8080", "publicURL": "http://10.222.0.50:8080/v1/AUTH_fef19544ec414094953daea6d545a361"}]}] Sep 24 05:17:03.930486 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: X-Tenant: tempest-TestVolumeBootPattern-1339481357 Sep 24 05:17:03.930486 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: X-Tenant-Id: fef19544ec414094953daea6d545a361 Sep 24 05:17:03.930486 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: X-Tenant-Name: tempest-TestVolumeBootPattern-1339481357 Sep 24 05:17:03.930486 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: X-User: tempest-TestVolumeBootPattern-1339481357-project Sep 24 05:17:03.930486 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: X-User-Domain-Id: default Sep 24 05:17:03.930486 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: X-User-Domain-Name: Default Sep 24 05:17:03.930486 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: X-User-Id: 60edcebcccaa4da99ffddadd3e27c1c0 Sep 24 05:17:03.930486 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: X-User-Name: tempest-TestVolumeBootPattern-1339481357-project Sep 24 05:17:03.930486 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: method: > Sep 24 05:17:03.930486 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: exception: Instance dd7d8b54-2d8e-4a74-912f-4eab2ccf2125 could not be found. Sep 24 05:17:03.930486 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: action_args: {'id': 'dd7d8b54-2d8e-4a74-912f-4eab2ccf2125'} Sep 24 05:17:03.931570 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 24 05:17:03.931570 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 05:17:03.931570 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 24 05:17:03.931570 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 24 05:17:03.931570 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 24 05:17:03.931570 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 24 05:17:03.931570 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 24 05:17:03.931570 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 24 05:17:03.931570 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 24 05:17:03.931570 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 24 05:17:03.931570 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dd7d8b54-2d8e-4a74-912f-4eab2ccf2125 could not be found. Sep 24 05:17:03.931570 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi Sep 24 05:17:03.931570 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 05:17:03.931570 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi Sep 24 05:17:03.931570 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 05:17:03.931570 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 05:17:03.931570 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 05:17:03.931570 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 24 05:17:03.931570 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 24 05:17:03.931570 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 24 05:17:03.933147 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 24 05:17:03.933147 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 24 05:17:03.933147 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 24 05:17:03.933147 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 24 05:17:03.933147 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 24 05:17:03.933147 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 24 05:17:03.933147 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 24 05:17:03.933147 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 24 05:17:03.933147 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 24 05:17:03.933147 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dd7d8b54-2d8e-4a74-912f-4eab2ccf2125 could not be found. Sep 24 05:17:03.933147 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi Sep 24 05:17:03.933147 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 05:17:03.933147 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi Sep 24 05:17:03.933147 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 05:17:03.933147 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 05:17:03.933147 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 05:17:03.933147 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 24 05:17:03.933147 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 24 05:17:03.933147 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dd7d8b54-2d8e-4a74-912f-4eab2ccf2125 could not be found. Sep 24 05:17:03.933147 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: ERROR nova.api.openstack.wsgi Sep 24 05:17:03.935242 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-f2d152bd-69c8-41eb-8a5d-8990c110d590 tempest-TestVolumeBootPattern-1339481357 tempest-TestVolumeBootPattern-1339481357-project] Returning 404 to user: Instance dd7d8b54-2d8e-4a74-912f-4eab2ccf2125 could not be found. {{(pid=120593) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 24 05:17:03.935242 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-f2d152bd-69c8-41eb-8a5d-8990c110d590 tempest-TestVolumeBootPattern-1339481357 tempest-TestVolumeBootPattern-1339481357-project] 10.222.0.50 "DELETE /compute/v2.1/servers/dd7d8b54-2d8e-4a74-912f-4eab2ccf2125" status: 404 len: 111 microversion: 2.1 time: 0.029837 Sep 24 05:17:03.935242 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 670/1367] 10.222.0.50 () {58 vars in 1239 bytes} [Sat Sep 24 05:17:03 2022] DELETE /compute/v2.1/servers/dd7d8b54-2d8e-4a74-912f-4eab2ccf2125 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 24 05:17:03.940421 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-27df29d9-56f5-4788-903e-684949ed1484 tempest-TestVolumeBootPattern-1339481357 tempest-TestVolumeBootPattern-1339481357-project] Calling method '>' {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:17:03.941024 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.compute.api [None req-27df29d9-56f5-4788-903e-684949ed1484 tempest-TestVolumeBootPattern-1339481357 tempest-TestVolumeBootPattern-1339481357-project] [instance: dd7d8b54-2d8e-4a74-912f-4eab2ccf2125] Fetching instance by UUID {{(pid=120594) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 24 05:17:03.947107 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-27df29d9-56f5-4788-903e-684949ed1484 tempest-TestVolumeBootPattern-1339481357 tempest-TestVolumeBootPattern-1339481357-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:17:03.947575 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-27df29d9-56f5-4788-903e-684949ed1484 tempest-TestVolumeBootPattern-1339481357 tempest-TestVolumeBootPattern-1339481357-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:17:03.948003 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-27df29d9-56f5-4788-903e-684949ed1484 tempest-TestVolumeBootPattern-1339481357 tempest-TestVolumeBootPattern-1339481357-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:17:03.948679 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-27df29d9-56f5-4788-903e-684949ed1484 tempest-TestVolumeBootPattern-1339481357 tempest-TestVolumeBootPattern-1339481357-project] Acquiring lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 24 05:17:03.949118 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-27df29d9-56f5-4788-903e-684949ed1484 tempest-TestVolumeBootPattern-1339481357 tempest-TestVolumeBootPattern-1339481357-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 24 05:17:03.949533 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG oslo_concurrency.lockutils [None req-27df29d9-56f5-4788-903e-684949ed1484 tempest-TestVolumeBootPattern-1339481357 tempest-TestVolumeBootPattern-1339481357-project] Lock "47a24eaf-35b3-42cb-8a92-f2a747d63cec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120594) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 24 05:17:03.963455 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: INFO nova.api.openstack.wsgi [None req-27df29d9-56f5-4788-903e-684949ed1484 tempest-TestVolumeBootPattern-1339481357 tempest-TestVolumeBootPattern-1339481357-project] HTTP exception thrown: Instance dd7d8b54-2d8e-4a74-912f-4eab2ccf2125 could not be found. Sep 24 05:17:03.964932 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-27df29d9-56f5-4788-903e-684949ed1484 tempest-TestVolumeBootPattern-1339481357 tempest-TestVolumeBootPattern-1339481357-project] Request method failure captured: Sep 24 05:17:03.964932 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: request: GET /compute/v2.1/servers/dd7d8b54-2d8e-4a74-912f-4eab2ccf2125 HTTP/1.1 Sep 24 05:17:03.964932 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: Accept: application/json Sep 24 05:17:03.964932 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: Accept-Encoding: identity Sep 24 05:17:03.964932 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: Connection: close Sep 24 05:17:03.964932 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: Content-Length: 0 Sep 24 05:17:03.964932 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: Content-Type: application/json Sep 24 05:17:03.964932 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: Host: 10.222.0.50 Sep 24 05:17:03.964932 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: Openstack-System-Scope: None Sep 24 05:17:03.964932 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: User-Agent: python-urllib3/1.26.12 Sep 24 05:17:03.964932 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: X-Auth-Token: gAAAAABjLpCeE6D8vgXPZLE3UBn0EhNuNAYlX4X3foH_VqnJAbIepC8Hc1OmT41Tw45wEmDv7hYnAhqK7ORd7IXvHMNstcXMw_K7lenr8Yq0POwG1OxUbYSMAfzKDSF3S9nluknty2XjO7EseuzEnqkeZNGMERgJ_Hq7ozqEKQYIgCWBxUwAM1U Sep 24 05:17:03.964932 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: X-Domain-Id: None Sep 24 05:17:03.964932 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: X-Domain-Name: None Sep 24 05:17:03.964932 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: X-Identity-Status: Confirmed Sep 24 05:17:03.964932 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: X-Is-Admin-Project: True Sep 24 05:17:03.964932 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: X-Project-Domain-Id: default Sep 24 05:17:03.964932 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: X-Project-Domain-Name: Default Sep 24 05:17:03.964932 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: X-Project-Id: fef19544ec414094953daea6d545a361 Sep 24 05:17:03.964932 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: X-Project-Name: tempest-TestVolumeBootPattern-1339481357 Sep 24 05:17:03.964932 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: X-Role: member,reader Sep 24 05:17:03.964932 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: X-Roles: member,reader Sep 24 05:17:03.966613 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/fef19544ec414094953daea6d545a361"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/volume/v3/fef19544ec414094953daea6d545a361"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2/fef19544ec414094953daea6d545a361"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.50/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.50:8080", "publicURL": "http://10.222.0.50:8080/v1/AUTH_fef19544ec414094953daea6d545a361"}]}] Sep 24 05:17:03.966613 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: X-Tenant: tempest-TestVolumeBootPattern-1339481357 Sep 24 05:17:03.966613 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: X-Tenant-Id: fef19544ec414094953daea6d545a361 Sep 24 05:17:03.966613 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: X-Tenant-Name: tempest-TestVolumeBootPattern-1339481357 Sep 24 05:17:03.966613 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: X-User: tempest-TestVolumeBootPattern-1339481357-project Sep 24 05:17:03.966613 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: X-User-Domain-Id: default Sep 24 05:17:03.966613 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: X-User-Domain-Name: Default Sep 24 05:17:03.966613 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: X-User-Id: 60edcebcccaa4da99ffddadd3e27c1c0 Sep 24 05:17:03.966613 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: X-User-Name: tempest-TestVolumeBootPattern-1339481357-project Sep 24 05:17:03.966613 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: method: > Sep 24 05:17:03.966613 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: exception: Instance dd7d8b54-2d8e-4a74-912f-4eab2ccf2125 could not be found. Sep 24 05:17:03.966613 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: action_args: {'id': 'dd7d8b54-2d8e-4a74-912f-4eab2ccf2125'} Sep 24 05:17:03.967621 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: {{(pid=120594) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 24 05:17:03.967621 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 05:17:03.967621 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 24 05:17:03.967621 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 24 05:17:03.967621 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 24 05:17:03.967621 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 24 05:17:03.967621 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 24 05:17:03.967621 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 24 05:17:03.967621 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 24 05:17:03.967621 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 24 05:17:03.967621 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dd7d8b54-2d8e-4a74-912f-4eab2ccf2125 could not be found. Sep 24 05:17:03.967621 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi Sep 24 05:17:03.967621 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 05:17:03.967621 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi Sep 24 05:17:03.967621 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 05:17:03.967621 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 05:17:03.967621 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 05:17:03.967621 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 24 05:17:03.967621 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 24 05:17:03.967621 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 24 05:17:03.969403 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 24 05:17:03.969403 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 24 05:17:03.969403 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 24 05:17:03.969403 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 24 05:17:03.969403 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 24 05:17:03.969403 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 24 05:17:03.969403 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 24 05:17:03.969403 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dd7d8b54-2d8e-4a74-912f-4eab2ccf2125 could not be found. Sep 24 05:17:03.969403 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi Sep 24 05:17:03.969403 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 24 05:17:03.969403 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi Sep 24 05:17:03.969403 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 24 05:17:03.969403 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 24 05:17:03.969403 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 24 05:17:03.969403 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 24 05:17:03.969403 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 24 05:17:03.969403 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dd7d8b54-2d8e-4a74-912f-4eab2ccf2125 could not be found. Sep 24 05:17:03.969403 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: ERROR nova.api.openstack.wsgi Sep 24 05:17:03.970876 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: DEBUG nova.api.openstack.wsgi [None req-27df29d9-56f5-4788-903e-684949ed1484 tempest-TestVolumeBootPattern-1339481357 tempest-TestVolumeBootPattern-1339481357-project] Returning 404 to user: Instance dd7d8b54-2d8e-4a74-912f-4eab2ccf2125 could not be found. {{(pid=120594) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 24 05:17:03.970876 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: INFO nova.api.openstack.requestlog [None req-27df29d9-56f5-4788-903e-684949ed1484 tempest-TestVolumeBootPattern-1339481357 tempest-TestVolumeBootPattern-1339481357-project] 10.222.0.50 "GET /compute/v2.1/servers/dd7d8b54-2d8e-4a74-912f-4eab2ccf2125" status: 404 len: 111 microversion: 2.1 time: 0.029700 Sep 24 05:17:03.970876 dv-cinder-859186-1-iscsi devstack@n-api.service[120594]: [pid: 120594|app: 0|req: 698/1368] 10.222.0.50 () {58 vars in 1236 bytes} [Sat Sep 24 05:17:03 2022] GET /compute/v2.1/servers/dd7d8b54-2d8e-4a74-912f-4eab2ccf2125 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 24 05:17:05.255147 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: DEBUG nova.api.openstack.wsgi [None req-8efb3b7a-2155-4a88-bc00-d727e108c885 tempest-TestVolumeBootPattern-1339481357 tempest-TestVolumeBootPattern-1339481357-project] Calling method '.version_select at 0x7f7950604160>' {{(pid=120593) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 24 05:17:05.282410 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: INFO nova.api.openstack.requestlog [None req-8efb3b7a-2155-4a88-bc00-d727e108c885 tempest-TestVolumeBootPattern-1339481357 tempest-TestVolumeBootPattern-1339481357-project] 10.222.0.50 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-418909133" status: 202 len: 0 microversion: 2.1 time: 0.031060 Sep 24 05:17:05.288154 dv-cinder-859186-1-iscsi devstack@n-api.service[120593]: [pid: 120593|app: 0|req: 671/1369] 10.222.0.50 () {58 vars in 1260 bytes} [Sat Sep 24 05:17:05 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-418909133 => generated 0 bytes in 33 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0)